Your comments

I tried to add a new paragraph tag <p> and a break <br /> into a caption. When I view source the tags are gone. I assume the same would happen with a link.

Is there a way to get html tags to work in captions?