This is a problem with including images generated by one of the many LaTeX servers. For these, the alt text should be the exact LaTeX code used to produce the image: it makes it accessible to those who use screen readers to read the alt text, and it makes it possible to simply cut-and-paste the formula without having to go through and undo all the Markdown escaping. Given how often the underscore is used in LaTeX formulae, it would be extremely useful to have this fixed in the markdown implementation used.
This has been fixed in the PHP markdown port (even the version without all the extras) and, I believe, in the maruku ruby variant.