I've tested this on the MathJax demo page and reported it as an issue on their GitHub page, but I thought I would mention it here as well in case it affects anyone else:
In one of my books, I have some introductory material on sets where I have the following example of a set:
<me>
S = \{x : x \text{ is a letter in ``pronghorns''}\}
</me>
(the Pronghorn being our mascot animal...)
If you do this, the equation displays correctly, but on the line below it, you'll see
pronghorns'\text{.}\}\end{equation*}
The problem goes away if I use single quotes.