It looks to me that one of the following is happening. Either
(a) Inline math is not configured properly so that your $ signs work as you wish. It should be like this
MathJax = {
tex: {
inlineMath: [['$', '$'], ['\\(', '\\)']]
}...
};(where you might have other things where I have "...")
OR
(b) You have conflicting CSS on your page which is setting the inline math to actually display as "block", thus getting the effect you're seeing.
It's not possible to tell without a minimal example page showing the problem.
If your configuration seems OK, you could try stripping out ALL the CSS on the page (and the math should work properly), then add in the CSS rules until it breaks.
If you have no joy, post your minimal example and we'll take a look.
Regards
Murray