Yeah, this gets discussed in typography and (La)TeX quite a bit. The x-height is the determining factor for a reader's perception of font size. In (La)TeX there are font packages which will allow one to scale all fonts being used in a publication so that they all match.
I just use Lucida or the ITC Stone fonts when I have the option, though I wish that they had more characters.
William