In addition to certain disadvantages, floating point numbers have
several advantages, not least managing a considerable range in
magnitude in a commonly useful way. You can certainly do the same
work with fixed point, but you commonly end up spending a lot of time
watching your magnitudes and carefully managing the scaling. It's
particularly popular in scientific-type calculations, as those are
normally done in a floating point format anyway.
As to other CPUs with FPUs, almost all of the large ones in some
fashion. From ARM to zSeries. In some architectures it's optional
(ARM), in some it's always been an integral part of the ISA (IPF,
Cray-1, CDC-6600), and in some it was originally optional but is now
integral (zSeries, x86).
Small CPU often don't have defined FP ISAs, so don't expect native FP
on your 6502 or 8051.
And while you don't see it much these days, there used to be
semi-generic FP coprocessor chips that you could attach to small CPUs
if your application needed that (these days it usually makes more
sense to just upgrade to a CPU with FP support rather than adding an
external device).