Most annotation measurements are generated dynamically (not part of the static Measurement List) and are not removable as a measurement. Detection measurements are fixed and part of the Measurement List, and so should be removable.
I do not think it is possible t remove things like Class or Name from the annotation display. You should be able to pick only certain columns to output when exporting data, though.