"I have this coming out as part of the Old School Dungeons Add-On. Will that do for map annotation purposes? You’ll be able to resize and recolor the letters and numbers however you want."
And to clarify, the letters & numbers would be placed as Items, so they will always be atop tiles and overlays that you might want to annotate.