Quick reply to add that I'm using a similar technique myself, and it works really well.
I'm working on a schools astronomy project where kids will leave cameras pointing at the sky overnight, and we use
astrometry.net to figure out orientation. The kids can use the images to illustrate all sorts of bits of their astronomy and compsci curriculum, as well as hunting for meteors, planes and satellites.
But because the lenses are fish-eye, and can only solve a small rectangle in the centre of each image.
That loses me some accuracy, but I get it back by taking the average of many fits. I know each camera was static overnight, so the central declinations of all the frames should be the same, meanwhile the RAs should differ by sidereal time.
My impression is that part of the problem is that most wide-angle lenses have significant barrel distortion, and
astrometry.net is very sensitive to that.
When I first start using a new lens, I solve for the barrel distortion parameters by attempting to stack the solved frames whilst measuring how well they overlay each other. If I then go back and feed the corrected wide-angle images into
astrometry.net, I can often solve much wider fields quite comfortably.
If any
astrometry.net team members are reading this, I'll be in touch with you shortly to ask about publicity, etc. We're happy to put your logo on stuff!