Yes, when the Windows-ARM64 support was added, we only tested GPU acceleration using ANGLE. (I'm not sure if that GL compatibility pack existed at the time). I think you have (at least) two options:
1) You could try installing that, and then enabling the GL backend again. Most of the changes were just to Skia's testing code, not the core library itself. Everything to disable it was (I think) in this change:
https://skia-review.googlesource.com/c/skia/+/175984/. GrGLMakeNativeInterface_Win.cpp is probably the most important (plus the GN changes to link in the GL libraries). That CPP file has moved, it now exists in the src/gpu/ganesh/gl/win directory.
2) Skia's native D3D backend might work better. It's less tested than our GL backend - none of our major clients have adopted it yet, but we do run it against our own unit tests and rendering examples.
-Brian