Thanks for the reply! I'm posting here for the sake of the community.
The app in question has been on Play for almost a decade, and is still using the original ad unit from back then. I've recently added other ad units that will be using mediation, which was what I was trying to test.
The reason I suspect this particular Ad Unit is because the crash occurs when the code calls com.google.android.ads.mediationtestsuite.dataobjects.AdUnit.<init> for that legacy ad unit.
I've seen the crash both on simulator using API 29 and on my Pixel 3 device that uses latest Android 10.
I'll be sending further sensitive details via private reply.