Follow up, after diving into this, I've found out that the Changeset class inside the changeview has a method causing this error. So I can override the changeset class and the changeview method of the admin model class and it would work.
I also found out that a far easier and probably more "djangoish" solution is just a add an admin filter with those query params, and not use them to filter the queryset. thus the whole inner django machinery treats those params as legit as they are tied to a "filter" :)
Thanks for the pointers !