Hi Parag,
Thanks for reaching out. You cannot retrieve removed user lists via the API. This is consistent with the Ads UI, which does not support viewing removed user lists. User lists can only be removed if they are not associated with any campaign or ad group.
If you would like for us to submit an internal feature request, subject to review, on your behalf, please let us know.
Regards,

ref:_00D1U1174p._5004Q2dnx7C:ref