do lsusb and look at your devices. see what bus numbers they on.
then do readlink /sys/bus/usb/devices/usb# # = whatever number you saw from lsusb.
Then add those controllers you want to sys-usb.
Delete the sys-usb and recreate it. if you having problems create it with qubesctl command.
https://www.qubes-os.org/doc/usb/ if you already used qubesctl doublecheck that.<
in 3.2 you can try just adding the
"single usb device". https://www.qubes-os.org/doc/assigning-devices/