You can pass PCI devices to bhyve hosts. I'm currently using the
wifibox port and passing my Intel WiFi card to a Linux VM to use the
Linux driver. If you are okay with the host not accessing USB devices
on a specific controller, you could pass the entire USB controller to
the VM.
If you want a VM solution with decent USB passthrough of single
devices, you could have a look at Virtualbox. It's in the port tree
and worked fairly well on FreeBSD the last time I used it. Note that
you can NOT run Virtualbox and Bhyve at the same time. Loading bhyve
kernel modules and Virtualbax kernel modules at the same time crashed
my machine last I tried it.