I have been using a USB-to-SSD for about 6mo, no issues, just need to use external power to power BBB.
As for the NVMe cards, I've heard it's a hit/miss on getting the USB-to-NVMe to work reliably. Plus these converters are somewhat more expensive than the ones for SSD.