Well, I suppose it will depend on how fast your machine is/gonna be. If it is a slow machine, maybe a Pi5 will not be the bottleneck. I have an ongoing project machine, which is slow in it self, where I have tested Pi5 4GB(if memory serves me right), using two MIPI cameras for top/bottom vision. The UI was a bit sluggish, and I have yet to learn how well vision is working. The project is parked due to other stuff... But it is nice to have such a small setup. :-)
I'd say, given you intend to work for speed, you should skip using a Pi as a first step, and go for a typical computer instead. That way, the upgrades are easier.