Here is how I have been testing with either pyqt5 or 6. No need for separate virtual environments.
After I install pyqt6, I go to the installation location (site-packages) and move all the pyqt6 folders (including the *.dist-info ones) somewhere else. In my case I'm using c:\Tom\qt623. When I want to run with pyqt6, I set
PYTHONPATH=c:\Tom\qt623
When I want to run with pyqt5, I unset PYTHONPATH. It would be easy to make a batch file to do this and launch Leo, but I haven't bothered so far.
When you copy all the folders including the *.dist-info ones, then pip doesn't know that pyqt6 is installed, unless PYTHONPATH has been set. That's a benefit when you need to work with different versions.