Thanks for the tip!
I tried it with headless=old (Selenium 4.23.1 and latest chromedriver 127.0.6533.99) and it works on Jenkins.
On Jenkins no headless is not an option, but locally there were no problem with not headless / headless modes at all.
On Jenkins the tests are run in a docker, maybe this caused the freeze, locally we do not have time to try it in the docker.
If we have time we will try in docker and check it maybe we can see something.