I'm using the Checkout over SSH trait and still have the same issue when Jenkins is restarting.
It is pretty annoying for us at the moment because we are setting up a new Jenkins instance and we are restarting it a lot when installing other plugins or doing some tests.
Jenkins version 2.227 gitlab-branch-source-plugin version 1.4.4