Giving this a vote since I desperately need the repo-plugin to be able to use passphrase-protected keys in the the polling phase. Unfortunately the ssh-agent only works in the actual build.
Vote +1 also from me I really need this feature!
BR