Too many authentication failures for xxxx

[Jonathan]

I just recently installed jenkins version 1.609.1 and I have this problem whenever I put my git repo url and I am getting this error every time.

Failed to connect to repository : Command "git ls-remote -h gitolite@<our.ip>:our/repo HEAD" returned status code 128:
stdout: 
stderr: Permission denied, please try again. 
Permission denied, please try again. 
Received disconnect from <our.ip>: 2: Too many authentication failures for gitolite 

fatal: The remote end hung up unexpectedly

I tried to clone using terminal the same git URL and it seems that there are no problem. I also specified in the jenkins credentials different combinations using the private key( direct, from master, with passphrase etc.) and still got no progress.

A user named 'jenkins' also has been created prior to the installation and in /etc/sysconfig/jenkins I explicitly specified /home/jenkins in the JENKINS_HOME system property.

I created ~/.ssh/config file , specified IdentitesOnly to true but the same error appears.

Hope someone can help me,
Jon