HELP! Jenkins no longer connects to Subversion (svn: REPORT of /svn/repo_name/!svn/vcc/default: 500 Internal Server Error)

701 views
Skip to first unread message

Masariello

unread,
Jul 2, 2013, 4:39:17 PM7/2/13
to jenkins...@googlegroups.com
I've been running a Jenkins 1.480.x + VisualSvn 2.5.x since Nov 2012.

A few days ago we started to experience the exception below ('500 Internal Server Error'). For a few times the problem went away after a reboot. But today everything started to fail ALWAYS.

This started to happen completely out of the blue, with Jenkins Subversion plugin v1.39. Upgrading to v1.50 did not help.

Every time I get the exception, the Subversion server logs and event saying "Could not access revision times. [500.#0]".

The svn polling log shows that Jenkins is successfully detecting new commits in the repositories. The problem below happens during checkout.

The Subversion server seems to be working absolutely fine, both via simple http, and via TortoiseSvn.

I've tried
  • upgrading to VisualSvn 2.6, with no change.
  • having Jenkins access svn via the server hostname, rather than its DNS alias (causing Jenkins to re-auth)
  • wiping all the workspaces
Nothing seems to work.

Has anyone else seen this before?

Thanks in advance!


org.tmatesoft.svn.core.SVNException: svn: REPORT of /svn/fineng/!svn/vcc/default: 500 Internal Server Error (http://svn)
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:64)
	at org.tmatesoft.svn.core.internal.wc.SVNErrorManager.error(SVNErrorManager.java:51)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.getDatedRevision(DAVRepository.java:207)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.getRevisionNumber(SVNBasicClient.java:477)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.getLocations(SVNBasicClient.java:882)
	at org.tmatesoft.svn.core.wc.SVNBasicClient.createRepository(SVNBasicClient.java:534)
	at org.tmatesoft.svn.core.wc.SVNUpdateClient.doCheckout(SVNUpdateClient.java:901)
	at hudson.scm.subversion.CheckoutUpdater$1.perform(CheckoutUpdater.java:84)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:136)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:144)
	at hudson.scm.subversion.UpdateUpdater$TaskImpl.perform(UpdateUpdater.java:121)
	at hudson.scm.subversion.WorkspaceUpdater$UpdateTask.delegateTo(WorkspaceUpdater.java:136)
	at hudson.scm.SubversionSCM$CheckOutTask.perform(SubversionSCM.java:788)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:769)
	at hudson.scm.SubversionSCM$CheckOutTask.invoke(SubversionSCM.java:753)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2246)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:326)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at hudson.remoting.Engine$1$1.run(Engine.java:58)
	at java.lang.Thread.run(Unknown Source)
Caused by: org.tmatesoft.svn.core.SVNErrorMessage: svn: REPORT of /svn/fineng/!svn/vcc/default: 500 Internal Server Error (http://svn)
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:200)
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:181)
	at org.tmatesoft.svn.core.SVNErrorMessage.create(SVNErrorMessage.java:133)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.createDefaultErrorMessage(HTTPRequest.java:444)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.readError(HTTPRequest.java:288)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPRequest.dispatch(HTTPRequest.java:213)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection._request(HTTPConnection.java:379)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:292)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:283)
	at org.tmatesoft.svn.core.internal.io.dav.http.HTTPConnection.request(HTTPConnection.java:271)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:283)
	at org.tmatesoft.svn.core.internal.io.dav.DAVConnection.doReport(DAVConnection.java:274)
	at org.tmatesoft.svn.core.internal.io.dav.DAVRepository.getDatedRevision(DAVRepository.java:200)
	... 23 more
FATAL: null
java.lang.NullPointerException
	at java.util.ArrayList.addAll(Unknown Source)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
	at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
	at hudson.model.AbstractProject.checkout(AbstractProject.java:1256)
	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:590)
	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:495)
	at hudson.model.Run.execute(Run.java:1502)
	at hudson.matrix.MatrixBuild.run(MatrixBuild.java:289)
	at hudson.model.ResourceController.execute(ResourceController.java:88)
	at hudson.model.Executor.run(Executor.java:237)
	at hudson.model.OneOffExecutor.run(OneOffExecutor.java:66)

Matthew...@diamond.ac.uk

unread,
Jul 3, 2013, 3:41:55 AM7/3/13
to jenkins...@googlegroups.com

Are the clocks on the Jenkins machine and the subversion server in sync (e.g. via ntp)? They need to be.

Matthew

 

From: jenkins...@googlegroups.com [mailto:jenkins...@googlegroups.com] On Behalf Of Masariello
Sent: 02 July 2013 21:39
To: jenkins...@googlegroups.com
Subject: HELP! Jenkins no longer connects to Subversion (svn: REPORT of /svn/repo_name/!svn/vcc/default: 500 Internal Server Error)

 

I've been running a Jenkins 1.480.x + VisualSvn 2.5.x since Nov 2012.

 

A few days ago we started to experience the exception below ('500 Internal Server Error'). For a few times the problem went away after a reboot. But today everything started to fail ALWAYS.

 

This started to happen completely out of the blue, with Jenkins Subversion plugin v1.39. Upgrading to v1.50 did not help.

 

Every time I get the exception, the Subversion server logs and event saying "Could not access revision times. [500.#0]".

 

The svn polling log shows that Jenkins is successfully detecting new commits in the repositories. The problem below happens during checkout.

 

The Subversion server seems to be working absolutely fine, both via simple http, and via TortoiseSvn.

 

I've tried

  • upgrading to VisualSvn 2.6, with no change.
  • having Jenkins access svn via the server hostname, rather than its DNS alias (causing Jenkins to re-auth)
  • wiping all the workspaces

Nothing seems to work.

 

Has anyone else seen this before?

 

Thanks in advance!


 

-- 

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
 


Masariello

unread,
Jul 3, 2013, 5:31:27 AM7/3/13
to jenkins...@googlegroups.com, Matthew...@diamond.ac.uk
Yes, the clocks are in sync. And the checkout started to work again.

Unfortunately I did not think of checking the clocks yesterday. Will certainly do it next time I get the problem.

Thanks for the prompt feedback! 

Masariello

unread,
Aug 28, 2013, 5:58:51 AM8/28/13
to jenkins...@googlegroups.com, Matthew...@diamond.ac.uk
The problem has come back a couple of times since I last posted on this thread.

It always went away on its own after a few hours, but this time it's sticking around. It came back yesterday afternoon 5pm GMT, and it's still there.

The same issue seems to be affecting Jenkins installations that use the SourceForge Subversion repositories.

This is a killer, guys.

I tried upgrading from 1.480.3 to an LTS 1.509 and all my matrix jobs stopped loading. I'm really stuck on this one...

Masariello

unread,
Aug 28, 2013, 7:30:24 AM8/28/13
to jenkins...@googlegroups.com, Matthew...@diamond.ac.uk
Correction: I could upgrade to LTS 1.509.2 and *all* the latest and greatest versions of the plugins.
I also upgraded to VisualSvn 2.6.4.
But I still get the error.

The VisualSvn server is now reporting the following in the log

Could not access revision times.  [500, #175002]

Re-stuck.
Reply all
Reply to author
Forward
0 new messages