Jenkins is hanging

[Benoit Sautel]

Hello.

I upgraded my Jenkins to the latest version. It is now unable to start. I get all symptoms described here.

I tried to remove all the configuration and jobs, but it still can't start.

It runs on a Debian Squeeze server, with Java OpenJDK 1.6.0_27.

In the log file I don't see any abnormal message:

Running from: /usr/share/jenkins/jenkins.war
Nov 14, 2013 10:10:07 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: jetty-8.y.z-SNAPSHOT
Nov 14, 2013 10:10:08 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Extract jar:file:/usr/share/jenkins/jenkins.war!/ to /tmp/jetty-0.0.0.0-8080-jenkins.war--any-/webapp
Nov 14, 2013 10:10:11 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: NO JSP Support for , did not find org.apache.jasper.servlet.JspServlet
Jenkins home directory: /var/lib/jenkins found at: EnvVars.masterEnvVars.get("JENKINS_HOME")
Nov 14, 2013 10:10:12 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: Started SelectChann...@0.0.0.0:8080
Nov 14, 2013 10:10:12 PM winstone.Logger logInternal
INFO: Winstone Servlet Engine v2.0 running: controlPort=disabled
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Nov 14, 2013 10:10:12 PM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs

Here is the jmap report of the Jenkins process:

JVM version is 20.0-b12

using thread-local object allocation.
Parallel GC with 18 thread(s)

Heap Configuration:
   MinHeapFreeRatio = 40
   MaxHeapFreeRatio = 70
   MaxHeapSize      = 698351616 (666.0MB)
   NewSize          = 1310720 (1.25MB)
   MaxNewSize       = 17592186044415 MB
   OldSize          = 5439488 (5.1875MB)
   NewRatio         = 2
   SurvivorRatio    = 8
   PermSize         = 21757952 (20.75MB)
   MaxPermSize      = 174063616 (166.0MB)

Heap Usage:
PS Young Generation
Eden Space:
   capacity = 211484672 (201.6875MB)
   used     = 61938720 (59.069366455078125MB)
   free     = 149545952 (142.61813354492188MB)
   29.28756936105516% used
From Space:
   capacity = 5177344 (4.9375MB)
   used     = 5172992 (4.933349609375MB)
   free     = 4352 (0.004150390625MB)
   99.9159414556962% used
To Space:
   capacity = 7733248 (7.375MB)
   used     = 0 (0.0MB)
   free     = 7733248 (7.375MB)
   0.0% used
PS Old Generation
   capacity = 22413312 (21.375MB)
   used     = 12653512 (12.067329406738281MB)
   free     = 9759800 (9.307670593261719MB)
   56.455342253746345% used
PS Perm Generation
   capacity = 45940736 (43.8125MB)
   used     = 45796672 (43.67510986328125MB)
   free     = 144064 (0.13739013671875MB)
   99.68641338266762% used

It sounds like the perm generation is nearly full. I tried to increase it with -XX:MaxPermSize=256M but it dit not change anything.

I joined the jstack report but it seems to indicate that there is no deadlock.

I also noted that when I stop the Jenkins service, the process keeps running. I have to kill -9 it to get it stop.

Would someone know where the problem comes from?

Thanks in advance. And thank you for developing Jenkins which is an awesome product.

[Etienne Grandier-Vazeille]

Hi

Same issue on Windows 7 x64 with jenkins 1.540 and JDK 1.7.0_17.

One solution is downgrade to oldest version like 1.526.

[mp]

A similar problem occured on our CenOS 6.4 instance. Setting -XX:PermSize
(note, no Max) helped remove the 99% utilization number, but jenkins still
hangs.



--
View this message in context: http://jenkins-ci.361315.n4.nabble.com/Jenkins-is-hanging-tp4680288p4690451.html
Sent from the Jenkins users mailing list archive at Nabble.com.