[JIRA] [core] (JENKINS-33845) Jenkins 1.654 cannot restart safely

5 views
Skip to first unread message

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:21:01 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker created an issue
 
Jenkins / Bug JENKINS-33845
Jenkins 1.654 cannot restart safely
Issue Type: Bug Bug
Assignee: Unassigned
Components: core
Created: 2016/Mar/28 6:20 AM
Labels: 2.0 2.0-planned
Priority: Critical Critical
Reporter: Monique Maker

Reproduction steps:
1) Select many plugins for upgrade
2) Update them with "restart after installation option"

Expected behavior:

  • Jenkins installs plugins and restarts

Actual behavior:

  • Jenkins shuts down the web UI
  • Jenkins does not restart due to "Caused by: java.lang.UnsupportedOperationException
    at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove"
  • Jenkins cannot open the UI anymore due to the exception from getActiveInstance()

Log:

Mar 22, 2016 5:38:30 PM hudson.model.UpdateCenter$UpdateCenterConfiguration download
INFO: Downloading JUnit Plugin
Mar 22, 2016 5:38:30 PM jenkins.model.Jenkins$27 run
INFO: Restart in 10 seconds
Mar 22, 2016 5:38:40 PM jenkins.model.Jenkins$27 run
SEVERE: Restarting VM as requested by anonymous
Mar 22, 2016 5:38:40 PM jenkins.model.Jenkins cleanUp
INFO: Stopping Jenkins
Mar 22, 2016 5:38:40 PM jenkins.model.Jenkins$22 onAttained
INFO: Started termination
Mar 22, 2016 5:38:40 PM com.cloudbees.opscenter.context.Messaging$Local close
INFO: Messaging Stopped
Mar 22, 2016 5:38:40 PM jenkins.model.Jenkins$22 onAttained
INFO: Completed termination
Mar 22, 2016 5:38:40 PM jenkins.model.Jenkins _cleanUpDisconnectComputers
INFO: Starting node disconnection
Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins _cleanUpShutdownPluginManager
INFO: Stopping plugin manager
Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins _cleanUpPersistQueue
INFO: Persisting build queue
Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins _cleanUpAwaitDisconnects
INFO: Waiting for node disconnection completion
Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins _cleanUpPluginServletFilters
SEVERE: Failed to stop filters
java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java:3292)
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2945)
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$27.run(Jenkins.java:3901)

Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins cleanUp
INFO: Jenkins stopped
Mar 22, 2016 5:38:41 PM jenkins.model.Jenkins$27 run
WARNING: Failed to restart Jenkins
java.lang.RuntimeException: Unexpected issues encountered during cleanUp: null
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2960)
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$27.run(Jenkins.java:3901)
Caused by: java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java:3292)
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2945)
        ... 2 more

Mar 22, 2016 5:38:41 PM org.eclipse.jetty.util.log.JavaUtilLog warn
WARNING: Error while serving http://172.30.0.217:8080/adjuncts/b616bb17/lib/layout/menu_right_arrow.png
java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:324)
        at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:167)
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:100)
        at org.kohsuke.stapler.MetaClass$12.dispatch(MetaClass.java:403)
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649)
        at org.kohsuke.stapler.Stapler.service(Stapler.java:238)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
....
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: javax.servlet.ServletException: org.apache.commons.jelly.JellyTagException: jar:file:/var/cache/jenkins/war/WEB-INF/lib/jenkins-core-2.0-alpha-5-SNAPSHOT.jar!/lib/layout/layout.jelly:161:89: <j:invokeStatic> method getActiveInstance threw exception: Jenkins has not been started, or was already shut down
        at org.kohsuke.stapler.jelly.JellyRequestDispatcher.forward(JellyRequestDispatcher.java:60)
        at hudson.util.HudsonIsRestarting.doDynamic(HudsonIsRestarting.java:45)
        ... 65 more
Caused by: org.apache.commons.jelly.JellyTagException: jar:file:/var/cache/jenkins/war/WEB-INF/lib/jenkins-core-2.0-alpha-5-SNAPSHOT.jar!/lib/layout/layout.jelly:161:89: <j:invokeStatic> method getActiveInstance threw exception: Jenkins has not been started, or was already shut down
        at org.apache.commons.jelly.tags.core.InvokeStaticTag.doTag(InvokeStaticTag.java:148)
        at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
        at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:120)
        at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
        at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
        at org.kohsuke.stapler.jelly.JellyViewScript.run(JellyViewScript.java:95)
        at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:63)
        at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:53)
        at org.kohsuke.stapler.jelly.JellyRequestDispatcher.forward(JellyRequestDispatcher.java:55)
....
Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
Atlassian logo

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:22:03 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue
Change By: Monique Maker
Labels: 2.0 2.0-planned

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:29:02 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue
Change By: Monique Maker
Priority: Critical Major

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:29:02 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue

Reproduction steps:
1)
 Select many plugins for upgrade  Safe restart Jenkins:
2   a )  Enter <jenkins url>/restart and confirm the restart
  b)
 Update  them  update plugin(s)  with "restart after installation  option "  option

Expected behavior:
* Jenkins
 (  installs plugins and )  restarts

Actual behavior:
* Jenkins shuts down the web UI
* Jenkins does not restart due to "Caused by: java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove"
* Jenkins cannot open the UI anymore
 due to the exception from getActiveInstance()

Log:
{noformat}
Mar
 22  28 , 2016  5  9 : 38 09 : 30 PM 49 AM  hudson. model.UpdateCenter WebAppMain $ UpdateCenterConfiguration download 3 run
INFO:
 Downloading JUnit Plugin
Mar 22, 2016 5:38:30 PM jenkins.model.
Jenkins $27 run  is fully up and running
INFO: Restart in 10 seconds
Mar  22  28 , 2016  5  9 : 38 13 : 40 PM 57 AM  jenkins.model.Jenkins$ 27 26  run
SEVERE: Restarting VM as requested by
 anonymous  mmaker
Mar
 22  28 , 2016  5  9 : 38 13 : 40 PM 57 AM  jenkins.model.Jenkins cleanUp
INFO: Stopping Jenkins
Mar
 22  28 , 2016  5  9 : 38 13 : 40 PM 57 AM  jenkins.model.Jenkins$22 onAttained
INFO: Started termination
Mar
 22  28 , 2016  5  9 : 38 13 : 40 PM com.cloudbees.opscenter.context.Messaging$Local close
INFO: Messaging Stopped
Mar 22, 2016 5:38:40 PM
57 AM  jenkins.model.Jenkins$22 onAttained
INFO: Completed termination
Mar
 22  28 , 2016  5  9 : 38 13 : 40 PM 57 AM  jenkins.model.Jenkins _cleanUpDisconnectComputers
INFO: Starting node disconnection
Mar
 22  28 , 2016  9:13:58 AM hudson.TcpSlaveAgentListener$ConnectionHandler run
INFO: Accepted connection #1 from /10.
 5 .1.212 : 38 59574
Mar 28, 2016 9
: 41 PM 13:58 AM  jenkins.model.Jenkins _cleanUpShutdownPluginManager
INFO: Stopping plugin manager
Mar
 22  28 , 2016  5  9 : 38 13 : 41 PM 58 AM  jenkins.model.Jenkins _cleanUpPersistQueue
INFO: Persisting build queue
Mar
 22  28 , 2016  5  9 : 38 13 : 41 PM 58 AM  jenkins.model.Jenkins _cleanUpAwaitDisconnects

INFO: Waiting for node disconnection completion
Mar  22  28 , 2016  5  9 : 38 13 : 41 PM 58 AM  jenkins.model.Jenkins _cleanUpPluginServletFilters

SEVERE: Failed to stop filters
java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java: 3292 3238 )
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:
2945 2891 )
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$
27 26 .run(Jenkins.java: 3901 3808 )

Mar
 22  28 , 2016  5  9 : 38 13 : 41 PM 58 AM  jenkins.model.Jenkins cleanUp
INFO: Jenkins stopped
Mar
 22  28 , 2016  5  9 : 38 13 : 41 PM jenkins 58 AM hudson . model init . Jenkins impl.InstallUncaughtExceptionHandler $ 27 run DefaultUncaughtExceptionHandler uncaughtException
WARNING SEVERE :  Failed to  A thread (  restart  thread/105) died unexpectedly due to an uncaught exception, this may leave your  Jenkins  in a bad way and is usually indicative of a bug in the code.
java.lang.RuntimeException: Unexpected issues encountered during cleanUp: null
        at jenkins.model.Jenkins.cleanUp(Jenkins.java: 2960 2906 )
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$
27 26 .run(Jenkins.java: 3901 3808 )

Caused by: java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java: 3292 3238 )
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:
2945 2891 )
        ... 2 more

Mar
 22  28 , 2016  5  9 : 38 15 : 41 PM 48 AM  org.eclipse.jetty.util.log.JavaUtilLog warn
WARNING:
 Error while serving http://172.30.0.217:8080/adjuncts/b616bb17/lib/layout/menu_right_arrow.png  Committed before 404 null
{noformat}

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:34:01 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue
In the last 2-3 Jenkins updates we observe a problem restarting Jenkins instance.

Reproduction steps:
1) Safe restart Jenkins:
  a) Enter <jenkins url>/restart and confirm the restart
  b)
 Upgrade Jenkins via automatic upgrade
  c)
 Update update plugin(s) with "restart after installation" option

Expected behavior:
* Jenkins (installs plugins and) restarts


Actual behavior:
* Jenkins shuts down the web UI
* Jenkins does not restart due to "Caused by: java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove"
* Jenkins cannot open the UI anymore

Log:
{noformat}
Mar 28, 2016 9:09:49 AM hudson.WebAppMain$3 run
INFO: Jenkins is fully up and running
Mar 28, 2016 9:13:57 AM jenkins.model.Jenkins$26 run
SEVERE: Restarting VM as requested by mmaker
Mar 28, 2016 9:13:57 AM jenkins.model.Jenkins cleanUp
INFO: Stopping Jenkins
Mar 28, 2016 9:13:57 AM jenkins.model.Jenkins$22 onAttained
INFO: Started termination
Mar 28, 2016 9:13:57 AM jenkins.model.Jenkins$22 onAttained
INFO: Completed termination
Mar 28, 2016 9:13:57 AM jenkins.model.Jenkins _cleanUpDisconnectComputers
INFO: Starting node disconnection
Mar 28, 2016 9:13:58 AM hudson.TcpSlaveAgentListener$ConnectionHandler run
INFO: Accepted connection #1 from /10.5.1.212:59574
Mar 28, 2016 9:13:58 AM jenkins.model.Jenkins _cleanUpShutdownPluginManager
INFO: Stopping plugin manager
Mar 28, 2016 9:13:58 AM jenkins.model.Jenkins _cleanUpPersistQueue
INFO: Persisting build queue
Mar 28, 2016 9:13:58 AM jenkins.model.Jenkins _cleanUpAwaitDisconnects

INFO: Waiting for node disconnection completion
Mar 28, 2016 9:13:58 AM jenkins.model.Jenkins _cleanUpPluginServletFilters

SEVERE: Failed to stop filters
java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java:3238)
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2891)
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$26.run(Jenkins.java:3808)

Mar 28, 2016 9:13:58 AM jenkins.model.Jenkins cleanUp
INFO: Jenkins stopped
Mar 28, 2016 9:13:58 AM hudson.init.impl.InstallUncaughtExceptionHandler$DefaultUncaughtExceptionHandler uncaughtException
SEVERE: A thread (restart thread/105) died unexpectedly due to an uncaught exception, this may leave your Jenkins in a bad way and is usually indicative of a bug in the code.

java.lang.RuntimeException: Unexpected issues encountered during cleanUp: null
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2906)
        at hudson.lifecycle.UnixLifecycle.restart(UnixLifecycle.java:70)
        at jenkins.model.Jenkins$26.run(Jenkins.java:3808)

Caused by: java.lang.UnsupportedOperationException
        at java.util.concurrent.CopyOnWriteArrayList$COWIterator.remove(CopyOnWriteArrayList.java:1176)
        at hudson.util.PluginServletFilter.cleanUp(PluginServletFilter.java:162)
        at jenkins.model.Jenkins._cleanUpPluginServletFilters(Jenkins.java:3238)
        at jenkins.model.Jenkins.cleanUp(Jenkins.java:2891)
        ... 2 more

Mar 28, 2016 9:15:48 AM org.eclipse.jetty.util.log.JavaUtilLog warn
WARNING: Committed before 404 null
{noformat}

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:36:01 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue
In the last 2-3 Jenkins updates we observe a problem restarting Jenkins instance.

Reproduction steps:
1) Safe restart Jenkins:
  a) Enter <jenkins url>/restart and confirm the restart
  b) Upgrade Jenkins via  automatic upgrade  "Upgrade automatically" button

mmaker1234@gmail.com (JIRA)

unread,
Mar 28, 2016, 2:40:03 AM3/28/16
to jenkinsc...@googlegroups.com
Monique Maker updated an issue
In the last 2-3 Jenkins updates we observe a problem restarting Jenkins instance.

Reproduction steps:
1 . Run Jenkins a WAR ( java -jar jenkins.war & )
2.
 Safe restart Jenkins:

  a) Enter <jenkins url>/restart and confirm the restart
  b) Upgrade Jenkins via "Upgrade automatically" button
  c) Update
 update  plugin(s) with "restart after installation" option

Expected behavior:
* Jenkins (
upgrades or installs plugins and) restarts

dbeck@cloudbees.com (JIRA)

unread,
Apr 14, 2016, 12:29:01 PM4/14/16
to jenkinsc...@googlegroups.com
Daniel Beck resolved as Cannot Reproduce
 

Resolved in 1.655, tracked as another issue.

Change By: Daniel Beck
Status: Open Resolved
Resolution: Cannot Reproduce
Reply all
Reply to author
Forward
0 new messages