[JIRA] (JENKINS-54121) Renaming jobs casue Jenkins crash

0 views
Skip to first unread message

habakuk@protonmail.com (JIRA)

unread,
Oct 17, 2018, 6:16:02 AM10/17/18
to jenkinsc...@googlegroups.com
Rafal Kowalski created an issue
 
Jenkins / Bug JENKINS-54121
Renaming jobs casue Jenkins crash
Issue Type: Bug Bug
Assignee: Unassigned
Components: core
Created: 2018-10-17 10:15
Priority: Critical Critical
Reporter: Rafal Kowalski
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

habakuk@protonmail.com (JIRA)

unread,
Oct 17, 2018, 6:17:02 AM10/17/18
to jenkinsc...@googlegroups.com
Rafal Kowalski updated an issue
Change By: Rafal Kowalski
Attachment: rename.PNG

habakuk@protonmail.com (JIRA)

unread,
Oct 17, 2018, 6:19:01 AM10/17/18
to jenkinsc...@googlegroups.com
Rafal Kowalski updated an issue
|[/view/TA/view/IOB/view/Backend/ When I try to rename job /TA_IOB-Frontend-Library-build-jest/confirmRename POST|https://jenkinstest Jenkins is down . testbbh.com/monitoring?part=graph&graph=http6903ce85630972c1c2bc0ce9cfaa35512f086792]|30|1|2 289 050|2 289 050|0|22|614 279|80 628 283|100,00|0|
|[/job/TA_IOB-Frontend-FF-Full-QA-BranchTest/confirmRename POST|https://jenkinstest.testbbh.com/monitoring?part=graph&graph=httpfc6ce11b2a0fe8c06617fb904fdbc7122e2e875a]|

habakuk@protonmail.com (JIRA)

unread,
Oct 17, 2018, 6:20:02 AM10/17/18
to jenkinsc...@googlegroups.com
Rafal Kowalski updated an issue
Change By: Rafal Kowalski
Attachment: raname1.PNG

dbeck@cloudbees.com (JIRA)

unread,
Oct 19, 2018, 4:32:02 AM10/19/18
to jenkinsc...@googlegroups.com
Daniel Beck resolved as Incomplete
 

This can be caused by any number of causes, such as plugins badly handling job rename notifications. Please provide a thread dump from after renaming so we can see what's keeping Jenkins busy.

Change By: Daniel Beck
Status: Open Resolved
Resolution: Incomplete

habakuk@protonmail.com (JIRA)

unread,
Apr 25, 2019, 6:49:01 AM4/25/19
to jenkinsc...@googlegroups.com
Rafal Kowalski closed an issue as Incomplete
 

not important anymore

Change By: Rafal Kowalski
Status: Resolved Closed

alexeygrigorov@gmail.com (JIRA)

unread,
Jul 18, 2019, 3:43:02 PM7/18/19
to jenkinsc...@googlegroups.com
Alexey Grigorov updated an issue
Change By: Alexey Grigorov
Attachment: image-2019-07-18-22-42-26-771.png

alexeygrigorov@gmail.com (JIRA)

unread,
Jul 18, 2019, 3:46:03 PM7/18/19
to jenkinsc...@googlegroups.com
Alexey Grigorov updated an issue
Change By: Alexey Grigorov
Attachment: heapdump07-18-19_12_36_Leak_Suspects.zip

alexeygrigorov@gmail.com (JIRA)

unread,
Jul 18, 2019, 3:48:03 PM7/18/19
to jenkinsc...@googlegroups.com
Alexey Grigorov reopened an issue
Change By: Alexey Grigorov
Resolution: Incomplete
Status: Closed Reopened

alexeygrigorov@gmail.com (JIRA)

unread,
Jul 18, 2019, 3:48:03 PM7/18/19
to jenkinsc...@googlegroups.com
Alexey Grigorov commented on Bug JENKINS-54121
 
Re: Renaming jobs casue Jenkins crash

Hi Daniel Beck

I have same issue,  jenkins 2.176.1, user tried to rename a folder containing 2 millions files

jenkins heap of 31 Gb become full and jenkins died in gc

 

trace is 

"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]   java.lang.Thread.State: RUNNABLE at java.util.HashMap.putVal(HashMap.java:631) at java.util.HashMap.put(HashMap.java:612) at org.apache.tools.ant.util.LinkedHashtable.put(LinkedHashtable.java:110) - locked <0x00007f624dfde3e0> (a org.apache.tools.ant.util.LinkedHashtable) at org.apache.tools.ant.taskdefs.Copy.buildMap(Copy.java:788) at org.apache.tools.ant.taskdefs.Copy.scan(Copy.java:735) at org.apache.tools.ant.taskdefs.Copy.iterateOverBaseDirs(Copy.java:660) at org.apache.tools.ant.taskdefs.Copy.execute(Copy.java:559) at hudson.model.AbstractItem.renameTo(AbstractItem.java:423) - locked <0x00007f621d7a18f8> (a com.cloudbees.hudson.plugins.folder.Folder) - locked <0x00007f6216b530b0> (a com.cloudbees.hudson.plugins.folder.Folder) at com.cloudbees.hudson.plugins.folder.AbstractFolder.renameTo(AbstractFolder.java:1305) at hudson.model.AbstractItem.doConfirmRename(AbstractItem.java:264) at java.lang.invoke.LambdaForm$DMH/769287236.invokeVirtual_LL_L(LambdaForm$DMH) at java.lang.invoke.LambdaForm$BMH/1605795346.reinvoke(LambdaForm$BMH) at java.lang.invoke.LambdaForm$MH/21979174.invoker(LambdaForm$MH) at java.lang.invoke.LambdaForm$MH/293294444.invokeExact_MT(LambdaForm$MH) at java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:627) at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:396) at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:408) at org.kohsuke.stapler.interceptor.RequirePOST$Processor.invoke(RequirePOST.java:77) at org.kohsuke.stapler.PreInvokeInterceptedFunction.invoke(PreInvokeInterceptedFunction.java:26) at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:212) at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:145) at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:535) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:747) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:878)

here is a shot from MAT , report archive attached

alexeygrigorov@gmail.com (JIRA)

unread,
Jul 18, 2019, 3:59:02 PM7/18/19
to jenkinsc...@googlegroups.com
Alexey Grigorov edited a comment on Bug JENKINS-54121
Hi [~danielbeck]


I have same issue,  jenkins 2.176.1, user tried to rename a folder containing 2 millions files

jenkins heap of 31 Gb become full and jenkins died in gc

 

trace is 
{ noformat code:java }

"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]"Handling POST /job/Avolin/job/Tradebeam/job/GTM-2/confirmRename from 10.212.255.245 : qtp1254526270-61611" #61611 prio=5 os_prio=0 tid=0x00007f60801c6800 nid=0x3ee0 runnable [0x00007f601d863000]   java.lang.Thread.State: RUNNABLE at java.util.HashMap.putVal(HashMap.java:631) at java.util.HashMap.put(HashMap.java:612) at org.apache.tools.ant.util.LinkedHashtable.put(LinkedHashtable.java:110) - locked <0x00007f624dfde3e0> (a org.apache.tools.ant.util.LinkedHashtable) at org.apache.tools.ant.taskdefs.Copy.buildMap(Copy.java:788) at org.apache.tools.ant.taskdefs.Copy.scan(Copy.java:735) at org.apache.tools.ant.taskdefs.Copy.iterateOverBaseDirs(Copy.java:660) at org.apache.tools.ant.taskdefs.Copy.execute(Copy.java:559) at hudson.model.AbstractItem.renameTo(AbstractItem.java:423) - locked <0x00007f621d7a18f8> (a com.cloudbees.hudson.plugins.folder.Folder) - locked <0x00007f6216b530b0> (a com.cloudbees.hudson.plugins.folder.Folder) at com.cloudbees.hudson.plugins.folder.AbstractFolder.renameTo(AbstractFolder.java:1305) at hudson.model.AbstractItem.doConfirmRename(AbstractItem.java:264) at java.lang.invoke.LambdaForm$DMH/769287236.invokeVirtual_LL_L(LambdaForm$DMH) at java.lang.invoke.LambdaForm$BMH/1605795346.reinvoke(LambdaForm$BMH) at java.lang.invoke.LambdaForm$MH/21979174.invoker(LambdaForm$MH) at java.lang.invoke.LambdaForm$MH/293294444.invokeExact_MT(LambdaForm$MH) at java.lang.invoke.MethodHandle.invokeWithArguments(MethodHandle.java:627) at org.kohsuke.stapler.Function$MethodFunction.invoke(Function.java:396) at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:408) at org.kohsuke.stapler.interceptor.RequirePOST$Processor.invoke(RequirePOST.java:77) at org.kohsuke.stapler.PreInvokeInterceptedFunction.invoke(PreInvokeInterceptedFunction.java:26) at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:212) at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:145) at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:535) at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58) at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:747) at org.kohsuke.stapler.Stapler.invoke(Stapler.java:878)

{ noformat code }

here is a shot from MAT , report archive attached

!image-2019-07-18-22-42-26-771.png!

qinling.net@gmail.com (JIRA)

unread,
Aug 30, 2019, 8:41:01 PM8/30/19
to jenkinsc...@googlegroups.com
Leon Qin updated an issue
 
Change By: Leon Qin
Attachment: image-2019-08-31-08-40-54-683.png

qinling.net@gmail.com (JIRA)

unread,
Aug 30, 2019, 8:44:02 PM8/30/19
to jenkinsc...@googlegroups.com
Leon Qin commented on Bug JENKINS-54121
 
Re: Renaming jobs casue Jenkins crash

My instance also has this problem. I am not sure it is exactly the same with the issue here. But I believe it is caused by renaming. There were 2 renaming operations caused Jenkins not responding in 2 hours.

Jenkins 2.176.1 

 

Reply all
Reply to author
Forward
0 new messages