[JIRA] [core] (JENKINS-19743) Massive parallel builds sometimes cause errors in LogRotation

[phraktle@gmail.com (JIRA)]

Viktor Szathmary commented on JENKINS-19743

Re: Massive parallel builds sometimes cause errors in LogRotation Using Jenkins ver. 1.636, we are seeing the following exception on a job allowing concurrent builds and having lots of short jobs: hudson.model.Run execute SEVERE: Failed to rotate log java.util.NoSuchElementException at jenkins.model.lazy.LazyLoadRunMapEntrySet$1.next(LazyLoadRunMapEntrySet.java:76) at jenkins.model.lazy.LazyLoadRunMapEntrySet$1.next(LazyLoadRunMapEntrySet.java:63) at java.util.AbstractMap$2$1.next(AbstractMap.java:396) at hudson.util.RunList.subList(RunList.java:139) at hudson.tasks.LogRotator.perform(LogRotator.java:125) at hudson.model.Job.logRotate(Job.java:467) at hudson.model.Run.execute(Run.java:1805) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:410) Add Comment

This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)

[phraktle@gmail.com (JIRA)]

Viktor Szathmary commented on JENKINS-19743

Re: Massive parallel builds sometimes cause errors in LogRotation

We are also seeing this one (reported above as well). So it seems log rotation for concurrent jobs has a race condition. Nov 06, 2015 6:01:49 AM hudson.model.Run execute

SEVERE: Failed to rotate log

java.io.IOException:Redacted #173213: /redacted/builds/173213 looks to have already been deleted; siblings: [....lots of job ids....] at hudson.model.Run.delete(Run.java:1483) at hudson.tasks.LogRotator.perform(LogRotator.java:144)

at hudson.model.Job.logRotate(Job.java:467) at hudson.model.Run.execute(Run.java:1805) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:410)

Add Comment

[klaus@schniedergers.com (JIRA)]

Klaus Schniedergers commented on JENKINS-19743

Re: Massive parallel builds sometimes cause errors in LogRotation

I am seeing the same (SEVERE: Failed to rotate log), on 1.625.3 (most recent LTS). Once the SEVERE log entries start, Jenkins service starts to use all CPU it can get and becomes very slow/unresponsive.

Add Comment

[columbusmonkey@me.com (JIRA)]

Gavin Shelley commented on JENKINS-19743

Re: Massive parallel builds sometimes cause errors in LogRotation

We see this on 1.611. We too have 100s of parallel jobs running. This pollutes the logs with scary messages. Not sure if it actually affects us apart from logs, but it would be nice to see this resolved in case it is the cause of the occasional unexplained problem.

Add Comment