[JIRA] (JENKINS-12290) Lockup when using "trigger/call builds on other projects" and "Block until the triggered projects finish their builds" is used with only 1 executor

10 views
Skip to first unread message

heiko.boettger@gmx.de (JIRA)

unread,
Jul 18, 2016, 4:15:05 AM7/18/16
to jenkinsc...@googlegroups.com
Heiko Böttger commented on Improvement JENKINS-12290
 
Re: Lockup when using "trigger/call builds on other projects" and "Block until the triggered projects finish their builds" is used with only 1 executor

Hi is any one working on that?
For me this problem make the parameterized jobs plugin unusable. I cannot risk that jenkins suddenly get stuck and block all builds.

My scenario is as following:

I have a buildscript which needs to be executed (on specific slave) to create a property files for each dependency I need to build. I use the parameterized job plugin to run a job for each dependency and wait until its finished. Here the problem starts as soon as I need to block until the end, the executed used by the main job is never releases. This issue can be easily reproduced using a slave with exactly one executor. Now I thought the Matrix Job used as upstream job type would solve the issue since it is executed as a flyweight job, however I need to execute the script for creating the dependencies on a specific slave which forces me to define a slave axis. The slave axis again is exeuted as a subtask which is not flyweight causing the same issues. One solution which will work is releasing the executor before blocking and acquire it again when the subtask is done.

My current idea to workaround that is avoiding the need for a axis in the matrixjob and using a separate downstream job to create the property files which I will transfer to the matrxijob by using the copy artifacts plugin. That's rather complicated and I am still not sure whether that will work.

Any better idea?

Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)
Atlassian logo

awattar.gm@gmail.com (JIRA)

unread,
May 17, 2018, 3:12:03 AM5/17/18
to jenkinsc...@googlegroups.com

I'm also looking forward to see this resolved.

This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)
Atlassian logo

vasily.lazerko@gmail.com (JIRA)

unread,
Sep 27, 2018, 1:24:03 PM9/27/18
to jenkinsc...@googlegroups.com
Vasily L commented on Improvement JENKINS-12290

I think the waiting parent job should share its executor for the children.
Alternatively, it can just release the executor while blocked and pick the executor up on unblock.

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

vasily.lazerko@gmail.com (JIRA)

unread,
Sep 27, 2018, 1:25:02 PM9/27/18
to jenkinsc...@googlegroups.com
Vasily L edited a comment on Improvement JENKINS-12290
I think the waiting parent job should share its executor for the children.
Alternatively, it can just release the executor while blocked and pick the executor it up on unblock.

tiger.cheng@saseconnect.org (JIRA)

unread,
Oct 22, 2018, 3:47:02 PM10/22/18
to jenkinsc...@googlegroups.com

Also following and in agreement with Vasily that it is expected that if the childjob is asking for a node that is run by the parent node, that it should be allowed access to the node. Without this expectation working, our complex pipeline is unable to properly archive artifacts in the ideal clean manner it was designed for. The alternative is to seek for a solution to archive from nodes

paranoiabla@gmail.com (JIRA)

unread,
Nov 18, 2018, 4:01:02 AM11/18/18
to jenkinsc...@googlegroups.com

I've just hit this issue My scenario is the following. I have several projects:

 - bom

 - platform

 - archetype

 - console

 - release-all

 

The release-all is a pipeline build which calls release on each of them in the following order bom->platform->archetype->console However because I have just one executor running release-all blocks the executor and bom is never started to release because it is waiting for the next available executor.

 

paranoiabla@gmail.com (JIRA)

unread,
Nov 18, 2018, 4:02:03 AM11/18/18
to jenkinsc...@googlegroups.com
Petar Tahchiev edited a comment on Improvement JENKINS-12290
I've just hit this issue :( My scenario is the following. I have several projects:


 - bom

 - platform

 - archetype

 - console

 - release-all

 

The release-all is a pipeline build which calls release on each of them in the following order \{{ bom }} -> \{{ platform }} ->archetype->console However because I have just one executor running release-all blocks the executor and bom is never started to release because it is waiting for the next available executor.

 

paranoiabla@gmail.com (JIRA)

unread,
Nov 18, 2018, 4:03:04 AM11/18/18
to jenkinsc...@googlegroups.com

paranoiabla@gmail.com (JIRA)

unread,
Nov 18, 2018, 4:03:07 AM11/18/18
to jenkinsc...@googlegroups.com

sorgloomer+jenkinsio@gmail.com (JIRA)

unread,
Nov 5, 2019, 7:45:03 AM11/5/19
to jenkinsc...@googlegroups.com

I have a single jenkins server with two executors. I cannot run two pipelines in parallel because it immediately gets deadlocked as it cannot start the child jobs. I wonder why doesn't this issue have critical priority. It renders pipeline jobs useless in most cases. JENKINS-26959 was set critical and was closed as a duplicate of this issue.

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo

tobias.gierke@voipfuture.com (JIRA)

unread,
Nov 14, 2019, 3:01:05 AM11/14/19
to jenkinsc...@googlegroups.com

I just hit this bug, IMHO this is a core feature (being able to trigger another project and wait for it's completion without blocking an executor).

me@alex.bio (JIRA)

unread,
Jan 16, 2020, 10:50:12 AM1/16/20
to jenkinsc...@googlegroups.com

me@alex.bio (JIRA)

unread,
Jan 16, 2020, 10:54:07 AM1/16/20
to jenkinsc...@googlegroups.com
Alexander Borsuk commented on Bug JENKINS-12290
 
Re: Lockup when using "trigger/call builds on other projects" and "Block until the triggered projects finish their builds" is used with only 1 executor

This is a critical issue that makes parallel/matrix builds unusable. In my pipeline I need to build for Mac and Linux. Obviously, it can be done in parallel. There are two build nodes available (Linux and Mac). The bug reproduces when one build node waits until another build node finishes. And another one waits until the first one finishes. This is a deadlock.

Reply all
Reply to author
Forward
0 new messages