[JIRA] (JENKINS-50306) "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

[block.jon@gmail.com (JIRA)]

Jon B updated an issue

Jenkins / JENKINS-50306 "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Change By: Jon B Summary: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Add Comment

This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)

[block.jon@gmail.com (JIRA)]

Jon B updated an issue

Jenkins / JENKINS-50306 "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Change By: Jon B

In my Jenkins server, I sometimes have a little bit of queueing and you'll see messages like this in a pipeline which has recently been submitted: — Still waiting to schedule task Waiting for next available executor on ip-172-31-141-11.us-west-2.compute.internal — I use node labels in order to select which agents may be used. However, the above message suggests to me that the Jenkins pipeline runner makes a selection as to which agent will receive the job at the moment it encounters the node() command in my Jenkinsfile . The reason that I believe this logic to be flawed is that the particular node in question (ip-172-31-141-11.us-west-2.compute.internal) might get killed off while the current job is running which suggests that my queued job will be stuck waiting forever because there is almost no chance that AWS will relaunch the same node with the same hostname. A better strategy would be on in which I request a node via something like node("mac") and then jenkins tells me that its waiting to schedule an executor on the next node labeled "mac" as opposed to selecting an individual machine which might go away.

Add Comment

[block.jon@gmail.com (JIRA)]

Jon B updated an issue

Jenkins / JENKINS-50306 "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Change By: Jon B

In my Jenkins server, I sometimes have a little bit of queueing and you'll see messages like this in a pipeline which has recently been submitted: — Still waiting to schedule task Waiting for next available executor on ip-172-31-141-11.us-west-2.compute.internal — I use node labels in order to select which agents may be used. However, the above message suggests to me that the Jenkins pipeline runner makes a selection as to which agent will receive the job at the moment it encounters the node() command in my Jenkinsfile. The reason that I believe this logic to be flawed is that the particular node in question (ip-172-31-141-11.us-west-2.compute.internal) might get killed off while the current job is running which suggests that my queued job will be stuck waiting forever because there is almost no chance that AWS will relaunch the same node with the same hostname.

A better strategy would be on one in which I request a node via something like node("mac") and then jenkins tells me that its waiting to schedule an executor on the next node labeled "mac" as opposed to selecting an individual machine which might go away.

Add Comment

[o.v.nenashev@gmail.com (JIRA)]

Oleg Nenashev updated an issue

Jenkins / JENKINS-50306 "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Change By: Oleg Nenashev Component/s: pipeline Component/s: core

Add Comment

[andrew.bayer@gmail.com (JIRA)]

Andrew Bayer updated an issue

Jenkins / JENKINS-50306 "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Change By: Andrew Bayer Component/s: workflow-durable-task-step-plugin Component/s: pipeline

Add Comment

[andrew.bayer@gmail.com (JIRA)]

Andrew Bayer commented on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Yes, when the node step is executed, it goes onto the agent. If you're seeing the build start, get to the node step, and immediately get that message, something's wrong somewhere, but there is a common case for that message, sadly, on master restart and running Pipelines resuming - often, dynamically provisioned agents no longer exist but Jenkins still tries to resume Pipelines onto the agents they were on at the time the master stopped, so things get gummed up. If that's not the situation where you're seeing this, is there any chance you could include your Jenkinsfile, or even better a minimal reproduction case? Oh, and are you using the throttle step by any chance?

Add Comment

[block.jon@gmail.com (JIRA)]

Jon B edited a comment on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Indeed I am using the "Throttle Concurrent Builds Plug-in" because my monolith's main pipeline is very busy and if i don't throttle, the agent capacity would get slathered across too many concurrent job runs making them all take forever. My pipeline logic is quite complex but I'm pretty sure the cause must be a flaw in the concurrent builds plugin. If you think it is essential to triage, I will create a watered down pipeline that repros this behavior but I'll hold on that until you confirm its worth my time to produce such a Jenkinsfile.

Add Comment

[block.jon@gmail.com (JIRA)]

Jon B commented on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Indeed I am using the "Throttle Concurrent Builds Plug-in" because my monolith's main pipeline is very busy and if i don't throttle, the agent capacity would get slathered too many concurrent job runs making them all take forever.

My pipeline logic is quite complex but I'm pretty sure the cause must be a flaw in the concurrent builds plugin. If you think it is essential to triage, I will create a watered down pipeline that repros this behavior but I'll hold on that until you confirm its worth my time to produce such a Jenkinsfile.

Add Comment

[andrew.bayer@gmail.com (JIRA)]

Andrew Bayer updated an issue

Jenkins / JENKINS-50306

"Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Change By: Andrew Bayer Component/s: throttle-concurrent-builds-plugin Component/s: workflow-durable-task-step-plugin

Add Comment

[andrew.bayer@gmail.com (JIRA)]

Andrew Bayer commented on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion Yup, it's throttle-concurrent-builds - it'd be worth knowing how you have the throttling category set up (are you saying only run X of jobs in this category across all nodes, or ...on a single node, etc), though.

Add Comment

[gunter@grodotzki.co.za (JIRA)]

Gunter Grodotzki commented on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

I am seeing this issue as well especially on cron triggered builds. It does not happen to all triggered builds though: [Pipeline] nodeStill waiting to schedule task ‘Jenkins Prebuilt Slave (sir-2c3r7s3n)’ is offline; ‘Jenkins Prebuilt Slave (sir-6z9r4yhm)’ is offline; ‘Jenkins Prebuilt Slave (sir-d4mg59im)’ is offline; ‘Jenkins Prebuilt Slave (sir-vt4g7crq)’ is offline Nodes are EC2 (spot) that are launched on-demand. They are not failing to launch in general as other builds work fine.

Add Comment

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

[aboumediene@infovista.com (JIRA)]

Abdelkader Boumediene commented on JENKINS-50306

Re: "Still waiting to schedule task" indicates a flaw in the Jenkins pipelining design in my opinion

Any news about this issue ? I have this issue also. Note that if I perform "Reply" build that freezes with this error, it works fine. So issue seems occur only when Pipeline is called from another

Add Comment