[JIRA] (JENKINS-60107) durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164

4 views
Skip to first unread message

jonuda77@gmail.com (JIRA)

unread,
Nov 8, 2019, 8:25:03 AM11/8/19
to jenkinsc...@googlegroups.com
Jon Udaondo updated an issue
 
Jenkins / Bug JENKINS-60107
durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164
Change By: Jon Udaondo
Summary: durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo

cchiou@cloudbees.com (JIRA)

unread,
Nov 8, 2019, 12:19:02 PM11/8/19
to jenkinsc...@googlegroups.com
Carroll Chiou commented on Bug JENKINS-60107
 
Re: durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164

Thanks for including the logs. In the future it would be better to include the actual logs next time and not screenshots. It makes it easier to actually read as well as guarantees that nothing has been left out.

So, looking at JENKINS-59838, the problem might very well be that you are executing an extremely long shell step that is not giving any output because it is over `ssh`. That is most likely tricking the shell wrapper into thinking that the shell step is not running?
If this is indeed the problem, I can think of two solutions:

  1. Enable the binary wrapper by passing the system property org.jenkinsci.plugins.durabletask.BourneShellScript.FORCE_BINARY_WRAPPER=true
  2. Switch to the SSH plugin

dnusbaum@cloudbees.com (JIRA)

unread,
Nov 13, 2019, 12:13:03 PM11/13/19
to jenkinsc...@googlegroups.com

dnusbaum@cloudbees.com (JIRA)

unread,
Nov 13, 2019, 12:13:03 PM11/13/19
to jenkinsc...@googlegroups.com
Devin Nusbaum commented on Bug JENKINS-60107
 
Re: durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164

Jon Udaondo Please send an email to the jenkinsci-users mailing list for a general investigation like this. In your email, add the output from once you enable LAUNCH_DIAGNOSTICS, and some details about whether this was working for you previously, and if so with what version of the plugin and Jenkins, what version of Jenkins you are running, what OS you are using on the Jenkins master and the agent being used by the shell step, how the agent is configured, what other configurations you have tried, etc.

Basic guidance on how to enable LAUNCH_DIAGNOSTICS is here. The property you want is named org.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS, and you want to set it to true. Exactly where the system property is specified will depend on how you run Jenkins. From your last ticket, it looks like you are running it as a service, so you want to configure the Java arguments in the service configuration. Once you have it set correctly, the message "running Jenkins temporarily with -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true ..." will no longer be present in the build log, and hopefully the actual error will be printed to the build log for the failing build, which you should include in your email.

I am going to close this issue for now, if it looks like there is a bug after you provide more info on the mailing list, we’ll reopen the ticket, so please do not open another ticket for your issue.

dnusbaum@cloudbees.com (JIRA)

unread,
Nov 13, 2019, 12:13:04 PM11/13/19
to jenkinsc...@googlegroups.com

jonuda77@gmail.com (JIRA)

unread,
Dec 2, 2019, 9:18:05 AM12/2/19
to jenkinsc...@googlegroups.com
Jon Udaondo commented on Bug JENKINS-60107
 
Re: durabletask v1.33 - process apparently never started in /var/lib/jenkins/workspace/local-cloud-regression-test@tmp/durable-fa896164

Devin Nusbaum I sent and email to jenkins-ci-users mailing list and get no response.

I also set "-Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true" but the error is not printed on the build log...

I my /etc/default/jenkins file I have the following:

# Allow graphs etc. to work even when an X server is present
JAVA_ARGS="-Xmx2048m -XX:MaxPermSize=512m -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.FORCE_BINARY_WRAPPER=true -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true -Dfile.encoding=UTF8"

jonuda77@gmail.com (JIRA)

unread,
Dec 2, 2019, 9:29:03 AM12/2/19
to jenkinsc...@googlegroups.com
Jon Udaondo edited a comment on Bug JENKINS-60107
I also set "-Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true" but the error is not printed on the build log...

I my /etc/default/jenkins file I have the following:
{code:java}

# Allow graphs etc. to work even when an X server is present
JAVA_ARGS="-Xmx2048m -XX:MaxPermSize=512m -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.FORCE_BINARY_WRAPPER=true -Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true -Dfile.encoding=UTF8"
{code}

jonuda77@gmail.com (JIRA)

unread,
Dec 4, 2019, 10:11:05 AM12/4/19
to jenkinsc...@googlegroups.com

Devin Nusbaum

The issue is still there...

It happened in another job while using "terraform destroy -f".

00:00:26.617  module.redis02.vsphere_virtual_machine.vm: Destroying... [id=42068f3c-c1f8-70e9-4262-0f63e7c9c77e]
00:00:26.617  module.cassandra01.vsphere_virtual_machine.vm: Destroying... [id=4206a140-090b-3066-35ba-71c30007b204]
00:05:18.718  process apparently never started in /var/lib/jenkins/workspace/destroy-cloud-environment@tmp/durable-3ee2246a
[Pipeline] }
00:05:18.748  ERROR: script returned exit code -2

Below that, no more output about the error is deplayed despite having "-Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true" enabled.

 

jonuda77@gmail.com (JIRA)

unread,
Dec 4, 2019, 10:13:03 AM12/4/19
to jenkinsc...@googlegroups.com
Jon Udaondo edited a comment on Bug JENKINS-60107
[~dnusbaum]


The issue is still there...

It happened in another job while using "terraform destroy -f". The console output of the job displays the following..
{code:java}

00:00:26.617  module.redis02.vsphere_virtual_machine.vm: Destroying... [id=42068f3c-c1f8-70e9-4262-0f63e7c9c77e]
00:00:26.617  module.cassandra01.vsphere_virtual_machine.vm: Destroying... [id=4206a140-090b-3066-35ba-71c30007b204]
00:05:18.718  process apparently never started in /var/lib/jenkins/workspace/destroy-cloud-environment@tmp/durable-3ee2246a
[Pipeline] }
00:05:18.748  ERROR: script returned exit code -2
{code}

Below that, no more output about the error is deplayed despite having "-Dorg.jenkinsci.plugins.durabletask.BourneShellScript.LAUNCH_DIAGNOSTICS=true" enabled.

 

dnusbaum@cloudbees.com (JIRA)

unread,
Dec 4, 2019, 1:55:03 PM12/4/19
to jenkinsc...@googlegroups.com

00:00:26.617 module.redis02.vsphere_virtual_machine.vm: Destroying... [id=42068f3c-c1f8-70e9-4262-0f63e7c9c77e]


00:00:26.617 module.cassandra01.vsphere_virtual_machine.vm: Destroying... [id=4206a140-090b-3066-35ba-71c30007b204]

Is this output from the script you passed to sh? If so, I am a bit curious about the timestamps. It looks like it ran for 5 hours, and then failed with "process apparently never started"? Can you confirm that downgrading to Durable Task Plugin 1.30 (you may also need to downgrade Pipeline: Nodes and Processes Plugin to 2.34 if you have already updated to 2.35) makes these problems go away?

dnusbaum@cloudbees.com (JIRA)

unread,
Dec 4, 2019, 1:55:03 PM12/4/19
to jenkinsc...@googlegroups.com
Devin Nusbaum edited a comment on Bug JENKINS-60107
{quote}00:00:26.617 module.redis02.vsphere_virtual_machine.vm: Destroying... [id=42068f3c-c1f8-70e9-4262-0f63e7c9c77e]

00:00:26.617 module.cassandra01.vsphere_virtual_machine.vm: Destroying... [id=4206a140-090b-3066-35ba-71c30007b204]
{quote}
Is this output from the script you passed to {{sh}}? If so, I am a bit curious about the timestamps. It looks like it ran for 5 hours, and then failed with "process apparently never started"? Can you confirm that downgrading to Durable Task Plugin 1.30 (you
may will also need to downgrade Pipeline: Nodes and Processes Plugin to 2.34 if you have already updated to 2.35) makes these problems go away?
Reply all
Reply to author
Forward
0 new messages