[JIRA] (JENKINS-61294) Jenkins node disconnects frequently because of that job fails.

[prakash.jyoti991@gmail.com (JIRA)]

jyotiprakash subudhi started work on JENKINS-61294

Change By: jyotiprakash subudhi Status: Open In Progress Add Comment

This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38)

[prakash.jyoti991@gmail.com (JIRA)]

jyotiprakash subudhi created an issue

Jenkins / JENKINS-61294 Jenkins node disconnects frequently because of that job fails. Issue Type: Bug Assignee: Fred G Components: build-node-column-plugin Created: 2020-03-02 16:04 Priority: Blocker Reporter: jyotiprakash subudhi 10:36:24 java.nio.channels.ClosedChannelException 10:36:24 at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209) 10:36:24 at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222) 10:36:24 at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816) 10:36:24 at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213) 10:36:24 at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:784) 10:36:24 at org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:173) 10:36:24 at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314) 10:36:24 at hudson.remoting.Channel.close(Channel.java:1452) 10:36:24 at hudson.remoting.Channel.close(Channel.java:1405) 10:36:24 at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:844) 10:36:24 at hudson.slaves.SlaveComputer.access$800(SlaveComputer.java:105) 10:36:24 at hudson.slaves.SlaveComputer$3.run(SlaveComputer.java:753) 10:36:24 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) 10:36:24 at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59) 10:36:24 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 10:36:24 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 10:36:24 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 10:36:24 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 10:36:24 at java.lang.Thread.run(Thread.java:748) 10:36:24 Caused: java.io.IOException: Backing channel 'JNLP4-connect connection from 10.104.24.62/10.104.24.62:59160' is disconnected. 10:36:24 at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214) 10:36:24 at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283) 10:36:24 at com.sun.proxy.$Proxy95.isAlive(Unknown Source) 10:36:24 at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1150) 10:36:24 at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1142) 10:36:24 at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:155) 10:36:24 at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:109) 10:36:24 at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66) 10:36:24 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) 10:36:24 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741) 10:36:24 at hudson.model.Build$BuildExecution.build(Build.java:206) 10:36:24 at hudson.model.Build$BuildExecution.doRun(Build.java:163) 10:36:24 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504) 10:36:24 at hudson.model.Run.execute(Run.java:1818) 10:36:24 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) 10:36:24 at hudson.model.ResourceController.execute(ResourceController.java:97) 10:36:24 at hudson.model.Executor.run(Executor.java:429) 10:36:24 FATAL: Unable to delete script file /var/folders/pj/8xyqxjys0473gwcc4yt_0lt00000gn/T/jenkins6027960159098425849.sh 10:36:24 java.nio.channels.ClosedChannelException 10:36:24 at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer.onReadClosed(ChannelApplicationLayer.java:209) 10:36:24 at org.jenkinsci.remoting.protocol.ApplicationLayer.onRecvClosed(ApplicationLayer.java:222) 10:36:24 at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.onRecvClosed(ProtocolStack.java:816) 10:36:24 at org.jenkinsci.remoting.protocol.FilterLayer.onRecvClosed(FilterLayer.java:287) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.onRecvClosed(SSLEngineFilterLayer.java:181) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.switchToNoSecure(SSLEngineFilterLayer.java:283) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processWrite(SSLEngineFilterLayer.java:503) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.processQueuedWrites(SSLEngineFilterLayer.java:248) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doSend(SSLEngineFilterLayer.java:200) 10:36:24 at org.jenkinsci.remoting.protocol.impl.SSLEngineFilterLayer.doCloseSend(SSLEngineFilterLayer.java:213) 10:36:24 at org.jenkinsci.remoting.protocol.ProtocolStack$Ptr.doCloseSend(ProtocolStack.java:784) 10:36:24 at org.jenkinsci.remoting.protocol.ApplicationLayer.doCloseWrite(ApplicationLayer.java:173) 10:36:24 at org.jenkinsci.remoting.protocol.impl.ChannelApplicationLayer$ByteBufferCommandTransport.closeWrite(ChannelApplicationLayer.java:314) 10:36:24 at hudson.remoting.Channel.close(Channel.java:1452) 10:36:24 at hudson.remoting.Channel.close(Channel.java:1405) 10:36:24 at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:844) 10:36:24 at hudson.slaves.SlaveComputer.access$800(SlaveComputer.java:105) 10:36:24 at hudson.slaves.SlaveComputer$3.run(SlaveComputer.java:753) 10:36:24 at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) 10:36:24 at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59) 10:36:24 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 10:36:24 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 10:36:24 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 10:36:24 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 10:36:24 at java.lang.Thread.run(Thread.java:748) 10:36:24 Caused: hudson.remoting.ChannelClosedException: Channel "unknown": Remote call on JNLP4-connect connection from 10.104.24.62/10.104.24.62:59160 failed. The channel is closing down or has closed down 10:36:24 at hudson.remoting.Channel.call(Channel.java:950) 10:36:24 at hudson.FilePath.act(FilePath.java:1072) 10:36:24 at hudson.FilePath.act(FilePath.java:1061) 10:36:24 at hudson.FilePath.delete(FilePath.java:1542) 10:36:24 at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:123) 10:36:24 at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66) 10:36:24 at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) 10:36:24 at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741) 10:36:24 at hudson.model.Build$BuildExecution.build(Build.java:206) 10:36:24 at hudson.model.Build$BuildExecution.doRun(Build.java:163) 10:36:24 at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504) 10:36:24 at hudson.model.Run.execute(Run.java:1818) 10:36:24 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) 10:36:24 at hudson.model.ResourceController.execute(ResourceController.java:97) 10:36:24 at hudson.model.Executor.run(Executor.java:429) 10:36:24 Build step 'Execute shell' marked build as failure 10:36:24 Finished: FAILURE

Add Comment

[fredg02@hotmail.com (JIRA)]

Fred G updated an issue

Jenkins / JENKINS-61294 Jenkins node disconnects frequently because of that job fails.

Change By: Fred G Component/s: core Component/s: build-node-column-plugin

Add Comment

[fredg02@hotmail.com (JIRA)]

Fred G assigned an issue to Unassigned

Jenkins / JENKINS-61294 Jenkins node disconnects frequently because of that job fails.

Change By: Fred G Assignee: Fred G

Add Comment

[fredg02@hotmail.com (JIRA)]

Fred G commented on JENKINS-61294

Re: Jenkins node disconnects frequently because of that job fails. It's not clear why this issue was assigned to the build-node-column-plugin component, therefore reassigning to core and unassigning myself. Please also provide more context about the master and the build agent. Which OS? Java version? etc. Did this issue exist from the beginning? Did it appear suddenly?

Add Comment

[prakash.jyoti991@gmail.com (JIRA)]

jyotiprakash subudhi commented on JENKINS-61294

Re: Jenkins node disconnects frequently because of that job fails.

Master OS: Cent OS Agent OS: Mac OS Mojave 10.14.6 Java Version : 1.8 This happens randomly, because of this job fails.    Is there any solution that if jenkins disconnects from the master also the job scheduled in the node should continue?

Add Comment

[m.winter@sap.com (JIRA)]

Markus Winter commented on JENKINS-61294

Re: Jenkins node disconnects frequently because of that job fails.

Fresstyle jobs will fail when the connection from master to agent is lost. Try using pipeline jobs instead. So the question is why you loose connection that frequently, maybe your network is unreliable.

Add Comment

[sudhakar.kethireddy@royalcyber.com (JIRA)]

sudhakar kethireddy commented on JENKINS-61294

Re: Jenkins node disconnects frequently because of that job fails.

We are seeing the similar issue, My Master is on Azure Ubuntu Box running Java 1.8 and Agent is on AWS Windows machine on Java 1.8 it keeps disconnecting after staying idle for 10 mins or less.

Add Comment