Agent fails - windows agent service is restarting - SIGINT to 3460 failed - Killing as fallback

[zakyn]

Hello,

I would like to ask you for a help.

We have a problem, that windows service of all agents/nodes are crashing and reconneting again. The longest time is 12 hours sometimes less.

In the windows event log there is - SIGINT to 3460 failed - Killing as fallback - message.

I tried all the things I found on google but still without any success.

I tried run agents just from cmd and the behavior is the same.

Could you please help me?

Thank you.

Vladimir

jenkins-slave-err.log

Jan 08, 2020 2:03:46 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Terminated
Jan 08, 2020 2:03:56 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Performing onReconnect operation.
Jan 08, 2020 2:03:56 PM jenkins.slaves.restarter.JnlpSlaveRestarterInstaller$FindEffectiveRestarters$1 onReconnect
INFO: Restarting agent via jenkins.slaves.restarter.WinswSlaveRestarter@27f599
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main createEngine
INFO: Setting up agent: MYAGENT
Jan 08, 2020 2:03:58 PM hudson.remoting.jnlp.Main$CuiListener <init>
INFO: Jenkins agent is running in headless mode.
Jan 08, 2020 2:03:58 PM hudson.remoting.Engine startEngine
INFO: Using Remoting version: 3.36
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager initializeWorkDir
INFO: Using c:\_js\remoting as a remoting work directory
Jan 08, 2020 2:03:58 PM org.jenkinsci.remoting.engine.WorkDirManager setupLogging
INFO: Both error and output logs will be printed to c:\_js\remoting
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Locating server among [http://MYADDRESS/]
Jan 08, 2020 2:03:59 PM org.jenkinsci.remoting.engine.JnlpAgentEndpointResolver resolve
INFO: Remoting server accepts the following protocols: [JNLP4-connect, Ping]
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Agent discovery successful
  Agent address: MYADDRESS
  Agent port:    49187
  Identity:      3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Handshaking
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connecting to MYADDRESS:49187
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Trying protocol: JNLP4-connect
Jan 08, 2020 2:03:59 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Remote identity confirmed: 3e:36:96:ce:df:53:9a:86:71:99:48:31:27:de:bd:87
Jan 08, 2020 2:04:00 PM hudson.remoting.jnlp.Main$CuiListener status
INFO: Connected

wrapper.log

2020-01-08 10:08:38,702 INFO  - Stopping jenkinsslave-c___js
2020-01-08 10:08:38,703 DEBUG - ProcessKill 2512
2020-01-08 10:08:38,825 INFO  - Found child process: 7408 Name: conhost.exe
2020-01-08 10:08:38,908 INFO  - Stopping process 7408
2020-01-08 10:08:38,911 INFO  - Send SIGINT 7408
2020-01-08 10:08:38,912 WARN  - SIGINT to 7408 failed - Killing as fallback
2020-01-08 10:08:38,914 INFO  - Stopping process 2512
2020-01-08 10:08:38,918 INFO  - Send SIGINT 2512
2020-01-08 10:08:38,919 WARN  - SIGINT to 2512 failed - Killing as fallback
2020-01-08 10:08:38,921 INFO  - Finished jenkinsslave-c___js
2020-01-08 10:08:38,923 DEBUG - Completed. Exit code is 0
2020-01-08 10:08:42,687 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 10:08:42,709 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl http://MYAGENT/slave-agent.jnlp -secret 75ef2485eebc894178cbfa9cecd0501cfffb49d4fcb6a240e6
2020-01-08 10:08:42,716 INFO  - Extension loaded: killOnStartup
2020-01-08 10:08:42,720 DEBUG - Checking the potentially runaway process with PID=2512
2020-01-08 10:08:42,727 DEBUG - No runaway process with PID=2512. The process has been already stopped.
2020-01-08 10:08:42,754 INFO  - Started process 2724
2020-01-08 10:08:42,758 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 10:08:42,761 INFO  - Recording PID of the started process:2724. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 10:08:47,081 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 10:08:47,312 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 10:08:47,317 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,264 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,457 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,464 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:56,556 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:03:56,760 INFO  - Restarting the service with id 'jenkinsslave-c___js'
2020-01-08 14:03:56,787 INFO  - Stopping jenkinsslave-c___js
2020-01-08 14:03:56,787 DEBUG - ProcessKill 2724
2020-01-08 14:03:56,908 INFO  - Found child process: 3460 Name: conhost.exe
2020-01-08 14:03:56,987 INFO  - Stopping process 3460
2020-01-08 14:03:56,991 INFO  - Send SIGINT 3460
2020-01-08 14:03:56,994 WARN  - SIGINT to 3460 failed - Killing as fallback
2020-01-08 14:03:56,998 INFO  - Stopping process 2724
2020-01-08 14:03:57,004 INFO  - Send SIGINT 2724
2020-01-08 14:03:57,004 WARN  - SIGINT to 2724 failed - Killing as fallback
2020-01-08 14:03:57,006 INFO  - Finished jenkinsslave-c___js
2020-01-08 14:03:57,007 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,042 INFO  - Starting ServiceWrapper in the service mode
2020-01-08 14:03:58,056 DEBUG - Completed. Exit code is 0
2020-01-08 14:03:58,063 INFO  - Starting C:\Program Files (x86)\Java\jre1.8.0\bin\java.exe -Xrs  -jar "c:\_js\slave.jar" -jnlpUrl http://MYAGENT/slave-agent.jnlp -secret 75ef24bf56b0070cecd0501cfffb49d4fcb6a240e6
2020-01-08 14:03:58,072 INFO  - Extension loaded: killOnStartup
2020-01-08 14:03:58,080 DEBUG - Checking the potentially runaway process with PID=2724
2020-01-08 14:03:58,087 DEBUG - No runaway process with PID=2724. The process has been already stopped.
2020-01-08 14:03:58,106 INFO  - Started process 5188
2020-01-08 14:03:58,109 DEBUG - Forwarding logs of the process System.Diagnostics.Process (java) to winsw.SizeBasedRollingLogAppender
2020-01-08 14:03:58,112 INFO  - Recording PID of the started process:5188. PID file destination is c:\_js\jenkins_agent.pid
2020-01-08 14:04:01,930 DEBUG - Starting ServiceWrapper in the CLI mode
2020-01-08 14:04:02,128 DEBUG - User requested the status of the process with id 'jenkinsslave-c___js'
2020-01-08 14:04:02,133 DEBUG - Completed. Exit code is 0

[zakyn]

Hello,

the problem is still there. This is a combination for problems from event log.

Any ideas please?

Thank you.

Dne středa 8. ledna 2020 14:32:23 UTC+1 zakyn napsal(a):