[JIRA] (JENKINS-61676) 1.44 -> 1.49.1 Can't connect agent and doesn't terminate instance

3 views
Skip to first unread message

eygraber@gmail.com (JIRA)

unread,
Mar 25, 2020, 1:32:04 AM3/25/20
to jenkinsc...@googlegroups.com
Eli Graber created an issue
 
Jenkins / Bug JENKINS-61676
1.44 -> 1.49.1 Can't connect agent and doesn't terminate instance
Issue Type: Bug Bug
Assignee: FABRIZIO MANFREDI
Components: ec2-plugin
Created: 2020-03-25 05:31
Priority: Major Major
Reporter: Eli Graber

I recently updated my plugin from 1.44 to 1.49.1 and instances spin up, don't connect, and then don't terminate. If I wasn't looking at aws this would've cost me a lot of money (had over 100 instances running doing nothing).

 

Everything was working for months before updating. I have an agent.jar that sits in /home/ubuntu. The log from one of the instances is below. If I had to guess I'd say that the issue is that the host is null. Also I don't know what /tmp/remoting.jar is.

 

Testing the connection and Checking the AMI both succeed.

 

I have a subnet ID for VPC set correctly.

 

Root command prefix = 

Slave command prefix = nice -15

Slave command suffix =

Remote ssh port = 22

 

Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Launching instance: <instance id>
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: bootstrap()
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Getting keypair...
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Using private key android (SHA-1 fingerprint <fingerprint>)
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Authenticating as ubuntu
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Connecting to null on port 22, with timeout 35000.
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Connected via SSH.
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: connect fresh as root
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Connecting to null on port 22, with timeout 35000.
Mar 25, 2020 1:15:17 AM hudson.plugins.ec2.EC2Cloud
INFO: Connected via SSH.
Mar 25, 2020 1:15:18 AM hudson.plugins.ec2.EC2Cloud
INFO: Creating tmp directory (/tmp) if it does not exist
Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
INFO: Verifying: java -fullversion
openjdk full version "1.8.0_242-8u242-b08-0ubuntu3~18.04-b08"
Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
INFO: Verifying: which scp
/usr/bin/scp
Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
INFO: Copying remoting.jar to: /tmp
Mar 25, 2020 1:15:19 AM hudson.plugins.ec2.EC2Cloud
INFO: Launching remoting agent (via SSH client process): ssh -o StrictHostKeyChecking=no -i /tmp/ec2_5958435854098369335.pem ubuntu@null -p 22 nice -15  java -server -XX:+AlwaysPreTouch -XX:+UseG1GC -XX:+ExplicitGCInvokesConcurrent -XX:+ParallelRefProcEnabled -XX:+UseStringDeduplication -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=20 -XX:+UnlockDiagnosticVMOptions -XX:G1SummarizeRSetStatsPeriod=1 -Xmx6g -Xms6g -jar /tmp/remoting.jar -workDir /home/ubuntu
[03/25/20 01:15:19] Launching agent
$ ssh -o StrictHostKeyChecking=no -i /tmp/ec2_5958435854098369335.pem ubuntu@null -p 22 nice -15  java -server -XX:+AlwaysPreTouch -XX:+UseG1GC -XX:+ExplicitGCInvokesConcurrent -XX:+ParallelRefProcEnabled -XX:+UseStringDeduplication -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=20 -XX:+UnlockDiagnosticVMOptions -XX:G1SummarizeRSetStatsPeriod=1 -Xmx6g -Xms6g -jar /tmp/remoting.jar -workDir /home/ubuntu
ssh: Could not resolve hostname null: Temporary failure in name resolution
ERROR: Unable to launch the agent for EC2 (aws-android) - android-slave (<instance id>)
java.io.EOFException: unexpected stream termination
	at hudson.remoting.ChannelBuilder.negotiate(ChannelBuilder.java:415)
	at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:360)
	at hudson.slaves.SlaveComputer.setChannel(SlaveComputer.java:419)
	at hudson.slaves.CommandLauncher.launch(CommandLauncher.java:165)
	at hudson.plugins.ec2.ssh.EC2UnixLauncher.launchScript(EC2UnixLauncher.java:247)
	at hudson.plugins.ec2.EC2ComputerLauncher.launch(EC2ComputerLauncher.java:48)
	at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:292)
	at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
	at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages