[JIRA] (JENKINS-58193) EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

[tapvirvirk@gmail.com (JIRA)]

tapvir virk created an issue

Jenkins / JENKINS-58193 EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version Issue Type: Bug Assignee: Matt Sicker Components: ec2-plugin Created: 2019-06-25 19:35 Priority: Blocker Reporter: tapvir virk EC2 instances are getting terminated right away on initializing in 1.44 version Add Comment

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

[tapvirvirk@gmail.com (JIRA)]

tapvir virk updated an issue

Jenkins / JENKINS-58193 EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: tapvir virk

EC2 instances are getting terminated right away on initializing in 1.44 version

Below is the error message java.io.EOFException: unexpected stream termination   It's working fine in 1.43 version

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk updated an issue

Jenkins / JENKINS-58193 EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version Change By: tapvir virk EC2 instances are getting terminated right away on initializing in 1.44 version Below is the error message java.io.EOFException: unexpected stream termination

Add Comment

[boards@gmail.com (JIRA)]

Matt Sicker commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version Do you have more of a stack trace?

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk updated an issue

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: tapvir virk

EC2 instances are getting terminated right away on initializing in 1.44 version

Below is the error message

Jun 25, 2019 3:49:22 PM hudson.plugins.ec2.EC2Cloud INFO: Launching instance: i-0dedca71f82852276 Jun 25, 2019 3:49:22 PM hudson.plugins.ec2.EC2Cloud INFO: bootstrap() Jun 25, 2019 3:49:22 PM hudson.plugins.ec2.EC2Cloud INFO: Getting keypair... Jun 25, 2019 3:49:22 PM hudson.plugins.ec2.EC2Cloud INFO: Using private key jenkins-slave (SHA-1 fingerprint e7:f4) Jun 25, 2019 3:49:22 PM hudson.plugins.ec2.EC2Cloud INFO: Authenticating as ec2-user Jun 25, 2019 3:49:23 PM hudson.plugins.ec2.EC2Cloud INFO: Connecting to 10.188.11.241 on port 22, with timeout 10000. Jun 25, 2019 3:49:33 PM hudson.plugins.ec2.EC2Cloud INFO: Failed to connect via ssh: The kexTimeout (10000 ms) expired. Jun 25, 2019 3:49:33 PM hudson.plugins.ec2.EC2Cloud INFO: Waiting for SSH to come up. Sleeping 5. Jun 25, 2019 3:49:38 PM hudson.plugins.ec2.EC2Cloud INFO: Connected via SSH. Jun 25, 2019 3:50:46 PM hudson.plugins.ec2.EC2Cloud INFO: Creating tmp directory (/tmp) if it does not exist Jun 25, 2019 3:50:46 PM hudson.plugins.ec2.EC2Cloud INFO: Verifying: java -fullversion openjdk full version "1 . 8.0_201-b09" Jun 25, 2019 3:50:46 PM hudson.plugins.ec2.EC2Cloud INFO: Verifying: which scp /usr/bin/scp Jun 25, 2019 3:50:46 PM hudson.plugins.ec2.EC2Cloud INFO: Copying remoting.jar to: /tmp Jun 25, 2019 3:50:46 PM hudson.plugins.ec2.EC2Cloud INFO: Launching remoting agent (via Trilead SSH2 Connection): java -jar /tmp/remoting.jar -workDir ERROR: unexpected stream termination java. io.EOFException: unexpected stream termination at hudson.remoting.ChannelBuilder.negotiate(ChannelBuilder.java:415) at hudson.remoting.ChannelBuilder.build(ChannelBuilder.java:360) at hudson.slaves.SlaveComputer.setChannel(SlaveComputer.java:431) at hudson.plugins.ec2.ssh.EC2UnixLauncher.launchScript(EC2UnixLauncher.java:262) at hudson.plugins.ec2.EC2ComputerLauncher.launch(EC2ComputerLauncher.java:48) at hudson.slaves.SlaveComputer$1.call(SlaveComputer.java:294) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

It's working fine in 1.43 version

Add Comment

[boards@gmail.com (JIRA)]

Matt Sicker updated an issue

Jenkins / JENKINS-58193 EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: Matt Sicker Comment:

Do you have more of a stack trace?

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version This is the exception getting logged in the jenkins logs

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Hey Tapvir can you show us your agent configuration?

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell assigned an issue to Raihaan Shouhell

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: Raihaan Shouhell Assignee: Matt Sicker Raihaan Shouhell

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell started work on JENKINS-58193

Change By: Raihaan Shouhell Status: Open In Progress

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version tapvir virk can you try the build from  https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/ec2/1.45-rc980.7e1580e3f8d5/

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell updated JENKINS-58193

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: Raihaan Shouhell Status: In Progress Review

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version Hi Raihaan, It is working with 1.45-rc980.7e1580e3f8d5 version

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk edited a comment on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Hi Raihaan, It is working with  in 1.45-rc980.7e1580e3f8d5 version

Add Comment

[bochenski.kuba+jenkins@gmail.com (JIRA)]

Jakub Bochenski commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Is this a duplicate of JENKINS-58163 ?

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

When this fix will be released?

Add Comment

[fabrizio.manfredi@gmail.com (JIRA)]

FABRIZIO MANFREDI updated JENKINS-58193

Released in 1.44.1

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: FABRIZIO MANFREDI Status: In Review Closed Resolution: Duplicate

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk reopened an issue

Hi Raihaan,   I just observed, same exception is thrown on WIndows slave. Linux slaves are working fine.   Can you please check and provide the fix?   Thanks Tapvir

Jenkins / JENKINS-58193 EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: tapvir virk Resolution: Duplicate Status: Closed Reopened

Add Comment

[fabrizio.manfredi@gmail.com (JIRA)]

FABRIZIO MANFREDI commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version the fix for windows will be in 1.44.2, can you test the build from master ?

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

I dont have setup to build the branch. Do you know when 1.44.2 will be released? If it is at later point, I will try to build from master

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell updated JENKINS-58193

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: Raihaan Shouhell Status: Reopened Fixed but Unreleased Resolution: Fixed

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version Our master branch has been failing due to some infra issues. If you don't mind you can test from one of my other PRs that reduces calls to describeInstances but contains the above fix https://repo.jenkins-ci.org/incrementals/org/jenkins-ci/plugins/ec2/1.45-rc1008.3d3aaabf683e/

Add Comment

[cimpoiesgeorge@gmail.com (JIRA)]

George Cimpoies commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

tapvir virk FABRIZIO MANFREDI, was this released? I'm encountering it on version 1.46.1 as well.

Add Comment

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

George Cimpoies can you provide a stacktrace if you have one?

Add Comment

[cimpoiesgeorge@gmail.com (JIRA)]

George Cimpoies commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Raihaan Shouhell sure, I've documented everything here: https://issues.jenkins-ci.org/browse/JENKINS-59682

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Windows ec2 slave is not working. Getting below exception I have given the permission to retrieve the password. Now, I'm not getting the above exception. But instance/slave node is getting terminated with the below exception ERROR: Unable to decode password: java.lang.IllegalArgumentException: Illegal base64 character d com.amazonaws.AmazonClientException: Unable to decode password: java.lang.IllegalArgumentException: Illegal base64 character d at hudson.plugins.ec2.EC2PrivateKey.decryptWindowsPassword(EC2PrivateKey.java:141) at hudson.plugins.ec2.win.EC2WindowsLauncher.connectToWinRM(EC2WindowsLauncher.java:156) at hudson.plugins.ec2.win.EC2WindowsLauncher.launchScript(EC2WindowsLauncher.java:39)

at hudson.plugins.ec2.EC2ComputerLauncher.launch(EC2ComputerLauncher.java:48) at hudson.slaves.SlaveComputer$1.call(SlaveComputer.java:294) at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46) at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Add Comment

[tapvirvirk@gmail.com (JIRA)]

tapvir virk commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

I think it is related to newline characters returned in the PasswordData property from "getPasswordData" api call. I tried to replicate on my local machine with standalone application. With newline characters, it is giving me below exception, Exception in thread "main" org.bouncycastle.util.encoders.DecoderException: unable to decode base64 string: invalid characters encountered in base64 dataException in thread "main" org.bouncycastle.util.encoders.DecoderException: unable to decode base64 string: invalid characters encountered in base64 data at org.bouncycastle.util.encoders.Base64.decode(Unknown Source) at com.telushealth.thcp.pipeline.gradle.aws.ec2.AwsEC2GetPasswordTest.decryptWindowsPassword(AwsEC2GetPasswordTest.java:51) at com.telushealth.thcp.pipeline.gradle.aws.ec2.AwsEC2GetPasswordTest.main(AwsEC2GetPasswordTest.java:19)Caused by: java.io.IOException: invalid characters encountered in base64 data at org.bouncycastle.util.encoders.Base64Encoder.decode(Unknown Source) ... 3 more

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell updated JENKINS-58193

Jenkins / JENKINS-58193

EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version

Change By: Raihaan Shouhell Status: Fixed but Unreleased Resolved

Add Comment

[raihaan.shouhell@autodesk.com (JIRA)]

Raihaan Shouhell commented on JENKINS-58193

Re: EC2 Plguin: EC2 instances are getting terminated right away on initializing in 1.44 version get password data cannot return newlines according to RFC 4648. Are you setting the password on the AMI or leaving it random? Also can you open a new issue for this the issue is unrelated

Add Comment