com.jcraft.jsch.JSchException: Auth fail at

[tuan ngueyn]

Hi, 

I am facing this issue when connect to remote hadoop provision via ssh 

i am using this cmd to generate ssh key

ssh-keygen -t rsa

2022-07-17 22:43:49,275 - WARN [provisioning-task-9:i.c.c.r.s.p.r.RemoteHadoopProvisioner@148] - Unable to clean up resources for program DataPipelineWorkflow run 3c6af466-05e7-11ed-b999-000000d98e52 on the remote cluster. The run directory may need to be manually deleted on cluster node localhost. java.io.IOException: Failed to SSH to root@localhost:22    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:103) ~[na:na]    at io.cdap.cdap.internal.provision.DefaultSSHContext.createSSHSession(DefaultSSHContext.java:120) ~[na:na]    at io.cdap.cdap.runtime.spi.ssh.SSHContext.createSSHSession(SSHContext.java:92) ~[na:na]    at io.cdap.cdap.runtime.spi.ssh.SSHContext.createSSHSession(SSHContext.java:80) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.remote.RemoteHadoopProvisioner.createSSHSession(RemoteHadoopProvisioner.java:82) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.remote.RemoteHadoopProvisioner.deleteCluster(RemoteHadoopProvisioner.java:143) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.Provisioner.deleteClusterWithStatus(Provisioner.java:142) [na:na]    at io.cdap.cdap.internal.provision.task.ClusterDeleteSubtask.execute(ClusterDeleteSubtask.java:42) [na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningSubtask.execute(ProvisioningSubtask.java:54) [na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningTask.lambda$executeOnce$1(ProvisioningTask.java:127) [na:na]    at io.cdap.cdap.common.service.Retries.lambda$callWithRetries$2(Retries.java:186) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithRetries(Retries.java:218) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithRetries(Retries.java:186) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithInterruptibleRetries(Retries.java:294) ~[na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningTask.executeOnce(ProvisioningTask.java:127) [na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.lambda$null$22(ProvisioningService.java:696) ~[na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.callWithProgramLogging(ProvisioningService.java:882) ~[na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.lambda$null$23(ProvisioningService.java:694) ~[na:na]    at io.cdap.cdap.common.async.KeyedExecutor$2.run(KeyedExecutor.java:99) ~[na:na]    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_191]    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_191]    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_191] Caused by: com.jcraft.jsch.JSchException: invalid privatekey: [B@628e659c    at com.jcraft.jsch.KeyPair.load(KeyPair.java:664) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.IdentityFile.newInstance(IdentityFile.java:46) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.JSch.addIdentity(JSch.java:442) ~[com.jcraft.jsch-0.1.54.jar:na]    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:81) ~[na:na]    ... 25 common frames omitted

after change the ssh key gen 

ssh-keygen -t rsa -b 2048 -m PEM

The invalid key is fixed but I am facing other issue: 

SNAPSHOT.workflow.DataPipelineWorkflow.e78de5ac-0650-11ed-ab95-000000f7d08e java.io.IOException: Failed to SSH to root@localhost:22    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:103) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillPreparer.launch(RemoteExecutionTwillPreparer.java:117) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.AbstractRuntimeTwillPreparer.lambda$start$1(AbstractRuntimeTwillPreparer.java:466) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$0(RemoteExecutionTwillRunnerService.java:584) ~[na:na]    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_191]    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_191]    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_191] Caused by: com.jcraft.jsch.JSchException: Auth fail    at com.jcraft.jsch.Session.connect(Session.java:519) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.Session.connect(Session.java:183) ~[com.jcraft.jsch-0.1.54.jar:na]    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:100) ~[na:na]    ... 10 common frames omitted 2022-07-18 11:20:12,673 - WARN [runtime-scheduler-10:i.c.c.i.a.r.d.r.RemoteExecutionTwillRunnerService@618] - Force termination of remote process for program_run:default.test.-SNAPSHOT.workflow.DataPipelineWorkflow.e78de5ac-0650-11ed-ab95-000000f7d08e failed java.io.IOException: Failed to SSH to root@localhost:22    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:103) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.SSHRemoteProcessController.killProcess(SSHRemoteProcessController.java:107) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.SSHRemoteProcessController.kill(SSHRemoteProcessController.java:102) ~[na:na]    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$2(RemoteExecutionTwillRunnerService.java:616) ~[na:na]    at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760) ~[na:1.8.0_191]    at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736) ~[na:1.8.0_191]    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474) ~[na:1.8.0_191]    at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977) ~[na:1.8.0_191]    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$0(RemoteExecutionTwillRunnerService.java:586) ~[na:na]    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_191]    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_191]    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_191] Caused by: com.jcraft.jsch.JSchException: socket is not established    at com.jcraft.jsch.Util.createSocket(Util.java:394) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.Session.connect(Session.java:215) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.Session.connect(Session.java:183) ~[com.jcraft.jsch-0.1.54.jar:na]    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:100) ~[na:na]    ... 15 common frames omitted 2022-07-18 11:20:14,726 - WARN [provisioning-task-9:i.c.c.r.s.p.r.RemoteHadoopProvisioner@148] - Unable to clean up resources for program DataPipelineWorkflow run e78de5ac-0650-11ed-ab95-000000f7d08e on the remote cluster. The run directory may need to be manually deleted on cluster node localhost. java.io.IOException: Failed to SSH to root@localhost:22    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:103) ~[na:na]    at io.cdap.cdap.internal.provision.DefaultSSHContext.createSSHSession(DefaultSSHContext.java:120) ~[na:na]    at io.cdap.cdap.runtime.spi.ssh.SSHContext.createSSHSession(SSHContext.java:92) ~[na:na]    at io.cdap.cdap.runtime.spi.ssh.SSHContext.createSSHSession(SSHContext.java:80) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.remote.RemoteHadoopProvisioner.createSSHSession(RemoteHadoopProvisioner.java:82) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.remote.RemoteHadoopProvisioner.deleteCluster(RemoteHadoopProvisioner.java:143) ~[na:na]    at io.cdap.cdap.runtime.spi.provisioner.Provisioner.deleteClusterWithStatus(Provisioner.java:142) [na:na]    at io.cdap.cdap.internal.provision.task.ClusterDeleteSubtask.execute(ClusterDeleteSubtask.java:42) [na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningSubtask.execute(ProvisioningSubtask.java:54) [na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningTask.lambda$executeOnce$1(ProvisioningTask.java:127) [na:na]    at io.cdap.cdap.common.service.Retries.lambda$callWithRetries$2(Retries.java:186) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithRetries(Retries.java:218) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithRetries(Retries.java:186) ~[na:na]    at io.cdap.cdap.common.service.Retries.callWithInterruptibleRetries(Retries.java:294) ~[na:na]    at io.cdap.cdap.internal.provision.task.ProvisioningTask.executeOnce(ProvisioningTask.java:127) [na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.lambda$null$22(ProvisioningService.java:696) ~[na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.callWithProgramLogging(ProvisioningService.java:882) ~[na:na]    at io.cdap.cdap.internal.provision.ProvisioningService.lambda$null$23(ProvisioningService.java:694) ~[na:na]    at io.cdap.cdap.common.async.KeyedExecutor$2.run(KeyedExecutor.java:99) ~[na:na]    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_191]    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_191]    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_191]    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_191]    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_191] Caused by: com.jcraft.jsch.JSchException: Auth fail    at com.jcraft.jsch.Session.connect(Session.java:519) ~[com.jcraft.jsch-0.1.54.jar:na]    at com.jcraft.jsch.Session.connect(Session.java:183) ~[com.jcraft.jsch-0.1.54.jar:na]    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:100) ~[na:na]    ... 25 common frames omitted

i can ssh to localhost and using cdap latest version 6.7.0 sandbox 

[Tuan Minh]

issue happens on ubuntu 22.04 

Vào lúc 11:21:44 UTC+7 ngày Thứ Hai, 18 tháng 7, 2022, nmt...@gmail.com đã viết: