[jsch-scp] Failed copying the file: java.lang.NullPointerException

1,243 views

Skip to first unread message

bbush

unread,

May 1, 2014, 4:30:39 PM5/1/14

to rundeck...@googlegroups.com

Hello---I'm new to Rundeck....I'm trying to get some test jobs setup but I've run into a roadblock with what seems like it should be a simple file copy operation from the Rundeck server (CentOS 6.5) to another CentOS 6.5 server.

I first ran into this issue when trying to use a "script" workflow step in my job and then I backed off of that to try just simple file copy step with the same results.

I'm able to use Rundeck to execute a simple command across the wire just fine using SSH key auth, so I know connectivity is good.

Job log output below. Any ideas would be appreciated. I am sure it's probably a simple fix, but I've been hammering on the issue for a day or so and I'm out of ideas as to what null value Rundeck is encountering here.

Just a simple single file copy....

^text/x-rundeck-log-v2.0^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Begin execution: rundeck-workflow-node-first context: null^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|preparing for sequential execution on 1 nodes^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|Executing command on node: qaveapp04.company.biz, NodeEntryImpl{tags=[app], attributes={tags=app, osFamily=unix, username=contrs, environment=QA, description=QA Application Server, hostname=192.168.202.26, nodename=qaveapp04.company.biz, osName=Centos Linux 6.5}, project='null'}^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|NodeSet: MultiNodeSelector{nodenames=[qaveapp04.company.biz]}^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|Workflow: com.dtolabs.rundeck.core.execution.workflow.StepFirstWorkflowStrategy$stepFirstWrapper@91080307^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|data context: {node={tags=app, username=contrs, environment=QA, os-version=, description=QA Application Server, name=qaveapp04.company.biz, os-arch=, hostname=192.168.202.26, os-name=Centos Linux 6.5, os-family=unix}, job={id=ad10b774-0c97-426b-8153-e0d6bff93be7, project=TesticleBB, loglevel=DEBUG, username=bbush, user.name=bbush, name=SimpleCopyTest1, serverUUID=null, group=null, url=http://scm01:4440/project/TesticleBB/execution/follow/22, serverUrl=http://scm01:4440/, execid=22}, option={}}^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|[workflow] Begin step: 1,NodeDispatch^

^2014-05-01T20:11:53Z|stepbegin||{node=localhost|step=1|stepctx=1|user=bbush}|^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|1: Workflow step executing: com.dtolabs.rundeck.execution.PluginNodeStepExecutionItemImpl@1d92e760^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|preparing for sequential execution on 1 nodes^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|Executing command on node: qaveapp04.company.biz, NodeEntryImpl{tags=[app], attributes={tags=app, osFamily=unix, username=contrs, environment=QA, description=QA Application Server, hostname=192.168.202.26, nodename=qaveapp04.company.biz, osName=Centos Linux 6.5}, project='null'}^

^2014-05-01T20:11:53Z||VERBOSE|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|[workflow] beginExecuteNodeStep(qaveapp04.company.biz): NodeDispatch: com.dtolabs.rundeck.execution.PluginNodeStepExecutionItemImpl@1d92e760^

^2014-05-01T20:11:53Z|nodebegin||{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|^

^2014-05-01T20:11:53Z|||{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|Begin copy 20 bytes to node qaveapp04.company.biz: /tmp/doofus.txt -> /tmp/doofus.txt^

^2014-05-01T20:11:53Z||ERROR|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|java.lang.NullPointerException^

^2014-05-01T20:11:53Z||ERROR|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|failed: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T20:11:53Z||ERROR|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|Failed: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T20:11:53Z|nodeend||{executionState=FAILED|failureReason=CopyFileFailed|node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|[workflow] finishExecuteNodeStep(qaveapp04.company.biz): NodeDispatch: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|1: Workflow step finished, result: Dispatch failed on 1 nodes: [qaveapp04.company.biz: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]^

^2014-05-01T20:11:53Z|stepend||{executionState=FAILED|failedNodes=qaveapp04.company.biz|failureReason=NodeDispatchFailure|node=localhost|step=1|stepctx=1|user=bbush}|Node dispatch failed^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Finish step: 1,NodeDispatch^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Finish execution: rundeck-workflow-node-first: [Workflow step failures: {1=Dispatch failed on 1 nodes: [qaveapp04.company.biz: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}, Node failures: {qaveapp04.company.biz=[CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}]^

^2014-05-01T20:11:53Z||VERBOSE|{node=localhost|user=bbush}|[Workflow step failures: {1=Dispatch failed on 1 nodes: [qaveapp04.company.biz: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}, Node failures: {qaveapp04.company.biz=[CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}]^

^2014-05-01T20:11:53Z||ERROR|{node=localhost|user=bbush}|Execution failed: 22: [Workflow step failures: {1=Dispatch failed on 1 nodes: [qaveapp04.company.biz: CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}, Node failures: {qaveapp04.company.biz=[CopyFileFailed: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException]}]^

^END^

Here's the log output of just trying to execute a remote script that echos "Hello World" on the far end:

^text/x-rundeck-log-v2.0^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Begin execution: rundeck-workflow-node-first context: null^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|preparing for sequential execution on 1 nodes^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|Executing command on node: qaveapp04.company.biz, NodeEntryImpl{tags=[app], attributes={tags=app, osFamily=unix, username=contrs, environment=QA, description=QA Application Server, hostname=192.168.202.26, nodename=qaveapp04.company.biz, osName=Centos Linux 6.5}, project='null'}^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|NodeSet: MultiNodeSelector{nodenames=[qaveapp04.company.biz]}^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|Workflow: com.dtolabs.rundeck.core.execution.workflow.StepFirstWorkflowStrategy$stepFirstWrapper@9a9a27df^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|user=bbush}|data context: {node={tags=app, username=contrs, environment=QA, os-version=, description=QA Application Server, name=qaveapp04.company.biz, os-arch=, hostname=192.168.202.26, os-name=Centos Linux 6.5, os-family=unix}, job={id=34b8d1fb-1c39-4f58-b0d0-477623758ced, project=TestProject1, loglevel=DEBUG, username=bbush, user.name=bbush, name=Deploy Content Resource Server Kit, serverUUID=null, group=QA, url=http://scm01:4440/project/TestProject1/execution/follow/20, serverUrl=http://scm01:4440/, execid=20}, option={isRunningString=java}}^

^2014-05-01T19:43:45Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|[workflow] Begin step: 1,NodeDispatch^

^2014-05-01T19:43:45Z|stepbegin||{node=localhost|step=1|stepctx=1|user=bbush}|^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|1: Workflow step executing: com.dtolabs.rundeck.execution.ExecutionItemFactory$1@1706b188^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|preparing for sequential execution on 1 nodes^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|Executing command on node: qaveapp04.company.biz, NodeEntryImpl{tags=[app], attributes={tags=app, osFamily=unix, username=contrs, environment=QA, description=QA Application Server, hostname=192.168.202.26, nodename=qaveapp04.company.biz, osName=Centos Linux 6.5}, project='null'}^

^2014-05-01T19:43:46Z||VERBOSE|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|[workflow] beginExecuteNodeStep(qaveapp04.company.biz): NodeDispatch: com.dtolabs.rundeck.execution.ExecutionItemFactory$1@1706b188^

^2014-05-01T19:43:46Z|nodebegin||{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|^

^2014-05-01T19:43:46Z||ERROR|{node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|java.lang.NullPointerException^

^2014-05-01T19:43:46Z|nodeend||{executionState=FAILED|failureReason=Unknown|node=qaveapp04.company.biz|step=1|stepctx=1|user=contrs}|[jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|[workflow] finishExecuteNodeStep(qaveapp04.company.biz): NodeDispatch: Unknown: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T19:43:46Z||ERROR|{node=localhost|step=1|stepctx=1|user=bbush}|Failed dispatching to node qaveapp04.company.biz: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|Failed dispatching to node qaveapp04.company.biz: com.dtolabs.rundeck.core.execution.workflow.steps.node.NodeStepException: [jsch-scp] Failed copying the file: java.lang.NullPointerException

at com.dtolabs.rundeck.core.execution.workflow.steps.node.impl.ScriptFileNodeStepExecutor.executeNodeStep(ScriptFileNodeStepExecutor.java:73)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.executeNodeStep(ExecutionServiceImpl.java:149)

at com.dtolabs.rundeck.core.execution.dispatch.SequentialNodeDispatcher.dispatch(SequentialNodeDispatcher.java:116)

at com.dtolabs.rundeck.core.execution.dispatch.SequentialNodeDispatcher.dispatch(SequentialNodeDispatcher.java:58)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.dispatchToNodes(ExecutionServiceImpl.java:177)

at com.dtolabs.rundeck.core.execution.workflow.steps.NodeDispatchStepExecutor.executeWorkflowStep(NodeDispatchStepExecutor.java:66)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.executeStep(ExecutionServiceImpl.java:116)

at com.dtolabs.rundeck.core.execution.workflow.BaseWorkflowStrategy.executeWFItem(BaseWorkflowStrategy.java:162)

at com.dtolabs.rundeck.core.execution.workflow.BaseWorkflowStrategy.executeWorkflowItemsForNodeSet(BaseWorkflowStrategy.java:222)

at com.dtolabs.rundeck.core.execution.workflow.BaseWorkflowStrategy.executeWorkflowItemsForNodeSet(BaseWorkflowStrategy.java:189)

at com.dtolabs.rundeck.core.execution.workflow.StepFirstWorkflowStrategy.executeWorkflowImpl(StepFirstWorkflowStrategy.java:79)

at com.dtolabs.rundeck.core.execution.workflow.BaseWorkflowStrategy.executeWorkflow(BaseWorkflowStrategy.java:120)

at com.dtolabs.rundeck.core.execution.workflow.NodeFirstWorkflowStrategy$DispatchedWorkflow.dispatch(NodeFirstWorkflowStrategy.java:365)

at com.dtolabs.rundeck.core.execution.dispatch.SequentialNodeDispatcher.dispatch(SequentialNodeDispatcher.java:118)

at com.dtolabs.rundeck.core.execution.dispatch.SequentialNodeDispatcher.dispatch(SequentialNodeDispatcher.java:64)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.dispatchToNodes(ExecutionServiceImpl.java:196)

at com.dtolabs.rundeck.core.execution.workflow.NodeFirstWorkflowStrategy.executeWFSectionNodeDispatch(NodeFirstWorkflowStrategy.java:177)

at com.dtolabs.rundeck.core.execution.workflow.NodeFirstWorkflowStrategy.executeWorkflowImpl(NodeFirstWorkflowStrategy.java:106)

at com.dtolabs.rundeck.core.execution.workflow.BaseWorkflowStrategy.executeWorkflow(BaseWorkflowStrategy.java:120)

at com.dtolabs.rundeck.core.execution.WorkflowExecutionServiceThread.run(WorkflowExecutionServiceThread.java:55)

Caused by: com.dtolabs.rundeck.core.execution.service.FileCopierException: [jsch-scp] Failed copying the file: java.lang.NullPointerException

at com.dtolabs.rundeck.core.execution.impl.jsch.JschScpFileCopier.copyFile(JschScpFileCopier.java:166)

at com.dtolabs.rundeck.core.execution.impl.jsch.JschScpFileCopier.copyFile(JschScpFileCopier.java:107)

at com.dtolabs.rundeck.core.execution.impl.jsch.JschScpFileCopier.copyScriptContent(JschScpFileCopier.java:101)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.fileCopyScriptContent(ExecutionServiceImpl.java:295)

at com.dtolabs.rundeck.core.execution.ExecutionServiceImpl.fileCopyScriptContent(ExecutionServiceImpl.java:275)

at com.dtolabs.rundeck.core.execution.workflow.steps.node.impl.ScriptFileNodeStepExecutor.executeNodeStep(ScriptFileNodeStepExecutor.java:65)

... 19 more

Caused by: java.lang.NullPointerException

at org.apache.tools.ant.taskdefs.optional.ssh.Scp.execute(Scp.java:215)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)

at org.apache.tools.ant.Task.perform(Task.java:348)

at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:62)

at com.dtolabs.rundeck.core.execution.impl.jsch.JschScpFileCopier.copyFile(JschScpFileCopier.java:156)

... 24 more

Caused by: java.lang.NullPointerException

at com.dtolabs.rundeck.core.tasks.net.SSHTaskBuilder.openSession(SSHTaskBuilder.java:98)

at com.dtolabs.rundeck.core.tasks.net.ExtScp.openSession(ExtScp.java:32)

at org.apache.tools.ant.taskdefs.optional.ssh.Scp.upload(Scp.java:291)

at org.apache.tools.ant.taskdefs.optional.ssh.Scp.execute(Scp.java:203)

... 32 more

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|step=1|stepctx=1|user=bbush}|1: Workflow step finished, result: NodeDispatchFailure: Failed dispatching to node qaveapp04.company.biz: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T19:43:46Z|stepend||{executionState=FAILED|failureReason=NodeDispatchFailure|node=localhost|step=1|stepctx=1|user=bbush}|Failed dispatching to node qaveapp04.company.biz: [jsch-scp] Failed copying the file: java.lang.NullPointerException^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Finish step: 1,NodeDispatch^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|user=bbush}|[workflow] Finish execution: rundeck-workflow-node-first: [Workflow , Node failures: {qaveapp04.company.biz=[]}]^

^2014-05-01T19:43:46Z||VERBOSE|{node=localhost|user=bbush}|[Workflow , Node failures: {qaveapp04.company.biz=[]}]^

^2014-05-01T19:43:46Z||ERROR|{node=localhost|user=bbush}|Execution failed: 20: [Workflow , Node failures: {qaveapp04.company.biz=[]}]^

Vince H

unread,

May 27, 2014, 2:41:04 PM5/27/14

to rundeck...@googlegroups.com

Were you running this in DEBUG mode? If so, it may be related to this bug https://github.com/rundeck/rundeck/issues/766