hadoopjava jobtype

[vishuda...@gmail.com]

I am trying to execute gobblin job through azkaban using hadoopjava jobtype .My .job file looks like this-

type=hadoopJava

job.class=gobblin.azkaban.AzkabanJobLauncher

classpath=/root/Shared/vb_shared/installed/gobblin_dist/gobblin-omniture-1.2.0-SNAPSHOT.jar,/usr/lib/hadoop/lib/*,/root/Shared/vb_shared/installed/gobblin_dist/lib/hadoop-common-2.4.0,/root/Shared/vb_shared/installed/gobblin_dist/lib/*

main.args=${standalone_prop}

force.output.overwrite=true

jobtype.class=azkaban.jobtype.HadoopJavaJob

obtain.binary.token=true

When i run it through azkaban, i got this error on command line-

java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration

at azkaban.jobtype.HadoopConfigurationInjector.prepareResourcesToInject(HadoopConfigurationInjector.java:88)

at azkaban.jobtype.HadoopJavaJob.run(HadoopJavaJob.java:171)

at azkaban.execapp.JobRunner.runJob(JobRunner.java:516)

at azkaban.execapp.JobRunner.run(JobRunner.java:436)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

cwd=/root/azkaban-solo-2.5.0/executions/13

java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException

at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:94)

at azkaban.jobtype.HadoopJavaJob.run(HadoopJavaJob.java:188)

at azkaban.execapp.JobRunner.runJob(JobRunner.java:516)

at azkaban.execapp.JobRunner.run(JobRunner.java:436)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException

at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:98)

at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:88)

... 8 more

java.lang.Exception: java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException

at azkaban.jobtype.HadoopJavaJob.run(HadoopJavaJob.java:191)

at azkaban.execapp.JobRunner.runJob(JobRunner.java:516)

at azkaban.execapp.JobRunner.run(JobRunner.java:436)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException

at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:94)

at azkaban.jobtype.HadoopJavaJob.run(HadoopJavaJob.java:188)

... 7 more

Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException

at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:98)

at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:88)

... 8 more

I dont know how to resolve this error.Any kind of help would be appreciated.

thanks