error running ./gobblin-mapreduce.sh --conf /home/in/wikipedia.pull

[krishna tiwari]

I have the job file in the location.

I can get the below error 

Exception in thread "main" java.io.FileNotFoundException: File /home/ec2-user/gobblin-dist/lib/gson-2.3.1.jar does not exist.

Exception in thread "main" java.io.FileNotFoundException: File /home/ec2-user/gobblin-dist/lib/joda-time-2.9.jar does not exist.

to overcome i did 

mv ~/gobblin-dist/lib/gson-2.6.1.jar ~/gobblin-dist/lib/gson-2.3.1.jar

mv ~/gobblin-dist/lib/joda-time-2.9.2.jar ~/gobblin-dist/lib/joda-time-2.9.jar 

Finally i am stuck with the below error 

2016-03-01 19:08:12 UTC ERROR [main] gobblin.runtime.AbstractJobLauncher  307 - Failed to launch and run job job_GobblinKafkaQuickStart_1456859289039: java.lang.NoSuchMethodError: org.apache.hadoop.net.NetUtils.createSocketAddr(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Ljava/net/InetSocketAddress;

java.lang.NoSuchMethodError: org.apache.hadoop.net.NetUtils.createSocketAddr(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;)Ljava/net/InetSocketAddress;

        at org.apache.hadoop.mapred.ClientCache$1.run(ClientCache.java:95)

        at org.apache.hadoop.mapred.ClientCache$1.run(ClientCache.java:92)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:356)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)

        at org.apache.hadoop.mapred.ClientCache.instantiateHistoryProxy(ClientCache.java:92)

        at org.apache.hadoop.mapred.ClientCache.getInitializedHSProxy(ClientCache.java:77)

        at org.apache.hadoop.mapred.YARNRunner.addHistoryToken(YARNRunner.java:185)

        at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:282)

        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:536)

        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)

        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:415)

        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)

        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)

        at gobblin.runtime.mapreduce.MRJobLauncher.runWorkUnits(MRJobLauncher.java:200)

        at gobblin.runtime.AbstractJobLauncher.launchJob(AbstractJobLauncher.java:288)

        at gobblin.runtime.mapreduce.CliMRJobLauncher.run(CliMRJobLauncher.java:50)

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

        at gobblin.runtime.mapreduce.CliMRJobLauncher.main(CliMRJobLauncher.java:77)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

[Sahil Takiar]

I believe this was resolved in: https://github.com/linkedin/gobblin/issues/779

--
You received this message because you are subscribed to the Google Groups "gobblin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gobblin-user...@googlegroups.com.
To post to this group, send email to gobbli...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gobblin-users/17bf18c2-204e-4893-9636-dd95b1abf216%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[krishna tiwari]

Yes this is resolved by making sure the correct hadoop common jar is passed.