Running Camus(hadoop2 branch) on Hortonworks Sandbox

101 views
Skip to first unread message

ashwi...@gmail.com

unread,
Jul 31, 2014, 3:36:18 PM7/31/14
to camu...@googlegroups.com
Local runner works fine, when i try to run it against the hadoop instance i get the error below

Version: Hadoop 2.4.0.2.1.1.0-385


[root@sandbox target]# java -cp camus-example-0.1.0-SNAPSHOT-shaded.jar:/etc/hadoop/conf:/usr/lib/hadoop-hdfs/hadoop-hdfs.jar com.linkedin.camus.etl.kafka.CamusJob -Djava.library.path=/usr/lib/hadoop/lib/native -P ~/camus/camus-example/src/main/resources/camus_json.properties -Dlog4j.configuration=../log4j.xml
[NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[BlockReaderLocal] - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
[CamusJob] - Dir Destination set to: /data/camus
No previous execution, all topics pulled from earliest available offset
[CamusJob] - New execution temp location: /data/camus/exec/2014-06-29-06-55-28
Exception in thread "main" java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1255)
at org.apache.hadoop.mapreduce.Job$9.run(Job.java:1251)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapreduce.Job.connect(Job.java:1250)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1279)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:318)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:646)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.linkedin.camus.etl.kafka.CamusJob.main(CamusJob.java:610)

Any ideas?

Thanks,

Ashwin

Reply all
Reply to author
Forward
0 new messages