Camus job throwing Number format exception

76 views

Skip to first unread message

cti...@gmail.com

unread,

Jun 12, 2014, 6:40:48 PM6/12/14

to camu...@googlegroups.com

I am new to camus. I am having difficulty connecting to camus.

I think I have set properties correctly:

zookeeper.hosts=10.132.62.231:2181
zookeeper.broker.topics=/brokers/topics
zookeeper.broker.nodes=/brokers/ids

kafka.brokers=10.132.62.231:9092

I am still getting the below exception. When I try tcpdump, I dont see any traffic on either of destination ports.

Please help.

[CamusJob] - Unable to pull requests from Kafka brokers. Exiting the program
java.lang.NumberFormatException: For input string: ""
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:504)
at java.lang.Integer.parseInt(Integer.java:527)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:919)
at com.linkedin.camus.etl.kafka.CamusJob.getKafkaTimeoutValue(CamusJob.java:655)
at com.linkedin.camus.etl.kafka.mapred.EtlInputFormat.createConsumer(EtlInputFormat.java:134)
at com.linkedin.camus.etl.kafka.mapred.EtlInputFormat.getKafkaMetadata(EtlInputFormat.java:108)
at com.linkedin.camus.etl.kafka.mapred.EtlInputFormat.getSplits(EtlInputFormat.java:242)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:491)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:280)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.linkedin.camus.etl.kafka.CamusJob.main(CamusJob.java:572)
[JobSubmitter] - Cleaning up the staging area file:/tmp/hadoop-ctippur/mapred/staging/ctippur45485351/.staging/job_local45485351_0001
Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:492)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:280)
at com.linkedin.camus.etl.kafka.CamusJob.run(CamusJob.java:608)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.linkedin.camus.etl.kafka.CamusJob.main(CamusJob.java:572)

Reply all

Reply to author

Forward

0 new messages