Getting Exception in argument --table-list. Its not finding that input file which I am passing to it

27 views
Skip to first unread message

Vishal Agrawal

unread,
Aug 7, 2017, 12:21:54 PM8/7/17
to reair
I am getting the below exception when I am trying to run the replication job through hadoop jar command. 
--table-list argument is not accepting the input file which I am passing. Can someone please check and help.? Does that need to be in hdfs or in local file system. I tried both but nothing worked.
I also don't see the reair_*** folder anywhere in hdfs ? 
Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://<hostname>:8020/tmp/hive_replication/reair_1502115238006_19baa001-a152-4901-b3ba-003e39c7c6cf/abc.txt
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:323)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:265)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:387)
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:318)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:196)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at com.airbnb.reair.batch.hive.MetastoreReplicationJob.runMetastoreCompareJobWithTextInput(MetastoreReplicationJob.java:459)
at com.airbnb.reair.batch.hive.MetastoreReplicationJob.runMetastoreCompareJob(MetastoreReplicationJob.java:421)
at com.airbnb.reair.batch.hive.MetastoreReplicationJob.run(MetastoreReplicationJob.java:316)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at com.airbnb.reair.batch.hive.MetastoreReplicationJob.main(MetastoreReplicationJob.java:551)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)

Taikun Liu

unread,
Aug 8, 2017, 1:05:31 PM8/8/17
to reair
What is the argument you passed to table-list? Can you try file://yourlocalpath ?
Reply all
Reply to author
Forward
0 new messages