"No input paths specified in job" error when using rhwatch

366 views
Skip to first unread message

dhuang

unread,
May 20, 2014, 8:57:52 AM5/20/14
to rh...@googlegroups.com
Hi,

   I am working through the airline example in the documentation with Rhipe 0.73.1-2.
   I ran the following scripts and received the error message in blue below. I would really appreciate your comments on what went wrong and how to fix it.

mapred <- list(rhipe_map_buff_size=5000);
z <- rhwatch(map=map,reduce=reduce,setup=setup,input=rhfmt("/user/huangd/rhipe/airline/data/", type='text'),output="/user/huangd/rhipe/airline/blocks",mapred=mapred,orderby="numeric")

Error message:
java.io.IOException: No input paths specified in job
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:189)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248)
        at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1064)
        at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1081)
        at org.apache.hadoop.mapred.JobClient.access$600(JobClient.java:174)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:993)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:946)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:946)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:566)
        at org.godhuli.rhipe.RHMR.submitAndMonitorJob(RHMR.java:318)
        at org.godhuli.rhipe.RHMR.run(RHMR.java:153)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.godhuli.rhipe.RHMR.fmain(RHMR.java:103)
        at org.godhuli.rhipe.PersonalServer.rhex(PersonalServer.java:166)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at RJavaTools.invokeMethod(RJavaTools.java:386)
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,  :
  java.io.IOException: No input paths specified in job

Saptarshi Guha

unread,
May 20, 2014, 12:02:14 PM5/20/14
to rh...@googlegroups.com
Dont use this line, not required anymore

> mapred <- list(rhipe_map_buff_size=5000);

Try rhfmt(folders="/user/huangd/rhipe/airline/data/", type='text'),

z <- rhwatch(map=map,reduce=reduce,setup=setup,input=rhfmt("/user/huangd/rhipe/airline/data/",
type='text'),output="/user/huangd/rhipe/airline/blocks",mapred=mapred,orderby="numeric")

And what is version of Rhipe are you using?
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "rhipe" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to rhipe+un...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages