Unable to read fields from tap on data1 example

[Diane Yarbrough]

Just trying to run my first example, I see my user directory name is incorrect.   Data1 is looking for "hdfs://localhost:8020/user/diane.yarbrough/data/rain.txt" but the actual path is "hdfs://localhost:8020/Users/diane.yarbrough/data/rain.txt"]

Note /user vs /Users.   How do I change this?  I see I can change the host and port, but not the directories in the conf files.

13/05/29 11:20:47 INFO property.AppProps: using app.id: CF8D917E985F5DFE178966DF8F383422

Exception in thread "main" cascading.flow.planner.PlannerException: could not build flow from assembly: [unable to read fields from tap: Hfs["TextLine[['line']->[ALL]]"]["hdfs://localhost:8020/user/diane.yarbrough/data/rain.txt"]"], does not exist]

at cascading.flow.planner.FlowPlanner.handleExceptionDuringPlanning(FlowPlanner.java:533)

at cascading.flow.hadoop.planner.HadoopPlanner.buildFlow(HadoopPlanner.java:237)

at cascading.flow.FlowConnector.connect(FlowConnector.java:454)

at impatient.Main.main(Main.java:64)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: cascading.tap.TapException: unable to read fields from tap: Hfs["TextLine[['line']->[ALL]]"]["hdfs://localhost:8020/user/diane.yarbrough/data/rain.txt"]"], does not exist

at cascading.scheme.util.DelimitedParser.parseFirstLine(DelimitedParser.java:253)

at cascading.scheme.hadoop.TextDelimited.retrieveSourceFields(TextDelimited.java:828)

at cascading.tap.Tap.retrieveSourceFields(Tap.java:361)

at cascading.flow.BaseFlow.retrieveSourceFields(BaseFlow.java:214)

at cascading.flow.BaseFlow.<init>(BaseFlow.java:180)

at cascading.flow.hadoop.HadoopFlow.<init>(HadoopFlow.java:88)

at cascading.flow.hadoop.planner.HadoopPlanner.buildFlow(HadoopPlanner.java:200)

[Diane Yarbrough]

Found my problem!   Thanks anyway

[Paco Nathan]

Were those problems with examples from the "Cascading for the Impatient" series?

I noticed the data file name... :)

On Thu, May 30, 2013 at 10:14 AM, Yan Aung <yan.py...@gmail.com> wrote:

Could you share what your solution was? I am sort of having the same problem.

Thanks in advance.

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[sandeepm...@gmail.com]

Hi, I am new to cascading and trying to run my first example, I am having the same problem

Exception in thread "main" cascading.flow.planner.PlannerException: [Copy] could not build flow from assembly: [unable to read fields from tap: Hfs["TextLine[
['line']->[ALL]]"]["hdfs://localhost:9000/user/SMUDUGAN/data/rain.txt"], does not exist]

Could you share your solution for the problem?

Thanks in advance.

[sandeepm...@gmail.com]

Found the problem, the file needs to be loaded to hdfs.