Flow Exception using WritableSequenceFile

26 views
Skip to first unread message

Anil Kumar M

unread,
Apr 11, 2014, 5:25:22 PM4/11/14
to cascadi...@googlegroups.com
Hello,

I get this error when using WritableSequenceFile, but when i use SequenceFile(path), no error, writes successfully.
Environment: Hadoop 1.0.3
Scalding: 0.9.1

Source:
class TestImageJob(args : Args) extends Job(args) {
      TextLine(args("input"))
      .map('line -> 'image){
        line : String => line.getBytes()
      }  
      .project('line,'image)
      .write(WritableSequenceFile[NullWritable, ByteWritable](args("output"), ('line, 'image))) 
}


Exception in thread "main" java.lang.Throwable: If you know what exactly caused this error, please consider contributing to GitHub via following link.
https://github.com/twitter/scalding/wiki/Common-Exceptions-and-possible-reasons#cascadingflowflowexception
    at com.twitter.scalding.Tool$.main(Tool.scala:137)
    at com.twitter.scalding.Tool.main(Tool.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:622)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: cascading.flow.FlowException: step failed: (1/1) out, with job id: job_201404120220_0007, please see cluster logs for failure messages
    at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:221)
    at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:149)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:124)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:43)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:701)

Reply all
Reply to author
Forward
0 new messages