Output path does not created even though cascading Job run fines

14 views
Skip to first unread message

peehu

unread,
Jan 17, 2017, 7:00:09 AM1/17/17
to cascading-user
Hi,

I am trying to write a job where some aggregation is done on CSV data.
My Flow run fines without any error ,but it does not create output sink.

 Hfs hfs =
          new Hfs(new TextDelimited(new Fields(pipe, config.addHeader(),
             ","), "./xyz/output", SinkMode.KEEP);
        
      DelimitedPartition partition = new DelimitedPartition(new Fields("date_hour_ts"));
     
     Tap sinkTap = new PartitionTap(hfs, partition, SinkMode.REPLACE, true);

     flowDef.addTailSink(outputPipe, sinkTap);

Can someone suggest how to debug reason for it.

peehu

unread,
Jan 18, 2017, 2:04:12 AM1/18/17
to cascading-user

Keeping flowDef.setDebugLevel(DebugLevel.VERBOSE); also does not help in debugging the cause.
Logs shows the message  " deleting temp path xyz/output/_temporary "
so there is no error from Job side as bit of debugging shows that this INFO display if job get succeeded.

Can someone share their insights over this.
Reply all
Reply to author
Forward
0 new messages