re-run failed task

14 views
Skip to first unread message

Chao Peng

unread,
Sep 7, 2012, 4:53:33 AM9/7/12
to dumbo...@googlegroups.com
Hi,

I'm new to dumbo.

I have 71 map tasks, all finished, and 80 reduce tasks, however, 74 reduce tasks finished, but 6 failed due to timeout.

Can I redo these 6 failed reduce tasks?

Thanks,

Chao Peng


Gilles Vandelle

unread,
Sep 7, 2012, 5:32:26 AM9/7/12
to dumbo...@googlegroups.com
Hi Chao Peng,

Unfortunately not, hadoop cleans the mapper output so you need to rerun your job. I recommend to test your job on a sub-set of your data before so you'll loose less time at each retry.

-Gilles



--
You received this message because you are subscribed to the Google Groups "dumbo-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/dumbo-user/-/ed5IbazjjJAJ.
To post to this group, send email to dumbo...@googlegroups.com.
To unsubscribe from this group, send email to dumbo-user+...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/dumbo-user?hl=en.



--
Gilles Vandelle
gil...@vandelle.com

Reply all
Reply to author
Forward
0 new messages