Improving the Cascading flow performance

23 views
Skip to first unread message

Raju

unread,
Feb 28, 2015, 8:52:40 PM2/28/15
to cascadi...@googlegroups.com
Hi,
We have a flow which is used to run for 20 minutes with 10 steps. As part of requirement we have introduced cascading four Counter  in the flow, now it is executing almost 30 to 35 minutes with 14 steps.Is there a way to improve the performance?
Also How a flow will be converted into a Map- reduce programs? Does every Each pipe will be converted into a Map reduce program?

Regards,
Raju

Chris K Wensel

unread,
Feb 28, 2015, 10:11:40 PM2/28/15
to cascadi...@googlegroups.com
This is the best way to learn how Cascading, creates MR jobs, performs, and where to find bottlenecks.


ckw

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/a5f3c031-dfc7-4d9a-903c-1f45154d413f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Chris K Wensel




Reply all
Reply to author
Forward
0 new messages