Can pig scripts be run as part of cascading flow

49 views
Skip to first unread message

Amit Anand

unread,
May 24, 2012, 5:50:23 AM5/24/12
to cascading-user
Can I execute a pig script from my cascading flow as I have a
requirement of joining data from two files in different format based
on common key which I believe doing in cascading will be difficult. So
I was thinking of using pig script to do the same as part of my
cascading flow

Please suggest

Joris Bontje

unread,
May 24, 2012, 6:20:57 AM5/24/12
to cascadi...@googlegroups.com
What are the differences in format and how do you plan on joining them?
With Cascading you can coerce values from one type to another (for example from String to Integer) with the Coerce assembly:


--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To post to this group, send email to cascadi...@googlegroups.com.
To unsubscribe from this group, send email to cascading-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/cascading-user?hl=en.


David Kincaid

unread,
May 24, 2012, 8:57:02 AM5/24/12
to cascadi...@googlegroups.com
Joins are of two data streams are done in Cascading using a CoGroup pipe. It's really quite easy to do. Look at http://docs.cascading.org/cascading/2.0/userguide/html/ch03s03.html#N2061A

Dave
Reply all
Reply to author
Forward
0 new messages