SPLIT function

5 views
Skip to first unread message

meh...@gmail.com

unread,
Nov 13, 2017, 12:04:03 PM11/13/17
to PigPen Support
I didn't see any support for the 'SPLIT' function. I'm investigating converting existing pig scripts to use pigpen and these scripts make use of the SPLIT function.

Thanks

Matt Bossenbroek

unread,
Nov 13, 2017, 12:25:35 PM11/13/17
to PigPen Support, meh...@gmail.com
That one isn’t supported. There was no clear mapping to a Clojure concept & it really doesn’t do anything special under the hood. You could do something similar like this:

(defn predicate [x]
(< x 42))

(defn split [data]
[(pig/filter predicate data)
(pig/remove predicate data)])

If you have a more complicated example, I could give you pointers as to what it might look like.

-Matt


On November 13, 2017 at 9:04:05 AM, meh...@gmail.com (meh...@gmail.com) wrote:

I didn't see any support for the 'SPLIT' function. I'm investigating converting existing pig scripts to use pigpen and these scripts make use of the SPLIT function.

Thanks

--
You received this message because you are subscribed to the Google Groups "PigPen Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pigpen-suppor...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages