[ANN] PigPen 0.3.0 - Now with Cascading!

16 views
Skip to first unread message

mbosse...@netflix.com

unread,
May 11, 2015, 11:41:20 AM5/11/15
to pigpen-...@googlegroups.com
I'm excited to announce the release of PigPen v0.3.0, which now includes support for Cascading.

PigPen is Map-Reduce for Clojure - you write idiomatic Clojure code, we compile it into an Apache Pig script or a Cascading flow that runs on Hadoop.


An RC build is currently available in Maven (0.3.0-rc.7). We've been using it at Netflix for a little over a month now with no issues, but we want to get it out in the wild before locking down the release.

There are a couple of breaking changes in this release, mostly just moving pig-specific functions into another namespace. Check out the release notes for more details.

Also new since the last major release: semi-joins, anti-joins, load-json, store-json, load-csv (RFC 4180), load-parquet, store-parquet, and load-avro (parquet & avro support not yet available for cascading).

A huge thanks to Piotr Kozikowski for contributing all of the Cascading work to the project.

For questions or complaints: pigpen-...@googlegroups.com

-Matt


ps. The PigPen name & logo aren't really ideal now that we've added another platform and plan to add more. Apparently we're only clever enough for one name & logo. If you've got an idea for a better name for the project, please let us know. :)

Sunil S Nandihalli

unread,
May 12, 2015, 12:03:25 AM5/12/15
to Matt Bossenbroek, pigpen-...@googlegroups.com
This is great news. Will give it a run shortly...
Thanks Matt,
Sunil

--
You received this message because you are subscribed to the Google Groups "PigPen Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pigpen-suppor...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages