I'm excited to announce the release of PigPen v0.3.0, which now includes support for Cascading.
PigPen is Map-Reduce for Clojure - you write idiomatic Clojure code, we compile it into an Apache Pig script or a Cascading flow that runs on Hadoop.
An RC build is currently available in Maven (0.3.0-rc.7). We've been using it at Netflix for a little over a month now with no issues, but we want to get it out in the wild before locking down the release.
There are a couple of breaking changes in this release, mostly just moving pig-specific functions into another namespace. Check out the release notes for more details.
Also new since the last major release: semi-joins, anti-joins, load-json, store-json, load-csv (RFC 4180), load-parquet, store-parquet, and load-avro (parquet & avro support not yet available for cascading).
A huge thanks to Piotr Kozikowski for contributing all of the Cascading work to the project.
-Matt
ps. The PigPen name & logo aren't really ideal now that we've added another platform and plan to add more. Apparently we're only clever enough for one name & logo. If you've got an idea for a better name for the project, please let us know. :)