Cascading 4.5 WIP = Hadoop 3 and Tez 0.10

[Chris K Wensel]

Hey all

Thanks to the team at Foursquare Labs, we have a new WIP with support for Hadoop 3.

Special thanks to Daniel https://github.com/daniel-sudz and Jon https://github.com/jonshea for the contributions.

You can find the branch here:

https://github.com/cwensel/cascading/tree/wip-4.5

And as a reminder, WIP releases are through Github Packages

https://github.com/cwensel?tab=packages&repo_name=cascading

FWIW, the 4.5 branch will track the 4.1 branch which retains legacy Hadoop 2 support. That is, features added to 4.1 will be merged into 4.5 in tandem until release.

For lack of time and resources we can no longer maintain multiple version of Hadoop in a single release. Hopefully this model works out for everyone.

Also, Parquet has dropped Cascading support, I have a branch that ports it over to the Cascading repo, but I haven’t had the time to complete some of the needed improvements and get the tests working.

If anyone has a vested interest in Parquet and wants to offer input or code, let me know.

Also, old news, but Elasticsearch has dropped Cascading as well, I also have a git repo that needs some love.

https://github.com/cwensel/elasticsearch-hadoop

enjoy,

chris

—
Chris K Wensel
ch...@wensel.net