Cascading 3.0 Now Available

31 views
Skip to first unread message

Chris K Wensel

unread,
Jun 11, 2015, 2:56:04 PM6/11/15
to cascadi...@googlegroups.com, lingua...@googlegroups.com, patter...@googlegroups.com, us...@tez.apache.org, d...@tez.apache.org

Hey all, 

In case you missed it, 3.0.0 is out!


It took over a year and a half of work to get this release out. Though it feels anti-climatic at this point having been knee deep in it for so long, Cascading 3.0 is a major milestone.

The Apache Tez support is important, but as importantly we have proven we can execute the Cascading intermediate model over multiple distinct computation execution models. 

This was achieved by isolating the API coupling and embody the semantic mapping from Cascading to the target execution model via rules in the query planner.

Some of the thought behind the planner can be read here: http://www.cascading.org/2014/09/18/the-cascading-3-0-query-planner/

Still lacking is good documentation on leveraging the query planner for application specific optimizations.

I plan to incrementally build this knowledge base up as we begin work on additional platform support, and work with other teams like Apache Flink and Hazelcast (https://hazelcast.atlassian.net/wiki/display/COM/HEP+6+-+Cascading+Integration), and obviously Apache Spark.

Thanks every who has tested and/or offered guidance!!

chris

p.s.

Do note that the current GA release of Driven does not support Cascading 3. 

If interested in being notified when Driven EAP can be used with Cascading 3 and Apache Tez, please sign up here: http://www.cascading.org/join/

Chris K Wensel




Patrick Duin

unread,
Jun 12, 2015, 6:59:53 AM6/12/15
to cascadi...@googlegroups.com, us...@tez.apache.org, patter...@googlegroups.com, d...@tez.apache.org, lingua...@googlegroups.com

Congrats on the release!

We've got our test framework Plunger hooked up to the new release.

plunger-3.0.0 supports cascading-3.0.0

Available in maven central, see https://github.com/HotelsDotCom/plunger

Kind regards,
 Patrick

Chris K Wensel

unread,
Jun 12, 2015, 12:27:13 PM6/12/15
to cascadi...@googlegroups.com
Excellent!

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/430208f0-f9d1-4e2e-aebe-0d87e54b6265%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Chris K Wensel




Reply all
Reply to author
Forward
0 new messages