Does Cascading support streaming platform .

24 views
Skip to first unread message

Vivek Nagarajan

unread,
Jan 24, 2017, 6:14:37 PM1/24/17
to cascading-user
I am aware that Cascading can be used with other processing technologies such as Flink and Tez apart from the basic Map Reduce. I assume all these are batch operations. 
Does it support stream processing ?

Ken Krugler

unread,
Jan 24, 2017, 7:53:57 PM1/24/17
to cascadi...@googlegroups.com
On Jan 24, 2017, at 3:14pm, Vivek Nagarajan <viv...@gmail.com> wrote:

I am aware that Cascading can be used with other processing technologies such as Flink and Tez apart from the basic Map Reduce. I assume all these are batch operations. 
Does it support stream processing ?

No, not currently.

The most “Cascading-like” alternative for stream processing that I’ve seen is Flink. Though it doesn’t let you manipulate the data using just field names…Flink really wants you to use POJO types, though if you’re comfortable with Scala that gets you around some of the need to define lots of data types (which is something needed for Crunch, as an example).

— Ken


--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/f8d26feb-60bb-4da1-976c-046cc0da5339%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--------------------------
Ken Krugler
custom big data solutions & training
Hadoop, Cascading, Cassandra & Solr



Reply all
Reply to author
Forward
0 new messages