Re: [cascalog-user] Digest for cascalog-user@googlegroups.com - 2 updates in 1 topic

[Ruhollah Farchtchi]

I would be interested in helping out if anyone else is.  

On Saturday, June 7, 2014, <cascal...@googlegroups.com> wrote:

  Today's topic summary

Group: http://groups.google.com/group/cascalog-user/topics

• Is there any doc/example on how to use Cascalog with Storm? [2 Updates]

 Is there any doc/example on how to use Cascalog with Storm?

Bruno Bonacci <bruno....@gmail.com> Jun 06 06:45AM -0700  

Hi,
 
I've read that this is possible but I haven't found the doc.
Can anyone point me to the doc or any example?
 
Bruno


 

Sam Ritchie <sritc...@gmail.com> Jun 06 09:53AM -0400  

It's not possible yet - someone needs to step up to help with the Storm
planner implementation. I'd love to coach anyone through this who's
interested. I'd also be open to consulting on it, if someone needs it
right away.
 
 
--
Sam Ritchie (@sritchie)
Paddleguru Co-Founder
703.863.8561
www.paddleguru.com <http://www.paddleguru.com/>
Twitter <http://twitter.com/paddleguru>// Facebook
<http://facebook.com/paddleguru>


 

--
Ruhollah Farchtchi
ruhollah....@gmail.com

[Sam Ritchie]

Awesome! The implementation would use Soren's Marceline:

http://yieldbot.com/blog/say-hello-to-marceline-clojure-trident-dsl

Sounds like we need one more :)

Ruhollah Farchtchi

June 7, 2014 at 9:57 AM

I would be interested in helping out if anyone else is.  

On Saturday, June 7, 2014, <cascal...@googlegroups.com> wrote:

--
Ruhollah Farchtchi
ruhollah....@gmail.com
--
You received this message because you are subscribed to the Google Groups "cascalog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascalog-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Sam Ritchie (@sritchie)

Paddleguru Co-Founder
703.863.8561
www.paddleguru.com
Twitter // Facebook

[Ruhollah Farchtchi]

Would the same approach be used to integrate spark? Also is there anything that we need to take into account for batch vs realtime semantics? I may be able to grab a volunteer later this month if we can work on spark as well.

[Sam Ritchie]

The approach would be the same. Initially we'd just use Cascalog to build up spark flows, and drop down to a lower level DSL when necessary. I think we could build in spark-specific options like cache-size, etc.

So, yeah, definitely a great project if someone wants to pick it up.

—
Sent from Mailbox

On Sat, Jun 14, 2014 at 6:26 AM, Ruhollah Farchtchi <ruhollah....@gmail.com> wrote:

Would the same approach be used to integrate spark? Also is there anything that we need to take into account for batch vs realtime semantics? I may be able to grab a volunteer later this month if we can work on spark as well.