Hadoop streaming and cascalog

[C. A.]

Hello everybody,

I have searched the group for similiar threads but couldn't find any.

Is itpossible to run cascalog jobs on hadoop streaming?

Kind Regards,

C.A 

[Sam Ritchie]

I don't think so; Hadoop streaming is for non-JVM languages that need to pipe everything through STDIN and STDOUT. Why would you need to do this, vs using Hadoop proper?

--
Sam Ritchie
703.662.1337
@sritchie

--
You received this message because you are subscribed to the Google Groups "cascalog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascalog-use...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[C. A.]

Hi Sam,

We are using erlang escripts to run map/reduce jobs :-) 

But I thought so. Thanks for reply.

/Can

[Sam Ritchie]

You could move between streaming and cascalog by storing results of the erlang run in a text file, then starting up again in cascalog when the step completes. You might try cascalog.workflow for this.

--
Sam Ritchie
703.662.1337
@sritchie

[Can Arel]

Thanks Sam! Will check it out!

2013/5/10 Sam Ritchie <sritc...@gmail.com>

--
You received this message because you are subscribed to a topic in the Google Groups "cascalog-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/cascalog-user/ruMXYj8-gjA/unsubscribe?hl=en-US.
To unsubscribe from this group and all its topics, send an email to cascalog-use...@googlegroups.com.