How to run pig scripts

[Punit Naik]

I have generated the pig script and also the pigpen uber jar. Now I don't have pig installed. What steps do I need to follow to execute this script?

[Matt Bossenbroek]

The pig docs are a great place to start: https://pig.apache.org/docs/r0.15.0/start.html

They list how to download & setup pig on your machine and how to run scripts locally. Usually it's a command like this `pig -x local -f my-script.pig`.

Pigpen can also generate cascading flows, so you might be interested in pursuing that route as well: http://www.cascading.org/

-Matt

On Wednesday, February 24, 2016 at 3:37 AM, Punit Naik wrote:

I have generated the pig script and also the pigpen uber jar. Now I don't have pig installed. What steps do I need to follow to execute this script?

--
You received this message because you are subscribed to the Google Groups "PigPen Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pigpen-suppor...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Punit Naik]

Thanks a lot Matt. I just tried it in mapreduce mode and it worked like a charm

But there is just one thing, I did not start YARN on the hadoop node (assuming PigPen uses Pig which in turn uses YARN). So I am guessing it ran the script in a pseduo-distributed cluster mode.

So my question is, how can I use PigPen in a fully distributed cluster mode? 

[Matt Bossenbroek]

There are a multitude of different valid ways to set up pig/hadoop/yarn etc. Once you have a pig script generated, PigPen doesn't really have much to say about how or where it's executed. I would consult a hadoop or yarn resource to get help with setting up a larger cluster.

-Matt