MapReduce job fails for large file

3 views

Skip to first unread message

Punit Naik

unread,

Mar 7, 2016, 2:54:58 AM3/7/16

to Utah Hadoop Users Group - Big Data Utah

I have a Pig script which I ran on a small piece of data to check if its producing the correct output and it did. But when I run the same script on the same data but very large, 30G to be exact, the MapReduce job always fails after completing some percentage of the map phase. The logs too don't show anything.