Oozie - Unexpected output of Mapreduce Wordcount Program

38 views
Skip to first unread message

Pragya Jain

unread,
Aug 31, 2015, 5:27:02 PM8/31/15
to Hadoop User Group France
Hello Everyone,

I'm trying to execute MapReduce (wordcount program) job using oozie workflow.When I submit the job, oozie successfully executes but I don't get the expected output.means the o/p is wrong.

EXPECTED OUTPUT -

is    1
pragya    1
pragya,hello    1
this    1

BUT THE OUTPUT GENERATED BY OOZIE -

0    this is pragya,hello pragya

WORKFLOW.XML -

<workflow-app xmlns="uri:oozie:workflow:0.4" name="map-reduce-wf">
 <start to="mr-node"/>
 <action name="mr-node">
     <map-reduce>
       <job-tracker>centos66.tech:8032</job-tracker>
       <name-node>hdfs://centos66.tech:8020</name-node>
       <prepare><delete path="hdfs://centos66.tech:8020/user/countout"/></prepare>
       <configuration>
         <property>
           <name>mapred.mapper.new-api</name>
           <value>true</value>
         </property>
         <property>
           <name>mapred.reducer.new-api</name>
           <value>true</value>
         </property>
         <property>
           <name>mapred.job.queue.name</name>
           <value>${queueName}</value>
         </property>
         <property>
           <name>mapreduce.mapper.class</name>
           <value>Map</value>
         </property>
         <property>
           <name>mapreduce.reducer.class</name>
           <value>Reduce</value>
         </property>
           <property>
                <name>mapred.output.key.class</name>
                <value>org.apache.hadoop.io.LongWritable</value>
              </property>
          <property>
         <name>mapred.output.value.class</name>
         <value>org.apache.hadoop.io.Text</value>
          </property>
         <property>
           <name>mapred.input.dir</name>
           <value>/tempin/wordcount.txt</value>
         </property>
         <property>
           <name>mapred.output.dir</name>
           <value>/user/countout</value>
         </property>
       </configuration>
  </map-reduce>
  <ok to="end"/>
  <error to="fail"/>
 </action>
   <kill name="fail">
   <message>Map/Reduce failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
   </kill>
   <end name="end"/>
</workflow-app>

log file attachments - kindly find the screen shots of oozie web ui and logs of job history.

Any help will be greatly appreciated.Thank u
logs1.png
logs2.png
logs3.png
Reply all
Reply to author
Forward
0 new messages