Oozie Workflow fails with Launcher ERROR

896 views
Skip to first unread message

royojiligwe

unread,
Jul 26, 2016, 11:47:42 AM7/26/16
to Hue-Users
Hi,

I am getting the error 'Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]' when I try running a hive2 job from Oozie workflow:

We are using Hue 3.9.0 and on CDH5.7.0 with  AD Kerberos enabled... hive.server2.use.SSL property value is true in myhive-site.xml config file used for the workflow attached.

The workflow.xml is as follows: (Note: I replace the hive server2 node with a variable just for privacy reasons)

<workflow-app name="hive2_test1" xmlns="uri:oozie:workflow:0.5">
  <credentials>
    <credential name="hcat" type="hcat">
      <property>
        <name>hcat.metastore.uri</name>
        <value>thrift://node04.company.local:9083</value>
      </property>
      <property>
        <name>hcat.metastore.principal</name>
        <value>hive/node04.com...@COMPANY.LOCAL</value>
      </property>
    </credential>
  </credentials>
    <start to="hive2-8182"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="hive2-8182" cred="hcat">
        <hive2 xmlns="uri:oozie:hive2-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
              <job-xml>/user/rojiligwe/myhive-site.xml</job-xml>
            <jdbc-url>jdbc:hive2://node04.company.local:10000/default</jdbc-url>
            <script>/user/kbose/test-hive2</script>
        </hive2>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>


myhive-site.xml

royojiligwe

unread,
Jul 26, 2016, 11:54:42 AM7/26/16
to Hue-Users
Sorry I forgot to include the log generated from the Oozie workflow which is now attached.


On Tuesday, July 26, 2016 at 10:47:42 AM UTC-5, royojiligwe wrote:
Hi,

I am getting the error 'Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]' when I try running a hive2 job from Oozie workflow:

We are using Hue 3.9.0 and on CDH5.7.0 with  AD Kerberos enabled... hive.server2.use.SSL property value is true in myhive-site.xml config file used for the workflow attached.

The workflow.xml is as follows: (Note: I replace the hive server2 node with a variable just for privacy reasons)

<workflow-app name="hive2_test1" xmlns="uri:oozie:workflow:0.5">
  <credentials>
    <credential name="hcat" type="hcat">
      <property>
        <name>hcat.metastore.uri</name>
        <value>thrift://node04.company.local:9083</value>
      </property>
      <property>
        <name>hcat.metastore.principal</name>
        <value>hive/node04.company.lo...@COMPANY.LOCAL</value>
oozie_log.txt

Romain Rigaux

unread,
Aug 1, 2016, 10:32:51 PM8/1/16
to royojiligwe, Hue-Users
Do you see any good error message in the map reduce job of the map reduce jobs of the hive script on jobbrowser?
On Tue, Jul 26, 2016 at 8:54 AM royojiligwe <royoj...@gmail.com> wrote:
Sorry I forgot to include the log generated from the Oozie workflow which is now attached.


On Tuesday, July 26, 2016 at 10:47:42 AM UTC-5, royojiligwe wrote:
Hi,

I am getting the error 'Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]' when I try running a hive2 job from Oozie workflow:

We are using Hue 3.9.0 and on CDH5.7.0 with  AD Kerberos enabled... hive.server2.use.SSL property value is true in myhive-site.xml config file used for the workflow attached.

The workflow.xml is as follows: (Note: I replace the hive server2 node with a variable just for privacy reasons)

<workflow-app name="hive2_test1" xmlns="uri:oozie:workflow:0.5">
  <credentials>
    <credential name="hcat" type="hcat">
      <property>
        <name>hcat.metastore.uri</name>
        <value>thrift://node04.company.local:9083</value>
      </property>
      <property>
        <name>hcat.metastore.principal</name>
        <value>hive/node04.com...@COMPANY.LOCAL</value>
      </property>
    </credential>
  </credentials>
    <start to="hive2-8182"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="hive2-8182" cred="hcat">
        <hive2 xmlns="uri:oozie:hive2-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
              <job-xml>/user/rojiligwe/myhive-site.xml</job-xml>
            <jdbc-url>jdbc:hive2://node04.company.local:10000/default</jdbc-url>
            <script>/user/kbose/test-hive2</script>
        </hive2>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>


--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+u...@cloudera.org.

royojiligwe

unread,
Aug 3, 2016, 6:03:18 PM8/3/16
to Hue-Users, royoj...@gmail.com
Hi Romain,

Thanks for your response.

I could only see the log I attached (oozie_log.txt) in my 2nd post on this issue. stdout, stderr and syslog are all empty (not sure why).

However, this issue is now resolved for Hive actions after we disabled SSL on Hiveserver2 and changed the credential from hcat to hive2.

Now I am currently experiencing a similar error when I try to run a Sqoop 1 action on oozie.  . The error message is as follows:

 

Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]


See below the workflow.xml:

<workflow-app name="Test_Sqoop" xmlns="uri:oozie:workflow:0.5">

  <credentials>

    <credential name="hive2" type="hive2">

      <property>

        <name>hive2.jdbc.url</name>

        <value>jdbc:hive2://node04.company.local:10000/default</value>

      </property>

      <property>

        <name>hive2.server.principal</name>

        <value>hive/node04.com...@COMPANY.LOCAL</value>

      </property>

    </credential>

  </credentials>

    <start to="sqoop-0520"/>

    <kill name="Kill">

        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>

    </kill>

    <action name="sqoop-0520" cred="hive2">

        <sqoop xmlns="uri:oozie:sqoop-action:0.2">

            <job-tracker>${jobTracker}</job-tracker>

            <name-node>${nameNode}</name-node>

            <command>import  --connect jdbc:oracle:thin:@db_servername:1521/ORCL --username ******* --password ******** --table ADJUSTMENT_TYPES --hive-import --hive-table DWH.RK_ADJUSTMENT_TYPES --num-mappers 1 --verbose</command>

        </sqoop>

        <ok to="End"/>

        <error to="Kill"/>

    </action>

    <end name="End"/>

</workflow-app>


Regards,

Roy



On Monday, August 1, 2016 at 9:32:51 PM UTC-5, Romain Rigaux wrote:

Do you see any good error message in the map reduce job of the map reduce jobs of the hive script on jobbrowser?
On Tue, Jul 26, 2016 at 8:54 AM royojiligwe <royoj...@gmail.com> wrote:
Sorry I forgot to include the log generated from the Oozie workflow which is now attached.


On Tuesday, July 26, 2016 at 10:47:42 AM UTC-5, royojiligwe wrote:
Hi,

I am getting the error 'Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.Hive2Main], exit code [2]' when I try running a hive2 job from Oozie workflow:

We are using Hue 3.9.0 and on CDH5.7.0 with  AD Kerberos enabled... hive.server2.use.SSL property value is true in myhive-site.xml config file used for the workflow attached.

The workflow.xml is as follows: (Note: I replace the hive server2 node with a variable just for privacy reasons)

<workflow-app name="hive2_test1" xmlns="uri:oozie:workflow:0.5">
  <credentials>
    <credential name="hcat" type="hcat">
      <property>
        <name>hcat.metastore.uri</name>
        <value>thrift://node04.company.local:9083</value>
      </property>
      <property>
        <name>hcat.metastore.principal</name>
        <value>hive/node04.company.lo...@COMPANY.LOCAL</value>
      </property>
    </credential>
  </credentials>
    <start to="hive2-8182"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="hive2-8182" cred="hcat">
        <hive2 xmlns="uri:oozie:hive2-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
              <job-xml>/user/rojiligwe/myhive-site.xml</job-xml>
            <jdbc-url>jdbc:hive2://node04.company.local:10000/default</jdbc-url>
            <script>/user/kbose/test-hive2</script>
        </hive2>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>
Reply all
Reply to author
Forward
0 new messages