Struck-up with oozie-3.0.2 installation with hadoop-0.20.2

[Pari Margu]

Hi Friends,
                       I have started to install oozie-3.0.2 by referring below url:

http://www.ventlam.org/2012/08/14/oozie-tutorial-part-1-introductioninstall-run-example/

When I am trying to run the below command, getting error message as "Error: HTTP error code: 404 : Not Found"

bin/oozie admin -oozie http://localhost:11000/oozie -status

I have followed the below solution also but no success,

If the status is HTTP 404 Not Found,you can edit the configuration file to fix it.Open conf/oozie-default.xml with vim,copy the property “oozie.services”  into oozie-site.xml. In oozie-site.xml’s  ”oozie.services”  property,one of the service name is “KerberosHadoopAccessorService” .Remove only ”Kerberos” which will make it “HadoopAccessorService”. And then restart oozie.

Can somebody throw some ideas ... Thanks in advance.

Thanks & Regards,

Pari.M

[Prasad]

Hi Pari,

When I tried with Oozie - 3.0.2, I too faced the similar issues with no traces of debugging in the logs and then on seeing forums, it s was suggested to go with 3.2.0(incubating) at the time I tried. So you could either use that or the current stable build oozie-3.3.2 http://apache.techartifact.com/mirror/oozie/3.3.2

Regards,

Prasad

So you could either try with 3.2.0 version which worked for me or go with latest stable version 

[Senthil Kumar]

@Pari

can you check with Siva? I will drop down his number in your mail.

you have not built the war for webconsole correctly.

Or You can share the steps that you followed.

Thanks

Senthil

[Pari Margu]

Hi Prasad,
               Thank you for your input. If I understand correctly, to use oozie-3.3.2 and build war file for webconsole, maveen is required right? I will look into that sure.

Hi Senthil,

Thank you for your input. I just followed below steps by referring url: http://www.ventlam.org/2012/08/14/oozie-tutorial-part-1-introductioninstall-run-example/

Step 1: I have setup the hadoop-0.20.2 and 5 daemon processes are running successfully.

Step 2: I have downloaded oozie-3.0.2-distro.tar.gz and done the following steps

export JAVA_HOME=/home/pari/Pari/jdk1.6.0_38

export HADOOP_HOME=/home/pari/Pari/hadoop-0.20.2

bin/oozie-setup.sh -hadoop 0.20.2 ${HADOOP_HOME} -extjs /home/pari/Pari/ext-2.2.zip

bin/oozie-start.sh

bin/oozie admin -oozie http://localhost:11000/oozie -status

Let me know if I missed any steps.

Thanks & Regards,

Pari.M

[Senthil Kumar]

You can use the 1.0.4 version itself 

[Pari Margu]

Thank you for your information. But i got the error when i ran hadoop version as 1.0.4 in the following command,

bin/oozie-setup.sh -hadoop 1.0.4 ${HADOOP_HOME} -extjs /home/pari/Pari/ext-2.2.zip

The error message is like "this hadoop version is supported for this oozie version"

Pari.M

[Senthil Kumar]

the one of the commands i ran

bin/oozie-setup.sh -hadoop 0.20.2 /home/senthil/hadoop-1.0.4 -extjs /home/senthil/oozie-3.3.0/webapp/src/main/webapp/ext-2.2.zip

[Pari Margu]

Ok sure Senthil. I will check the command as specified below and let you know. One more thing I want to ask you whether I need add these two properties in hadoop's core-site.xml

<property>
    <name>hadoop.proxyuser.pari.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.pari.groups</name>
    <value>*</value>
  </property>

"pari" is my user name in the node. Thanks.

Pari.M

[Prasad S]

Yes pari you should add that command for enabling oozie user to submit
jobs to hadoop cluster. Tats for security purposes.

>>>>>>>> *Error: HTTP error code: 404 : Not Found*"

>>>>>>>>
>>>>>>>> bin/oozie admin -oozie http://localhost:11000/oozie -status
>>>>>>>>
>>>>>>>> I have followed the below solution also but no success,
>>>>>>>>

>>>>>>>> If the status is *HTTP 404 Not Found*,you can edit the

>>>>>>>> configuration file to fix it.Open conf/oozie-default.xml with
>>>>>>>> vim,copy the
>>>>>>>> property “oozie.services” into oozie-site.xml. In oozie-site.xml’s
>>>>>>>>
>>>>>>>> ”oozie.services” property,one of the service name is
>>>>>>>> “KerberosHadoopAccessorService” .Remove only ”Kerberos” which will
>>>>>>>> make it
>>>>>>>> “HadoopAccessorService”. And then restart oozie.
>>>>>>>>
>>>>>>>> Can somebody throw some ideas ... Thanks in advance.
>>>>>>>>
>>>>>>>> Thanks & Regards,
>>>>>>>>
>>>>>>>> Pari.M
>>>>>>>>
>>>>>>>
>

> --
> You received this message because you are subscribed to the Google Groups
> "Hadoop User Group (HUG) Chennai" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to chennaihug+...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

[Pari Margu]

Thank you for your input Prasad, Senthil.

Still my problem is not resolved. I tried to install oozie with hadoop 1.0.4 also. Same error exists.

When I ran this command:
ubuntu@ubuntu:~/Pari/oozie-3.0.2$ bin/oozie-setup.sh -hadoop 0.20.2 ${HADOOP_HOME} -extjs /home/ubuntu/Pari/ext-2.2.zip

the output is: New Oozie WAR file with added 'Hadoop JARs, ExtJS library' at /home/ubuntu/Pari/oozie-3.0.2/oozie-server/webapps/oozie.war

INFO: Oozie is ready to be started

When I ran following command: ubuntu@ubuntu:~/Pari/oozie-3.0.2$ bin/oozie-start.sh

the output is: Setting OOZIE_HOME:          /home/ubuntu/Pari/oozie-3.0.2
Setting OOZIE_CONFIG:        /home/ubuntu/Pari/oozie-3.0.2/conf
Sourcing:                    /home/ubuntu/Pari/oozie-3.0.2/conf/oozie-env.sh
Setting OOZIE_CONFIG_FILE:   oozie-site.xml
Setting OOZIE_DATA:          /home/ubuntu/Pari/oozie-3.0.2/data
Setting OOZIE_LOG:           /home/ubuntu/Pari/oozie-3.0.2/logs
Setting OOZIE_LOG4J_FILE:    oozie-log4j.properties
Setting OOZIE_LOG4J_RELOAD:  10
Setting OOZIE_HTTP_HOSTNAME: ubuntu
Setting OOZIE_HTTP_PORT:     11000
Setting OOZIE_BASE_URL:      http://ubuntu:11000/oozie
Setting CATALINA_BASE:       /home/ubuntu/Pari/oozie-3.0.2/oozie-server
Setting CATALINA_OUT:        /home/ubuntu/Pari/oozie-3.0.2/logs/catalina.out
Setting CATALINA_PID:        /home/ubuntu/Pari/oozie-3.0.2/oozie-server/temp/oozie.pid

Using   CATALINA_OPTS:        -Dderby.stream.error.file=/home/ubuntu/Pari/oozie-3.0.2/logs/derby.log
Adding to CATALINA_OPTS:     -Doozie.home.dir=/home/ubuntu/Pari/oozie-3.0.2 -Doozie.config.dir=/home/ubuntu/Pari/oozie-3.0.2/conf -Doozie.log.dir=/home/ubuntu/Pari/oozie-3.0.2/logs -Doozie.data.dir=/home/ubuntu/Pari/oozie-3.0.2/data -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Doozie.http.hostname=ubuntu -Doozie.http.port=11000 -Doozie.base.url=http://ubuntu:11000/oozie

Using CATALINA_BASE:   /home/ubuntu/Pari/oozie-3.0.2/oozie-server
Using CATALINA_HOME:   /home/ubuntu/Pari/oozie-3.0.2/oozie-server
Using CATALINA_TMPDIR: /home/ubuntu/Pari/oozie-3.0.2/oozie-server/temp
Using JRE_HOME:        /usr
Using CLASSPATH:       /home/ubuntu/Pari/oozie-3.0.2/oozie-server/bin/bootstrap.jar
Using CATALINA_PID:    /home/ubuntu/Pari/oozie-3.0.2/oozie-server/temp/oozie.pid

Oozie started

When I ran this command: ubuntu@ubuntu:~/Pari/oozie-3.0.2$ bin/oozie admin -oozie http://localhost:11000/oozie -status

the output is: Error: HTTP error code: 404 : Not Found

I doubt that whether the oozie.war deployed correctly or not?

I have attached the web.xml from the webapps\oozie\WEB-IN folder. Let me know if anything wrong.

Thanks & Regards,

Pari.M

[Ashwanth Kumar]

Checking from your logs, it seems like something is wrong with your /etc/hosts 

Instead of localhost try ubuntu

Eg. bin/oozie admin -oozie http://ubuntu:11000/oozie -status

--

Ashwanth Kumar / ashwanthkumar.in

[Pari Margu]

Thank you for your input Ashwanth.

Yes, I messed-up some where. Trying to find it.

When I ran this command: bin/oozie admin -oozie http://ubuntu:11000/oozie -status

i got the same error: Error: HTTP error code: 404 : Not Found


I have attached my hosts file for your reference.

Thanks & Regards,

Pari.M

[Pari Margu]

hosts file content is:

127.0.0.1    localhost
127.0.0.1    ubuntu

# The following lines are desirable for IPv6 capable hosts
::1     ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters

[Pari Margu]

Hi Ashwanth, Prasad & Senthil,

Problem is resolved. Sorry I was doing two installation, one is VM and another one dual OS ubuntu.

I missed this step in one installation,

If the status is HTTP 404 Not Found,you can edit the configuration file to fix it.Open conf/oozie-default.xml with vim,copy the property “oozie.services”  into oozie-site.xml. In oozie-site.xml’s  ”oozie.services”  property,one of the service name is “

KerberosHadoopAccessorService” .Remove only ”Kerberos” which will make it “HadoopAccessorService”. And then restart oozie.

After correcting this and as per ashwanth input, now my oozie webconsole is up and running ...

Thanks a lot for All.

Thanks & Regards,

Pari.M