Exception on o.a.hadoop.http.HttpConfig.setPolicy

[Matěj Holec]

Hi,

I have a problem with executing the graph-of-the-gods.json example (logs are below).

Gremlin commands:
g = HadoopFactory.open('conf/hadoop/titan-graphson.properties')
g.V.type.groupCount

Hadoop
I use Hortonworks data platform 2.2 (Hadoop 2.6.0).

Other settings
 export TITAN_HOME=/opt/titan
 export HADOOP_CONF=/etc/hadoop/conf/
 export TITAN_JAVA_OPTS='-Djava.library.path=/usr/hdp/2.2.0.0-2041/hadoop/lib/native/'


Any suggestions?

Thanks!
Matej



Execution log

15:47:18 INFO  org.apache.hadoop.mapreduce.Job  - Running job: job_1425307260964_0001
15:48:35 INFO  org.apache.hadoop.mapreduce.Job  - Job job_1425307260964_0001 running in uber mode : false
15:48:35 INFO  org.apache.hadoop.mapreduce.Job  -  map 0% reduce 0%
15:48:35 INFO  org.apache.hadoop.mapreduce.Job  - Job job_1425307260964_0001 failed with state FAILED due to: Application application_1425307260964_0001 failed 2 times due to AM Container for appattempt_1425307260964_0001_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://node01:8088/proxy/application_1425307260964_0001/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1425307260964_0001_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
    at org.apache.hadoop.util.Shell.run(Shell.java:455)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)


Job log:

2015-03-02 15:48:24,678 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1425307260964_0001_000001
2015-03-02 15:48:26,649 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoSuchMethodError: org.apache.hadoop.http.HttpConfig.setPolicy(Lorg/apache/hadoop/http/HttpConfig$Policy;)V
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1364)
2015-03-02 15:48:26,656 INFO [Thread-1] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a signal. Signaling RMCommunicator and JobHistoryEventHandler.

[Dan LaRocque]

Hi Matěj,

Which version of Titan are you using?  Did you compile Titan against the HDP 2.2 (Hadoop 2.6.0) jars?  The Titan 0.5.x artifacts are compiled against Apache Hadoop 2.2.0.  I'm not sure that's the root cause, but it may be related.

thanks,
Dan

--
You received this message because you are subscribed to the Google Groups "Aurelius" group.
To unsubscribe from this group and stop receiving emails from it, send an email to aureliusgraph...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/aureliusgraphs/97948354-b071-4b27-93d9-d6142d55de24%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Matěj Holec]

Hi Dan

thank you. You are probably right (here).
I presume, It's possible to compile Titan against the Hadoop 2.6.0. I tried to do it according some you older post (here) but without success; it failed due to dependency enforcement.

May I expect that this command will work?

> mvn clean install -Dhadoop.version=2.6.0 -DskipTests

I'm neither familiar with Java nor with Maven.


Thanks
Matej

PS: I use 0.5.3