Using Hadoop-gremlin (3.2.4, or 3.3.0-SNAPSHOT) with CDH 5.10 (Hadoop 2.6.0)

[Dan Ståby]

Hi,

I am trying to get Gremlin-console and Hadoop-Gremlin to work with my Cloudera CDH 5.10 installation, but am having issues with getting hdfs to setup properly:

INFO  org.apache.tinkerpop.gremlin.hadoop.structure.HadoopGraph  - HADOOP_GREMLIN_LIBS is set to: /home/user/tinkerpop/tinkerpop/spark-gremlin/target/spark-gremlin-3.3.0-SNAPSHOT-standalone/lib

WARN  org.apache.hadoop.util.NativeCodeLoader  - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

plugin activated: tinkerpop.hadoop

plugin activated: tinkerpop.spark

plugin activated: tinkerpop.tinkergraph

gremlin> hdfs

==>storage[org.apache.hadoop.fs.LocalFileSystem@7a360554]

-> echo $HADOOP_CONF_DIR

/etc/hadoop/conf

-> echo $HADOOP_HOME

/usr/lib/hadoop

Is there a way to get more verbose information regarding why Gremlin fails to detect Hadoop properly? I am able to use the Hadoop and hdfs commands from the same shell where I started the Gremlin process. I get this issue both with the released 3.2.4 binaries, and with the latest 3.3.3-SNAPSHOT with hadoop.version changed to 2.6.0 in pom.xml. 

Does anyone have any experience with running Gremlin-client on CDH 5?

Best Regards,

Dan Ståby

[Jason Plurad]

You need to put $HADOOP_CONF_DIR on the $CLASSPATH.

export CLASSPATH=$CLASSPATH:$HADOOP_CONF_DIR

See the Hadoop-Gremlin docs http://tinkerpop.apache.org/docs/current/reference/#_installing_hadoop_gremlin

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/748dfd3c-5837-477b-b63b-b837eef5682b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Dan Ståby]

Thank you for your help! Mystery solved. Now it works! :)

Regards,

Dan