Securegraph + gremlin installation error

[mohit kaushik]

Hi!

I am using ES-0.90.0 and build the securegraph for the version, followed the procedure copied the req dependencies. but getting this error.





[root@mohit bin]# ./gremlin.sh gremlin-sg.script

         \,,,/
         (o o)
-----oOOo-(_)-oOOo-----
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/Downloads/gremlin-groovy-2.6.0/lib/logback-classic-0.9.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/Downloads/gremlin-groovy-2.6.0/lib/slf4j-log4j12-1.7.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
12:57:51.087 [main] INFO  o.s.a.AccumuloGraphConfiguration - Connecting to accumulo instance [lumify] zookeeper servers [192.168.0.121]
12:57:51.851 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Using elastic search locations: localhost
12:57:51.851 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Default index name: search
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Indices to query: search
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - In Edge Boost: 1.2
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Out Edge Boost: 1.1
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Use edge boost: true
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - index edges: true
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Store source data: false
12:57:51.852 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Auto flush: true
org.securegraph.SecureGraphException: Could not create accumulo graph
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createAccumuloGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:25)
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:14)
    at org.securegraph.blueprints.SecureGraphBlueprintsFactory.open(SecureGraphBlueprintsFactory.java:23)
    at org.securegraph.blueprints.SecureGraphBlueprintsFactory$open.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
    at groovysh_evaluate.run(groovysh_evaluate:51)
    at groovysh_evaluate$run.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:112)
    at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:67)
    at org.codehaus.groovy.tools.shell.Interpreter$evaluate.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
    at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:152)
    at com.tinkerpop.gremlin.groovy.console.Console.initializeShellWithScript(Console.java:87)
    at com.tinkerpop.gremlin.groovy.console.Console.<init>(Console.java:57)
    at com.tinkerpop.gremlin.groovy.console.Console.main(Console.java:102)
Caused by: org.securegraph.SecureGraphException: java.lang.reflect.InvocationTargetException
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:38)
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:14)
    at org.securegraph.GraphConfiguration.createSearchIndex(GraphConfiguration.java:72)
    at org.securegraph.accumulo.AccumuloGraph.create(AccumuloGraph.java:94)
    at org.securegraph.accumulo.AccumuloGraph.create(AccumuloGraph.java:129)
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createAccumuloGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:23)
    ... 20 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:24)
    ... 25 more
Caused by: org.elasticsearch.index.mapper.MapperParsingException: Mapping must have the `type` as the root object
    at org.elasticsearch.index.mapper.DocumentMapperParser.extractMapping(DocumentMapperParser.java:254)
    at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:155)
    at org.elasticsearch.index.mapper.MapperService.parse(MapperService.java:383)
    at org.elasticsearch.index.mapper.MapperService.parse(MapperService.java:379)
    at org.elasticsearch.cluster.metadata.MetaDataMappingService$4.execute(MetaDataMappingService.java:310)
    at org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:229)
    at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:95)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
    at java.lang.Thread.run(Thread.java:662)
Exception in thread "main" org.securegraph.SecureGraphException: Could not create accumulo graph
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createAccumuloGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:25)
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:14)
    at org.securegraph.blueprints.SecureGraphBlueprintsFactory.open(SecureGraphBlueprintsFactory.java:23)
    at org.securegraph.blueprints.SecureGraphBlueprintsFactory$open.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
    at groovysh_evaluate.run(groovysh_evaluate:51)
    at groovysh_evaluate$run.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:112)
    at org.codehaus.groovy.tools.shell.Interpreter.evaluate(Interpreter.groovy:67)
    at org.codehaus.groovy.tools.shell.Interpreter$evaluate.call(Unknown Source)
    at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:42)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
    at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
    at org.codehaus.groovy.tools.shell.Groovysh.execute(Groovysh.groovy:152)
    at com.tinkerpop.gremlin.groovy.console.Console.initializeShellWithScript(Console.java:87)
    at com.tinkerpop.gremlin.groovy.console.Console.<init>(Console.java:57)
    at com.tinkerpop.gremlin.groovy.console.Console.main(Console.java:102)
Caused by: org.securegraph.SecureGraphException: java.lang.reflect.InvocationTargetException
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:38)
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:14)
    at org.securegraph.GraphConfiguration.createSearchIndex(GraphConfiguration.java:72)
    at org.securegraph.accumulo.AccumuloGraph.create(AccumuloGraph.java:94)
    at org.securegraph.accumulo.AccumuloGraph.create(AccumuloGraph.java:129)
    at org.securegraph.accumulo.blueprints.AccumuloSecureGraphBlueprintsGraphFactory.createAccumuloGraph(AccumuloSecureGraphBlueprintsGraphFactory.java:23)
    ... 20 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at org.securegraph.util.ConfigurationUtils.createProvider(ConfigurationUtils.java:24)
    ... 25 more
Caused by: org.elasticsearch.index.mapper.MapperParsingException: Mapping must have the `type` as the root object
    at org.elasticsearch.index.mapper.DocumentMapperParser.extractMapping(DocumentMapperParser.java:254)
    at org.elasticsearch.index.mapper.DocumentMapperParser.parse(DocumentMapperParser.java:155)
    at org.elasticsearch.index.mapper.MapperService.parse(MapperService.java:383)
    at org.elasticsearch.index.mapper.MapperService.parse(MapperService.java:379)
    at org.elasticsearch.cluster.metadata.MetaDataMappingService$4.execute(MetaDataMappingService.java:310)
    at org.elasticsearch.cluster.service.InternalClusterService$2.run(InternalClusterService.java:229)
    at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:95)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
    at java.lang.Thread.run(Thread.java:662)


Anyone, any help?

[mohit kaushik]

one more question was that does securegraph returns max 100 vertices?
I am facing the problem,

[mohit kaushik]

I also built Securegraph with Elasticsearch-1.1.2  and Elasticsearch is up but it says no node available

[root@mohit bin]# ./gremlin.sh gremlin-sg.script

         \,,,/
         (o o)
-----oOOo-(_)-oOOo-----
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/Downloads/gremlin-groovy-2.6.0/lib/logback-classic-0.9.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/Downloads/gremlin-groovy-2.6.0/lib/slf4j-log4j12-1.7.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

15:02:12.203 [main] INFO  o.s.a.AccumuloGraphConfiguration - Connecting to accumulo instance [lumify] zookeeper servers [192.168.0.121]
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Using elastic search locations: localhost
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Default index name: sg
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Indices to query: sg
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - In Edge Boost: 1.2
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Out Edge Boost: 1.1
15:02:12.983 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Use edge boost: true
15:02:12.984 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - index edges: true
15:02:12.984 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Store source data: false
15:02:12.984 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Auto flush: true

Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: No node available
    at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:219)
    at org.elasticsearch.client.transport.support.InternalTransportIndicesAdminClient.execute(InternalTransportIndicesAdminClient.java:85)
    at org.elasticsearch.client.support.AbstractIndicesAdminClient.exists(AbstractIndicesAdminClient.java:164)
    at org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsRequestBuilder.doExecute(IndicesExistsRequestBuilder.java:54)
    at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:85)
    at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:59)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndexBase.ensureIndexCreatedAndInitialized(ElasticSearchSearchIndexBase.java:211)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndexBase.<init>(ElasticSearchSearchIndexBase.java:109)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndex.<init>(ElasticSearchSearchIndex.java:27)
    ... 30 more

Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: No node available
    at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:219)
    at org.elasticsearch.client.transport.support.InternalTransportIndicesAdminClient.execute(InternalTransportIndicesAdminClient.java:85)
    at org.elasticsearch.client.support.AbstractIndicesAdminClient.exists(AbstractIndicesAdminClient.java:164)
    at org.elasticsearch.action.admin.indices.exists.indices.IndicesExistsRequestBuilder.doExecute(IndicesExistsRequestBuilder.java:54)
    at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:85)
    at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:59)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndexBase.ensureIndexCreatedAndInitialized(ElasticSearchSearchIndexBase.java:211)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndexBase.<init>(ElasticSearchSearchIndexBase.java:109)
    at org.securegraph.elasticsearch.ElasticSearchSearchIndex.<init>(ElasticSearchSearchIndex.java:27)
    ... 30 more



Any suggestions plz

[Joe Ferner]

I just verified the gremlin docs (https://github.com/lumifyio/securegraph/blob/master/securegraph-blueprints/README.md). I had to update a couple of the versions in the dependency list. I would be curious if that's the problem.

[mohit kaushik]

Hi Joe,

Thanks, but i have tried with the compatible versions of jars accoeding to the versions of accumulo-1.6.0 and ES-1.1.2 and that produced above exceptions.
and one more thing isthat  securegraph uses ES-1.1.2 and dependency list says ES 1.2.0, plz have a look.

-Mohit

[mohit kaushik]

And joe another strange problem that i am facing with securegraph is that it is not returning more than 100 elements.
any help or hint would work...

Thanks

[Joe Ferner]

You can try setting "storage.graph.search.clusterName" to the name of your ES cluster. Is your ES cluster running on the default ports and are they open?

Queries by default only return 100 elements (https://github.com/lumifyio/securegraph/blob/e9276caf3f9d2b073081ce49c37a18f25861d08d/securegraph-core/src/main/java/org/securegraph/query/QueryBase.java#L121). You can either set this limit at query time or page the results. I also created an issue (https://github.com/lumifyio/securegraph/issues/25) to make the limit configurable.

[mohit kaushik]

Joe, I have set the storage.graph.search.clusterName in gremlin-sg-accumulo.config but still gives the error...

root@mohit bin]# ./gremlin.sh gremlin-sg.script

         \,,,/
         (o o)
-----oOOo-(_)-oOOo-----
SLF4J: Class path contains multiple SLF4J bindings.

SLF4J: Found binding in [jar:file:/root/Documents/gremlin-groovy-2.6.0/lib/logback-classic-0.9.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/Documents/gremlin-groovy-2.6.0/lib/slf4j-log4j12-1.7.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]

SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

14:01:28.635 [main] INFO  o.s.a.AccumuloGraphConfiguration - Connecting to accumulo instance [lumify] zookeeper servers [192.168.0.121]
14:01:29.386 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Using elastic search locations: 192.168.0.121
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Default index name: sg
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Indices to query: sg
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - In Edge Boost: 1.2
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Out Edge Boost: 1.1
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Use edge boost: true
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - index edges: true
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Store source data: false
14:01:29.387 [main] INFO  o.s.e.ElasticSearchSearchIndexBase - Auto flush: true

and my ES node is running on default ports
tcp        0      0 :::9200                     :::*                        LISTEN      5688/java      
tcp        0      0 :::9300                     :::*                        LISTEN      5688/java        



Thanks

[Joe Ferner]

It looks like ES is listening on IPv6 address. Not sure if this is a problem but I would definitely try disabling IPv6 first to see if it fixes the problem.