--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/0e3babc4-0e6b-493a-88a9-a0e621dac79e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/CAA-H43-fTvvhKK8soUNkg5wUDfAZHtTnbxyGJSpDDM82HWLuxg%40mail.gmail.com.
g.addV(__newVLabel).property(_prop_name, _prop_value).toList()
What are you intending to compare? When I first read it, it sounded like the tests were comparing Gremlin Server WebSocket Vs. Gremlin Server Script. However, after reading the scripts, it is actually comparing Gremlin Server WebSocket Vs. Gremlin Console script. So maybe you're trying to compare the overhead of Gremlin Server? If so, this is not a good benchmark because it is not a like for like comparison.I'm assuming you're running with implicit schema enabled because I ran your tests and got similar results. The first problem with that is your test is creating unique label and property keys on every call. Thus, on every call janusgraph has to check the schema and create new schema types. Second, the python WebSocket script runs 10 concurrent writers. While they should end up in a single thread pool, it may cause some contention while servicing requests. IMO, I wouldn't consider concurrent writers to the same session as typical behavior. Next, the WebSocket script sometimes generates invalid requests so the server has the extra overhead of dealing with those errors and serializing them back (think: stacktraces).That said, if the schema is created first, the WebSocket requests are sent serially, and the scripts are error-free, Gremlin Server takes only 1.5s on my machine. Gremlin console takes 0.9s.
Robert Dale
On Thu, Jun 22, 2017 at 7:24 PM, Stephen Mallette <spmal...@gmail.com> wrote:
I doubt you'll get complete parity here. Gremlin Server isn't really a bulk loading tool. Look to OLAP and specific tools of graph providers for that. That said, you can probably get faster by not returning a result in add_node_message. doesn't look like you are using it in either script. Change it to:g.addV(__newVLabel).property(\\"$PROPERTY\\",___$PROPERTY).iterate()Also, since you are using scripts, you could also consider issuing the entire script to the server. Send a binding that contains a list of Maps containing the vertex data to load. If that binding is called "data" you could then send a script like:data.each {g.addV(it.label).property('value',it.value).iterate()}Then you kill the use of a session and use the size of "data" to control the commit batch size. That might speed things up too.
On Thu, Jun 22, 2017 at 2:36 PM, Carlos <512.quad...@gmail.com> wrote:
I'm running some benchmarking and I've noticed that there's a huge speed discrepancy between doing thousands of vertex adds through the GremlinServer and through a Groovy script.The Python script is using Websockets, and completes in about ~250 seconds. The Groovy script completes in about ~75 seconds.I'm using the master branch build of JanusGraph (as of today 6/22) with its InMemory database. The gremlin-server.yaml hasn't been edited other than to point to configuration file for the InMemory database.The test is being run on an Ubuntu 14.04 machine with 24GB of RAM and 4 CPUs. Can anyone explain why I'm seeing this discrepancy and maybe something I can do to get GremlinServer to perform up to speed like the Groovy script?Attached are the scripts I've used to test with.
--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/0e3babc4-0e6b-493a-88a9-a0e621dac79e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/7dacc1de-7f5f-41bd-a3ce-e773c2044a65%40googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/CAA-H438aCz5LPaq-o2yYbX9ZthvhSk%2B6R8CScPJAgz%2B2hr1Jfw%40mail.gmail.com.
data.each {
g.addV(it.label).property('value',it.value).iterate()
}
Robert Dale
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/7dacc1de-7f5f-41bd-a3ce-e773c2044a65%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/e8e0f968-69d0-4891-a215-fae897e5433c%40googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/dca1bb06-fe86-4f09-9a9a-9c0934177fd6%40googlegroups.com.