Typical insert speed of janusgraph?

[Alan Wang]

Hi all,

Thank you for reading this.

I am trying to write a large amount of data into janusgraph with cql. The problem I meet was that the create speed was slow, about 300 edges per second. 

The gremlin statement is probably like this:

g.addE('EDGE').from(g.V(id1)).to(g.V(id2)).property('name', name).next()

I've used multithreading in one transaction, it's really faster than a single thread, but it's not particularly obvious.

What is the typical write TPS of janusgraph? Is normal 300 new edges per second?

[Abhay Pandit]

Hi Alan,

I guess 300 edges per second is pretty much good speed with normal ingestion.

Also try scaling elastic & cassandra if that helps to scale more.

Here bulkloader vertex program can also be useful.
With Bulk loader Vertex Program I am able to create 3.8 M vertex in 9 min and 1M edges in 20 min.

Thanks,
Abhay 

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/f2609333-efc4-4b97-9733-a7f3885c3ce1%40googlegroups.com.

[Alan Wang]

Thank you, Abhay. This really helps me a lot.

On Monday, November 4, 2019 at 4:38:54 PM UTC, Abhay Pandit wrote:

Hi Alan,

I guess 300 edges per second is pretty much good speed with normal ingestion.

Also try scaling elastic & cassandra if that helps to scale more.

Here bulkloader vertex program can also be useful.
With Bulk loader Vertex Program I am able to create 3.8 M vertex in 9 min and 1M edges in 20 min.

Thanks,
Abhay 

On Mon, 4 Nov 2019 at 20:24, Alan Wang <alanw...@gmail.com> wrote:

Hi all,

Thank you for reading this.

I am trying to write a large amount of data into janusgraph with cql. The problem I meet was that the create speed was slow, about 300 edges per second. 

The gremlin statement is probably like this:

g.addE('EDGE').from(g.V(id1)).to(g.V(id2)).property('name', name).next()

I've used multithreading in one transaction, it's really faster than a single thread, but it's not particularly obvious.

What is the typical write TPS of janusgraph? Is normal 300 new edges per second?

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to janusgra...@googlegroups.com.