Tinkerpop3 on GraphX

[Kushal Datta]

Hi,

A few of us in the GraphX community are looking at bindings for Tinkerpop3.
The idea was to execute Gremlin traversals in a distributed fashion, but use GraphX operators instead of Giraph.

At the same time, in the Apache Incubator project I found that one of the items is to deliver Tinkerpop3 over Spark.
Are we talking about the same thing? If so, is there a way a JIRA ticket for this that I can refer to?

Thanks,
-Kushal.

[Marko Rodriguez]

Hello Kushal,

A few of us in the GraphX community are looking at bindings for Tinkerpop3.
The idea was to execute Gremlin traversals in a distributed fashion, but use GraphX operators instead of Giraph.

Sounds like a good thing to do.

At the same time, in the Apache Incubator project I found that one of the items is to deliver Tinkerpop3 over Spark.

Yea, I think the Spark guys having something on that:

https://issues.apache.org/jira/browse/SPARK-4279

Are we talking about the same thing? If so, is there a way a JIRA ticket for this that I can refer to?

I haven't done anything with Spark/GraphX, but am willing to help on the TinkerPop-side with anyone wanting to dive into an implementation.

Thanks Kushal,

Marko.

http://markorodriguez.com

[Kushal Datta]

Thanks Marko. My intuition is that the side-effects in chains of Gremlin traversals which are currently executed using map-reduce can be faster in Spark. I am interested in this work, but will need help with the implementation. But before jumping into it, I think sharing a design document is a better idea.

@Nick - thanks for sharing the code. If interested, you can also see my initial work at https://github.com/kdatta/tinkerpop3/tree/graphx-gremlin

Best,
-Kushal.

[Marko Rodriguez]

Hi Kushal,

Lets move this conversation over to d...@tinkerpop.incubator.apache.org (cc:d) and discuss matters there.

Stoked,

Marko.

http://markorodriguez.com

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/5386fc90-d9dd-492b-9c9f-921168c623b1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Georg Heiler]

What is the current status of graphX or graphframes integration?

http://markorodriguez.com

To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-users+unsubscribe@googlegroups.com.