State of the Intergalactic Union on TinkerPop and Its Federated Developers and Users

[Marko Rodriguez]

Hello,

I was typing away for the October2015 Podling status update and Stephen ping'd me and was like "TinkerPop doesn't have to do one this month." I had written up a nice report so I decided to share the contents with everyone as I think what we have done (and are doing) is quite impressive.

------------

TinkerPop's adoption is growing. Nearly every popular graph system vendor is "TinkerPop enabled." Interestingly enough, even RDF graph systems (historically in another area of graph computing) are starting to provide TinkerPop connectivity. I had breakfast with Kendall Clark (in Santa Fe of all places) on Sunday and he was talking about Stardog's TP3 integration and it is impressive what they are doing with TinkerPop for Stardog4 (being released this week). I will be helping them on a blog post about Stardog4+TinkerPop3.

* Neo4j

* OrientDB

* Stardog (RDF)

* Titan

* Blazegraph (RDF)

* IBM BlueMix Graph

* Sqlg

* Apache Spark

* Apache Giraph

* Apache Hadoop

Furthermore, there are many graph systems that are still TinkerPop2-enabled in the process of migrating to TinkerPop3.

Amazon (the providers of DynamoDB) just announced Titan integration for DynamoDB and that supports TinkerPop2. With Titan 1.0 just released, we will see Amazon supporting TinkerPop3. As a cloud service provider that enables a "flip of the switch" to get a DynamoDB cluster up and running, there will be lots of Tinker-and-Popping on AWS.

http://www.allthingsdistributed.com/2015/08/titan-graphdb-integration-in-dynamodb.html

https://aws.amazon.com/blogs/aws/new-store-and-process-graph-data-using-the-dynamodb-storage-backend-for-titan/

DataStax (the commercial providers of Apache Cassandra) just announced that they will be providing a graph system called DSEGraph whose sole interface will be TinkerPop3. They are committed to Apache TinkerPop and are banking on it for the graph aspect of their business.

http://www.slideshare.net/kromerm/datastax-cassandra-summit-2015-the-datastax-vision-for-a-multimodel-data-platform/8

http://www.zdnet.com/article/microsoft-and-datastax-tie-up-cassandra-on-azure-deal-as-new-titan-graph-database-rolls-out/

With the recent publication of two articles on the "Gremlin virtual machine" we hope to see a growth in the number of languages that compile to Gremlin.

http://www.datastax.com/dev/blog/the-benefits-of-the-gremlin-graph-traversal-machine

http://arxiv.org/abs/1508.03843

Right now, there exists SPARQL-Gremlin (proof-of-concept) which really helps to blur the distinction between the RDF and Property Graph worlds, thus expanding TinkerPop into another area of developers, consumers, promoters, and the like.

https://github.com/dkuppitz/sparql-gremlin

When I was at Cassandra Summit last week, I spoke with Ted Wilmes who used Apache Calcite to compile SQL to TinkerPop2. He has some initial plans to use Apache Calcite to compiled SQL to Gremlin3 and thus, we may be opening the doors to the entire SQL world to use graph technology for both OLTP and OLAP graph processing. That could be huge.

http://www.slideshare.net/twilmes/modeling-the-iot-with-titandb-and-cassandra

I've stated that I would like to see SPARQL-Gremlin or SQL-Gremlin ultimately as a 3rd reference language implementation merged into TinkerPop3. As such, I'm keeping a close eye on both projects to see how they evolve and see where we can help take them.

There have been 3 TinkerPop3-focused conference presentations recently:

1. NoSQL Now: http://www.slideshare.net/slidarko/the-gremlin-traversal-language

2. Cassandra Summit: http://www.slideshare.net/StephenMallette/tinkerpopfinal

3. Keynote at ACM Database Programming Languages: http://2015.splashcon.org/event/dbpl2015-dbpl-keynote-gremlin-a-stream-based-functional-language-for-oltp-and-olap-graph-computing

Look at #3 above. Gremlin is the keynote at an ACM conference. This means that the academic community is realizing the benefits of TinkerPop not only from a "we can build stuff"-perspective (as we get in industry) but from a "that is a theoretically trippy concept"-perspective (as we get in academia). I have a new article I am working on for an upcoming conference that will hopefully get us tapped into another space of academics (beyond "just graphs."). The ideas in the upcoming article will be presented at GraphDay (January of 2016). I plan to demonstrate what I believe to be the craziest concept to hit the graph space yet.

http://graphday.com/

It will fry brains…be there or be normal.

And that, my fellow TinkerPoppers, is my interpretation of the major accomplishments of our work here at Apache TinkerPop.

http://www.datastax.com/dev/blog/tales-from-the-tinkerpop

The future looks bright for TinkerPop with 3.0.2 and 3.1.0 releases coming over the remainder of this year.

Take care,

Marko.

http://markorodriguez.com

[Dylan Millikin]

This is all very inspiring! Looking forward to the future.

Quick question regarding OrientDB, I see them in the list but is there current support or are they still working on it ? (as has been discussed in some other threads)

[Marko Rodriguez]

Hi Dylan,

Michael Pollmeier (of Gremlin-Scala fame) has OrientDB working with TinkerPop3.

https://github.com/mpollmeier/orientdb-gremlin (and I just realized its a "proof of concept" -- dah. Sorry for the confusion)

I know Luca (OrientDB  lead) wants to transition to TinkerPop3, but can't just "cut the cord" so fast given its customers. Perhaps Luca can share more on that? 

Finally, I totally forgot to mention all the client libraries that have been developed by the wider ecosystem that are TinkerPop3 enabled. Check out the homepage under "Libraries."

http://tinkerpop.incubator.apache.org/

Insane….

Thanks Dylan,

Marko.

http://markorodriguez.com

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/CAK-m_Kwi2HB009fEQuweq84piwoSoGXWG5Jwd1gHvhyyeq0_gg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Stephen Mallette]

Luca might chime in and correct me with revised information but last I'd heard, we should expect to see an official release of OrientDB with TP3 support around the end of year for OrientDB 3.0.  I seem to remember that Michael Pollmeier had a basic implementation working though - not sure where that is or how it fits in with Luca's official work at this point.

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

[Dylan Millikin]

Thanks for the info guys!

[Alexander Patrikalakis]

We just released support for the Titan 1.0.0 and TP3 in the Amazon DynamoDB Storage Backend for Titan!

https://github.com/awslabs/dynamodb-titan-storage-backend

Cheers,

Alex

[Stephen Mallette]

Thanks for the update Alexander.  Now that the Amazon implementation is on TP3 officially, I guess we can add it to the TinkerPop home page. Very cool!

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/ccca58ea-5754-4549-aaff-c8379dc1e1a6%40googlegroups.com.