[COMMUNITY VOTE] Supporting only Hadoop2 for TP 3.1.0?

[Marko Rodriguez]

Hello everyone,

I decided to make this its own thread as opposed to a discussion off a TP3 Hadoop question from Don Dra(p)e(r).

TinkerPop is not interested in maintaining numerous connectors to various vendors (and their various versions). After TP2, we decided that vendors will maintain their own connectors to TP3. TP3 would only provide 3 "reference implementations" -- TinkerGraph (POJO in-memory OLTP and OLAP), Neo4j (OLTP), and Hadoop (OLAP -- Giraph/Spark).

Currently we only support Hadoop1 in TP3. However, there is good reason to support Hadoop2.

1. SparkServer works inside YARN.

2. All the major Hadoop distributions (Cloudera, Hortonworks, etc.) are using Hadoop2.

3. Hadoop2 is newer than Hadoop1.

I am more than happy to bump TP3 support to Hadoop2, but am not willing to support both Hadoop1 and Hadoop2 (as that means we will then have Giraph1/Giraph2, Spark1/Spark2, etc.). With that, can people reply to this email with:

+1 (please have TP 3.1.0 support Hadoop2)

-1 (please have TP 3.1.0 support Hadoop1) [keep it the same]

If you wish to provide a comment with your +1/-1, please do.

Thanks everyone,

Marko.

http://markorodriguez.com

[Daniel Quest]

+1 we use Hadoop 2 on hortonworks

Dan

Sent from my iPhone

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/DCF97686-3D4B-428B-8A69-C25609FF86D2%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Marko Rodriguez]

The only vote that matters.

http://vignette4.wikia.nocookie.net/jqdb/images/9/97/233px-Jonny.jpg/revision/latest?cb=20091229234924

Marko.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/A022806B-D8AA-4FF9-8C49-DE8B7912B408%40gmail.com.

[Matt Aldridge]

+1

[Don Drake]

+1 Obviously.  First round is on me if this passes. :)

-Don 

[Robert Olive]

+1 (please have TP 3.1.0 support Hadoop2)

On Wednesday, September 9, 2015 at 11:44:46 AM UTC-5, Marko A. Rodriguez wrote:

[Ran Magen]

+1

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/d1f33293-3abe-4286-99f5-01519a7c77c8%40googlegroups.com.

[Matt Frantz]

+1

(revoting on gremlin-users)

[Jason Plurad]

+1
Nice call on putting up for vote.

[Daniel Kuppitz]

-1

...just to add some diversity and because I like Hadoop 1 a lot more (I guess that's because it's easier to set up).

Don't panic +1 voters, I guess we already have a winner.

(silently hoping that this is not a signal for those who were hesitant to vote -1 :))

On Thu, Sep 10, 2015 at 1:10 AM, Jason Plurad <plu...@gmail.com> wrote:

+1
Nice call on putting up for vote.

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/33bbde7e-66b9-4510-a447-d2d1c52f303c%40googlegroups.com.

[Andrew Fitzgerald]

+1

[Alexandre Perrot]

+1

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/CACkx_dCC78c0CPwZZi4-YOR0oY6MDrmUMyTYhLcX5cwRLJo3%2BQ%40mail.gmail.com.

[Jen]

+1

[Webb, Ryan L.]

+1

[Malte Skoruppa]

+1

+1

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/00c8df18-ddff-472e-87f7-fc73656579b5%40googlegroups.com.

[Tim Dunlevy]

+1

On Wednesday, September 9, 2015 at 12:44:46 PM UTC-4, Marko A. Rodriguez wrote:

[Marko Rodriguez]

Hello everyone,

It seems unanimous that people want Hadoop2. Regardless, the VOTE was basically closed in my mind after Danny Quest voted.

http://vignette3.wikia.nocookie.net/p__/images/2/2d/Jonny_quest-show.jpg/revision/latest?cb=20120316162151&path-prefix=protagonist

But whatever… if it makes you feel better that your vote mattered, sure.

TinkerPop3 master/ now supports the following:

Apache Hadoop 2.7.1 (up from 1.2.1)

Apache Giraph 1.1.0 (up from 1.0.0)

Apache Spark 1.5.0 (up from 1.2.1)

There is one integration test failing in Giraph (around sorted MapReduce output) and I haven't written up the docs (need to work with Daniel on this). But all in all, TinkerPop 3.1.0 (when released) will have support for the versions above. I suspect over the remainder of today and tomorrow all the bumps will be sorted out, docs written, and full integration test suite passing.

Thanks for your input Danny Quest (aka. my hero),

Marko.

http://markorodriguez.com

--
You received this message because you are subscribed to the Google Groups "Gremlin-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gremlin-user...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/gremlin-users/b7c1d61a-ca00-4375-b771-f256cd33eab8%40googlegroups.com.