Project status

985 views
Skip to first unread message

Robin Verlangen

unread,
Feb 14, 2014, 12:55:47 AM2/14/14
to elasticsear...@googlegroups.com
Hi there,

Could anyone update me on the project status for ES zookeeper? Is it still being maintained for newer versions (e.g. 0.90.xx and 1.0.0)?

Thanks!

- Robin

Matt Wise

unread,
Feb 14, 2014, 11:56:28 AM2/14/14
to elasticsear...@googlegroups.com
It would really be great if the ElasticSearch team would take over this plugin and keep it updated. We use this plugin at Nextdoor and it forces us to stay a few revisions behind on ES to ensure plugin compatibility.

Matt Wise
Sr. Systems Architect
Nextdoor.com


--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zoo...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch-zookeeper/299efcb5-85cf-4d98-957a-c0c7849b6611%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Robin Verlangen

unread,
Feb 17, 2014, 3:37:56 AM2/17/14
to elasticsear...@googlegroups.com
Hi Matt,

Same feelings here. It would definitely make ES more stable in noisy environments like AWS or other Cloud providers.

Best regards, 

Robin Verlangen
Chief Data Architect




Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies.


Igor Motov

unread,
Mar 13, 2014, 10:01:04 PM3/13/14
to elasticsear...@googlegroups.com
First of all I need to mention that there is now a good alternative to the zookeeper plugin. Many users of elasticsearch are using dedicated masters setup, which is not more complex than zookeeper setup but provides pretty reliable system. So, I would say it's a good solution definitely worth considering. But, if you still prefer to use zookeeper, I just want to let you know that I have updated my private repo (https://github.com/imotov/elasticsearch-zookeeper) to work with elasticsearch 0.90.12 and 1.0.1. I don't like forks, but since I am no longer with Sonian and I am not sure who is going to maintain zookeeper there, a fork will probably have to do for now until we find a better solution. 

Igor


On Monday, February 17, 2014 3:37:56 AM UTC-5, Robin Verlangen wrote:
Hi Matt,

Same feelings here. It would definitely make ES more stable in noisy environments like AWS or other Cloud providers.

Best regards, 

Robin Verlangen
Chief Data Architect




Disclaimer: The information contained in this message and attachments is intended solely for the attention and use of the named addressee and may be confidential. If you are not the intended recipient, you are reminded that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies.


On Fri, Feb 14, 2014 at 5:56 PM, Matt Wise <ma...@nextdoor.com> wrote:
It would really be great if the ElasticSearch team would take over this plugin and keep it updated. We use this plugin at Nextdoor and it forces us to stay a few revisions behind on ES to ensure plugin compatibility.

Matt Wise
Sr. Systems Architect
Nextdoor.com
On Thu, Feb 13, 2014 at 9:55 PM, Robin Verlangen <ro...@us2.nl> wrote:
Hi there,

Could anyone update me on the project status for ES zookeeper? Is it still being maintained for newer versions (e.g. 0.90.xx and 1.0.0)?

Thanks!

- Robin

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsub...@googlegroups.com.

To post to this group, send email to elasticsear...@googlegroups.com.

Matt Wise

unread,
Mar 13, 2014, 10:34:08 PM3/13/14
to elasticsear...@googlegroups.com
Igor,
  Excellent to hear back from you on this issue! I actually forked the elasticsearch-zookeeper repo so that we could try to take over doing some work on it and getting it running. I may just pull your changes into our repo and see how it works. If its not difficult in an ongoing basis, we may continue to provide some updates.

  On a side note, where are you at now?

Matt Wise
Sr. Systems Architect
Nextdoor.com


To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zoo...@googlegroups.com.

To post to this group, send email to elasticsear...@googlegroups.com.

Igor Motov

unread,
Mar 13, 2014, 11:00:21 PM3/13/14
to elasticsear...@googlegroups.com
Matt, 

I am at Elasticsearch.

To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsubscr...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsubscr...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsub...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.

Matt Wise

unread,
Mar 14, 2014, 12:38:48 AM3/14/14
to elasticsear...@googlegroups.com
I havn't done any work to debug this ... but the initial unit tests fail from your branch: https://travis-ci.org/diranged/elasticsearch-zookeeper/jobs/20738580

Matt Wise
Sr. Systems Architect
Nextdoor.com


Igor Motov

unread,
Mar 14, 2014, 12:48:58 AM3/14/14
to elasticsear...@googlegroups.com
Try running build on 1.0 or 0.90 branch. Master is based on 1.1, which is not released yet. So, it uses snapshot 1.1.0-SNAPSHOT, which is not available from any repository: 

[ERROR] Failed to execute goal on project elasticsearch-zookeeper: Could not resolve dependencies for project com.sonian:elasticsearch-zookeeper:jar:1.1.0-SNAPSHOT: Could not find artifact org.elasticsearch:elasticsearch:jar:1.1.0-SNAPSHOT in sonatype-snapshots (https://oss.sonatype.org/content/repositories/snapshots/) -> [Help 1]
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsubscr...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsubscr...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsub...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.

Matt Wise

unread,
Mar 14, 2014, 11:01:47 AM3/14/14
to elasticsear...@googlegroups.com
Ah you're right, I merged in those branches to our repo and it looks good: 


We'll be testing this code ASAP. Thank you.

In the long term, what do you think the likelihood of the ElasticSearch team taking ownership of the plugin is? Its highly valuable. We're a big Zookeeper shop here and we've been using this in multiple ElasticSearch farms for almost 2 years now in live production.

Matt Wise
Sr. Systems Architect
Nextdoor.com


To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zoo...@googlegroups.com.

To post to this group, send email to elasticsear...@googlegroups.com.

Igor Motov

unread,
Mar 14, 2014, 4:31:14 PM3/14/14
to elasticsear...@googlegroups.com
I would day it's unlikely to happen in the foreseeable future. 

--
You received this message because you are subscribed to the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zookeeper+unsub...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.

Mike Deeks

unread,
Mar 31, 2014, 11:27:04 PM3/31/14
to elasticsear...@googlegroups.com
Huge thanks for this Igor! I just tested this on my local instance and it worked on the first try with ES 1.0.0. We are rolling out many ES clusters in our prod environment and this will integrate nicely with our existing ZK cluster. We're mostly a java house here so we might be able to contribute back (time permitting) if you don't mind maintaining the fork.

P.S. Also Hi Matt :) I interviewed with you about 6 months ago. Small world.

Matt Wise

unread,
Apr 1, 2014, 10:28:39 PM4/1/14
to elasticsear...@googlegroups.com
Mike,
  :) Small world indeed. Hope things are going well for you at the new place -- but if they aren't, send me an email! :)

Igor,
  Who would we need to petition over at ElasticSearch to vote for priority on this plugin? Its incredibly useful, and makes our clusters super flexible running in the cloud. I'd be happy to give Kevin a hard time, if he's opposed to making this a fully supported plugin. ElasticSearch+Zookeeper = one of our most reliable and easily scaled services in the cloud.

Matt Wise
Sr. Systems Architect
Nextdoor.com


To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch-zoo...@googlegroups.com.

To post to this group, send email to elasticsear...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages