Proposal

[kishore g]

Hello,

I want to run an idea by you of using Helix http://helix.incubator.apache.org/ for cluster management in elastic search. It provides the basic functionality that is added by elasticsearch-zookeeper but provides many more features that are very helpful in managing shards and replicas and operating the cluster. 

Let me know if this is something that might be useful. I would be happy to provide more details on the project

thanks,

Kishore G

[Lee Hinman]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I've been thinking about this, however, I'm not sure it would make
sense to have a plugin manage the shards and replicas for a cluster,
given that Elasticsearch does a lot of different things when managing
them (node tag routing, the weight routing added in the latest
version, etc).

However, that doesn't mean someone might not want to, if you so
desire, you could start a new elasticsearch-helix project based off of
es-zookeeper using Helix, but for us, it's probably out of scope.

;; Lee Hinman


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQIcBAEBAgAGBQJRLN7XAAoJEJ1kZdQ6zsrg/gQQAIclXGhOTaPlElYog5P97Pyx
XuTQXEg6iuHJAa2KMMQy8yEP1GsHizZ5xN8m8rdO47WFJQly4G6IirIeLzsKIxzg
RIX4BcNB+8tU3DW8IzYyc8LbVAtX1Zl/G9nHoHYEjlTdJbbVApel3tvirffYRMfB
gcnw1lYCnmIHCw+t+yOp+aZh/HvHK5hlpEpCSdxTiOuJv5nMq8Phtd6AsEqyXe+m
mtyKVUw85Uj08MBnebfwelLBJsiMeQ1iljP2ch1w04c1Rr+54GgAqNikNiPGc125
TA8idDb/Tr6hVMsdOeIxh4fimvR6YIpzNzXu6vS2LeNAcZKP5L+qhOXIMdyAjP2N
8hNoxAAExfEYzFeZb/5p9+7I38Y5Ur6Pbsk3DCf6D16RHJWk5OX3heHT/er2j8zP
qqRNNaJcnA3ZAUXt7oqF21SGlKKKjsQ0YgeyLpy8tnfQSeUuW5+f1ZWP5wzDtHAg
WPLCPJimpqMB8cjDRnNorNiRe4zo5l0vPi/ALhV4e1et9r0a5iKL6chbifKDJxnF
/Li9JdQ+R25Gud4xhD5rWaCKE6aYvVEO3EHH742Np51Y0h5uImKE9Kfp4lGX81GL
w3srX6LbkQHmEgiSI7/T7KZDtTwGWpFSDDw+JVqhxVPPKlGiufmr5TW8G+D2/+Gg
v1gn2ZPqtFitN3VAQFTA
=nB8r
-----END PGP SIGNATURE-----

[kishore g]

Thanks Lee for taking time to look into it and appreciate the feedback. Node tagging is something that Helix supports. Not sure what weight routing means. Helix provides the routing table to the application, using which load balancer will know where are the partitions hosted and in what state. It also provides the configuration about the node like node.data http.enabled etc as mentioned here.

http://www.elasticsearch.org/guide/reference/modules/node.html

Based on the info provide the routing layer can make the decision of where to send the request.

Thanks again for taking time to look into Helix.

Thanks,

Kishore G

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch-zookeeper" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch-zookeeper/Eznx0T8epNw/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to elasticsearch-zoo...@googlegroups.com.
To post to this group, send email to elasticsear...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.