Publish/Subscribe API for Voldemort

[Gomathivinayagam Muthuvinayagam]

I am interested in doing the publish/subscribe api (https://github.com/voldemort/voldemort/wiki/fun-projects).

Is someone working on that already? I dont see any progress in that area.

[Arunachalam]

We are not aware of anyone looking into it except you. This is a very tricky topic and we have some rough ideas on how to do this. Can you first write a proposal on how you want to solve this problem ? This is a very tricky topic and there are several trade offs so a proposal (Goal, Non-Goal, high level design) would be a good starting point. 

PS : We have some ideas of how to approach this problem, but we don't want to pollute your thought process :)

Thanks,

Arun.

On Fri, Jun 20, 2014 at 5:55 AM, Gomathivinayagam Muthuvinayagam <sanka...@gmail.com> wrote:

I am interested in doing the publish/subscribe api (https://github.com/voldemort/voldemort/wiki/fun-projects).

Is someone working on that already? I dont see any progress in that area.

--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.

[Gomathivinayagam Muthuvinayagam]

Sorry for the late reply. I have few high level questions before preparing the document.

1) For publish/subscribe api, do we want to maintain all list of changes happened to the keys?. For example k1, is updated with value a, and then b, and then c. The current state is k1 -> d. A observer has observed the state as k1 -> a. Is the system expected to publish changes continuously to the observer? like k1->b, k1->c, and k1->d. 

If I use merkle tree, I can make sure the observer that he will not miss the changes, but he will not able to get all the transitions that happened to the key. 

2) This project lists, using the publish/subscribe api, voldemort nodes can synch up with each other. Is it a necessary thing, or just an additional feature of publish/subscribe api?

Thanks, 

[Gomathivinayagam Muthuvinayagam]

Hi,

I am working on implementing merkle tree support(may be unrelated to the fun project mentioned on voldemort projects section) for Voldemort, initial version is available here (https://github.com/gomathi/voldemort/tree/hash-tree). I have few questions, and I am trying to ask the questions on irc, is there any specific time I can join irc to ask the questions? I tried to contact few people on the irc#voldemort kotk, stotch and tris. I did not get any response. If you have any suggestions, please let me know. Thanks.