Is there any document about running distributedlog in a cluster

44 views
Skip to first unread message

Yumei

unread,
May 13, 2016, 1:01:00 AM5/13/16
to distributedlog-user
Hello distributedlogger:

It seems that "Deployment & Administration" is not complete. Any plans on filling this up?
It would be good the share example configuration and scripts on how to run this. 

Lucas Bradstreet (Onyx)

unread,
May 13, 2016, 1:31:21 AM5/13/16
to distributedlog-user
Out of curiosity, in particular interested in the production zookeeper configuration. 

I found lots of people had similar concerns on using zookeeper: https://news.ycombinator.com/item?id=11669047

wondering how does Twitter manage this...

- Lucas (Onyx)

Khurrum Nasim

unread,
May 13, 2016, 1:50:40 AM5/13/16
to distributedlog-user
+1 

Also it seems that DistributedLog uses BookKeeper, and BookKeeper uses ZooKeeper ... so many moving pieces. do they run as separated services, like in containers?

knasim

Jon Derrick

unread,
May 13, 2016, 2:13:05 AM5/13/16
to distributedlog-user
Interested in:

* How does a typical bookkeeper configuration look like? (there is no example to find in google search ..)
* What type of machines are used for bookkeeper and zookeeper (e.g. cpu, memory, network)? do you use RAID? Kafka recommends to use RAID.. Did you tune any os parameters?
* Do you guys tune OS page cache for performance? If so, how?

- jderrick

On Thursday, May 12, 2016 at 10:01:00 PM UTC-7, Yumei wrote:

Jon Derrick

unread,
May 13, 2016, 2:31:26 AM5/13/16
to distributedlog-user
One more:

* What are your settings on zookeeper session timeout? How to tune it?

- jderrick

Jia Zhai

unread,
May 13, 2016, 6:47:11 AM5/13/16
to distributedlog-user
They run as services, which could be separated,  zookeeper provides services to bookkeeper, bookkeeper provides services to DistributedLog.
Zookeeper provides reliable distributed coordination between Bookies;
And for DistibutedLog, Bookkeeper provides a replicated log service.

Sijie Guo

unread,
May 14, 2016, 2:58:31 AM5/14/16
to Jia Zhai, distributedlog-user
Thanks all.
We will try to complete the 'Deployment and Administration' section soon.

- Sijie

--
You received this message because you are subscribed to the Google Groups "distributedlog-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to distributedlog-...@googlegroups.com.
To post to this group, send email to distribut...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/distributedlog-user/018e84d2-2cc3-4d6e-abe8-758450b58433%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Sijie Guo

unread,
Jun 2, 2016, 3:08:55 AM6/2/16
to Jia Zhai, distributedlog-user
FYI. I updated the site. The "Cluster Setup and Deployment" section is available now.

http://distributedlog.io/operations/deployment.html

- Sijie
Reply all
Reply to author
Forward
0 new messages