Purpose of ZooKeeper?

19 views
Skip to first unread message

Divya Sai Teja Pamarthi

unread,
Feb 10, 2022, 6:54:14 PMFeb 10
to ClickHouse
Hi,

Can we create Clickhouse cluster without Zookeeper. I would like to just create a clickhouse cluster with persistent volume. 

What am I going to lose if I don't have a Zookeeper. 

Thanks,
Sai Teja

Michael Smitasin

unread,
Feb 11, 2022, 8:51:03 PMFeb 11
to Divya Sai Teja Pamarthi, ClickHouse
Hello Sai Teja,

Indeed, you can run a cluster without ZooKeeper:

"ZooKeeper is not a strict requirement: in some simple cases, you can duplicate the data by writing it into all the replicas from your application code. This approach is not recommended, in this case, ClickHouse won’t be able to guarantee data consistency on all replicas. Thus it becomes the responsibility of your application."


So for example, if you don't use replicas but just use shards, and ingest your data on each node independently, you won't strictly need ZooKeeper. We have a use case for this - our data in ClickHouse is redundant to its original dataset anyway and just provided as a (fast!) convenience, so losing a node wouldn't be critical.

Michael Smitasin
Cyber Security
Information Technology Division
Lawrence Berkeley National Laboratory


--
You received this message because you are subscribed to the Google Groups "ClickHouse" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clickhouse+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clickhouse/6556510b-1821-4630-99f9-4c01ff98f8ffn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages