Zookeeper no node exception

[Kirill Solokhov]

Hi Everyone, periodically I see this message in logs:

2016.09.11 20:20:03.861 [ 1 ] <Error> Application: DB::Exception: Cannot create table from metadata file /opt/clickhouse/metadata/default//browser_traffic.sql, error: zkutil::KeeperException: no node, path: /c

lickhouse/tables/02/browser_traffic/replicas/ch1.myhost.com/parts, stack trace:

0. clickhouse-server(StackTrace::StackTrace()+0xe) [0xfd921e]

1. clickhouse-server(DB::Exception::Exception(std::string const&, int)+0x1e) [0xf9cbae]

2. clickhouse-server(zkutil::KeeperException::KeeperException(int, std::string const&)+0x6c) [0x10d8dec]

3. clickhouse-server(zkutil::check(int, std::string)+0x31) [0x2a408c1]

4. clickhouse-server(zkutil::ZooKeeper::getChildren(std::string const&, Stat*, std::shared_ptr<Poco::Event>)+0x6a) [0x2a431fa]

5. clickhouse-server(DB::StorageReplicatedMergeTree::checkParts(bool)+0x96) [0x10c11b6]

6. clickhouse-server(DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(std::string const&, std::string const&, bool, std::string const&, std::string const&, std::string const&, std::shared_ptr<DB::Nam

esAndTypesList>, DB::NamesAndTypesList const&, DB::NamesAndTypesList const&, std::unordered_map<std::string, DB::ColumnDefault, std::hash<std::string>, std::equal_to<std::string>, std::allocator<std::pair<std:

:string const, DB::ColumnDefault> > > const&, DB::Context&, std::shared_ptr<DB::IAST>&, std::string const&, std::shared_ptr<DB::IAST> const&, unsigned long, DB::MergeTreeData::MergingParams const&, bool, DB::M

ergeTreeSettings const&)+0x136b) [0x10ca7bb]

7. clickhouse-server(DB::StorageReplicatedMergeTree::create(std::string const&, std::string const&, bool, std::string const&, std::string const&, std::string const&, std::shared_ptr<DB::NamesAndTypesList>, DB:

:NamesAndTypesList const&, DB::NamesAndTypesList const&, std::unordered_map<std::string, DB::ColumnDefault, std::hash<std::string>, std::equal_to<std::string>, std::allocator<std::pair<std::string const, DB::C

olumnDefault> > > const&, DB::Context&, std::shared_ptr<DB::IAST>&, std::string const&, std::shared_ptr<DB::IAST> const&, unsigned long, DB::MergeTreeData::MergingParams const&, bool, DB::MergeTreeSettings con

st&)+0xc2) [0x10cb9c2]

8. clickhouse-server(DB::StorageFactory::get(std::string const&, std::string const&, std::string const&, std::string const&, DB::Context&, DB::Context&, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::NamesAnd

TypesList>, DB::NamesAndTypesList const&, DB::NamesAndTypesList const&, std::unordered_map<std::string, DB::ColumnDefault, std::hash<std::string>, std::equal_to<std::string>, std::allocator<std::pair<std::stri

ng const, DB::ColumnDefault> > > const&, bool, bool) const+0x39a5) [0x23e7375]

9. clickhouse-server(DB::createTableFromDefinition(std::string const&, std::string const&, std::string const&, DB::Context&, bool, std::string const&)+0x19e) [0x23b2e3e]

10. clickhouse-server() [0x23b0b69]

11. clickhouse-server() [0x23b159c]

12. clickhouse-server() [0x23b1884]

13. clickhouse-server(ThreadPool::worker()+0x1ac) [0xfe3d3c]

14. clickhouse-server(execute_native_thread_routine+0x20) [0x32a53c0]

15. /lib/x86_64-linux-gnu/libpthread.so.0(+0x8184) [0x7ff076411184]

16. /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7ff075a2c37d]

And after that server stops to responding on http interface, with this lines in log:

2016.09.11 20:20:03.861 [ 1 ] <Information> Application: shutting down

2016.09.11 20:20:03.861 [ 1 ] <Debug> Application: Uninitializing subsystem: Logging Subsystem

2016.09.11 20:20:03.861 [ 1 ] <Information> ~ZooKeeper: Closing ZooKeeper session

2016.09.11 20:20:03.861 [ 1 ] <Information> ~ZooKeeper: Removing 0 watches

2016.09.11 20:20:03.861 [ 1 ] <Information> ~ZooKeeper: Removed watches

2016.09.11 20:21:22.372 [ 1 ] <Information> : Starting daemon with revision 54010

2016.09.11 20:21:22.380 [ 1 ] <Information> Application: starting up

What can cause this problem?

[Kirill Solokhov]

Blame on me, the problem was solved (cluster.xml misconfiguration).

[Fatih Kaya]

Hi Kirill, do you remember your mistake? Currently I am getting the same error.

12 Eylül 2016 Pazartesi 20:41:37 UTC+3 tarihinde Kirill Solokhov yazdı:

[sunil sunny]

Hey Krill,

I am facing problems in replication.could you please help me.

I am able to create replicated tables in one of the engine..BUt they are not rplicating in the other server.