DB::Exception: Suspiciously many broken parts to remove

[Alexey Degtyarev]

Hello!

At some point of time found clickhouse-server continuously trying to start but failing to do so with error:

2017.04.19 09:57:26.320042 [ 1 ] <Error> Application: DB::Exception: Cannot create table from metadata file /srv/clickhouse/metadata/test//hits.sql, error: DB::Exception: Suspiciously many (24) broken parts to remove.

The full error log: http://termbin.com/6qjv

What could cause that error and how to fix it and/or avoid in future?

Using Linux 4.4.0-70 generic

ClickHouse server version 1.1.54189

$ grep /srv /proc/mounts

/dev/xvdb /srv xfs rw,relatime,attr2,inode64,noquota 0 0

[Alex Zatelepin]

Hi!

This can happen if the host server restarted uncleanly (because recent data parts have not yet fully synced to disk at the moment of restart). Recently inserted data may have been lost. Consider using replication (https://clickhouse.yandex/reference_en.html#Data%20replication) to ensure data safety.

To start the server anyway, execute the command before starting it:

sudo -u clickhouse touch /var/lib/clickhouse/flags/force_restore_data