How to speed up the data laoding process

crazylearner

unread,

Feb 10, 2021, 6:14:09 AM2/10/21

to ClickHouse

Currently, with 7 parallel inserts(PPSS Shell script), 26 B data gets inserted into the table in 24 Hours.

Our data is growing every day and I want some alternate solution to speed up the loading process.

I often get Merge error and I understand it's an asnync background process is there any way to speed up the merges as well?

Denis Zhuravlev

unread,

Feb 10, 2021, 6:03:47 PM2/10/21

to ClickHouse

Merge error?

Divya Divya

unread,

Feb 11, 2021, 1:27:36 AM2/11/21

to Denis Zhuravlev, ClickHouse

Yes with 7parallel inserts I often get merge error (inserts are faster than merges)

--
You received this message because you are subscribed to the Google Groups "ClickHouse" group.
To unsubscribe from this group and stop receiving emails from it, send an email to clickhouse+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/clickhouse/c4c64749-01be-4870-b95c-89cfea0403can%40googlegroups.com.

Reply all

Reply to author

Forward