ClickHouse data insert

155 views
Skip to first unread message

sadik...@gmail.com

unread,
Sep 14, 2017, 2:19:01 AM9/14/17
to ClickHouse
Hi All,
when I loading data into Table using text file, if one error record found in the file, upload stop from that row.
is it possible to continue loading while rejecting the error record and sending error record into a separate log?


command used

for i in /datan2/process/TBL_SUBSCRIBER/x* ; do echo $i; cat $i |clickhouse-client --host=172.99.99.99 --query="INSERT INTO db1.TBL_SUBSCRIBER FORMAT CSV";done;

Regards,
sadika

tatiana....@revjet.com

unread,
Sep 14, 2017, 12:17:00 PM9/14/17
to ClickHouse
There are settings to control that:
input_format_allow_errors_num
input_format_allow_errors_ratio

They both must be set to values above zero.
Unfortunately they are documented only in Russian.

sadik...@gmail.com

unread,
Sep 15, 2017, 2:12:22 AM9/15/17
to ClickHouse
Thanks


Reply all
Reply to author
Forward
0 new messages