insert big data into ClickHouse

[leeo...@gmail.com]

My customer has 100M/s data from Web. I need to insert these data into Clickhouse from Java servlet. What is an efficient way to implement this? Can I use JDBC or call some methods in Clickhouse from Java code?

David

[Denis Zhuravlev]

100m/s 100m of what? Rows ? Gigabytes?

https://github.com/ClickHouse/clickhouse-jdbc#send-data-in-binary-formatted-with-custom-user-callback

[Vladimir Klimontovich]

Hi David!

I'm not sure if a direct insert through JDBC driver will do the job at your scale. If CH is down for maintenance (or the network is down) data can be lost.

Check out this post on Altinity blog: https://altinity.com/blog/introducing-eventnative-an-easy-way-to-put-your-event-stream-into-clickhouse (P. S. Full disclosure, I'm affiliated with Jitsu (ex-EventNative) mentioned in this blog-post)