I use a threadpool, where each thread writes to CQ, in response a prior step. There are about 20-100 threads.
In order to make things threadsafe, each thread does a createappender(), writes, calls finish() and then close().
This overhead consumes most of the resources, ends up with thousands of files (presumably each thread creates a new file on every write operation). The time to write to queue increases from 2- 2000 ms within a few seconds. It is nowhere near ns rates that I assume are normal.
What is the safe number of threads for concurrent writes to ChronicleQueue to achieve a ns rate.
Is my use case, not suitable for ChronicleQueue.