Re: OptimisticTransactionDb Busy on commit

7 views

Skip to first unread message

Jon Groff

unread,

Mar 9, 2025, 8:01:13 PMMar 9

to Adam Retter, rocksdb

Greetings,

Follow up on commit Busy issue: I managed to sustain writes to Db by committing after every 'tuple', so it seems pretty probable that its some parameter I need to increase. This is for an open source project, so its not just a matter of getting it working, it would be nice if people actually wanted to use it. Sadly, meta.ai is not very helpful when it came to advice on its own in-house open source software. Trying it with standard TransactionDb, it gets lock timeouts even increasing lock timeout to several minutes. I am hoping there is just one parameter I am missing that will solve both issues. My test case it to have 5 heavyweight processes writing 1 month of NASA web log data from 5 files each of 400k rows using Java serialization over TCP sockets, and profiling with Java VisualVM. None of the processes are taxing the system overtly. CPU is about 45%, I can see the network threads heavily saturated but still with some headroom and the write threads are operating in bursts.

Thanks again,

Jon

Reply all

Reply to author

Forward

0 new messages