Re: 'Busy' constantly returned from OptimisticTransactionDb commit
21 views
Skip to first unread message
Jon Groff
Mar 9, 2025, 2:18:19 PMMar 9
to Adam Retter, roc...@googlegroups.com
Greetings,
I am using RocksJava in a server environment with OptimisticTransactionDb, and upon commit I am getting constant Busy returns in the RocksDbException status. In small singe user instances I can wait it out, and eventually the commit goes through, but adding users causes it to be starved out and no amount of retries/waits succeeds, and one user seems to own the entire resource. If I let the transactions get larger before commit, I get a message about the max_write_buffer_size_to_maintain being too small instead of a Busy.
I tried increasing the number of background threads, the numbers that show in the logs that max_write_buffer_size_to_maintain is up over a few gigabytes, committing even more, waiting even longer, and changing transactions after every commit, but the result is the same.
If you can advise on this, or hopefully have seen it before and found a simple expedient, I would be eternally grateful.
Sincerely,
Jon Groff
Adam Retter
Mar 10, 2025, 4:46:09 AMMar 10
to j...@microcaliperdevices.com, roc...@googlegroups.com
Hi Jon,
This is not something that I am familiar with. I just wondered if the RocksDB log gives you any indication of where it is spending its time, or perhaps a profiler or strace could shed some light?
Jon Groff
Mar 10, 2025, 6:41:33 AMMar 10
to Adam Retter, roc...@googlegroups.com
Hi Adam,
Thanks for getting back to me. This is tricky because this system is composed of multiple RocksDB databases, one for each class holding its instances and a key, and a main 'Relation' DB holding groupings of the keys and 5 column families that function as indexes with the keys in different orders. It's loosely based on category theory so the keys represent domain->map->range triplets. In short, there are quite a few log files involved and I am not at all an expert yet at interpreting whats truly relevant in log files.
One question I had is in relation to options, I use the same overall option in the opening the man db and column families. The Java API only lets you set certain attributes and I notice that as far as max_write_buffer_size_to_maintain the logs report that option as follows:
Default Column Family:
2025/03/09-13:02:14.890694 1df4 Options.write_buffer_size: 67108864
2025/03/09-13:02:14.890699 1df4 Options.max_write_buffer_number: 25
2025/03/09-13:02:14.890703 1df4 Options.compression: Snappy
2025/03/09-13:02:14.890707 1df4 Options.bottommost_compression: Disabled
2025/03/09-13:02:14.890711 1df4 Options.prefix_extractor: nullptr
2025/03/09-13:02:14.890716 1df4 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2025/03/09-13:02:14.890720 1df4 Options.num_levels: 7
2025/03/09-13:02:14.890724 1df4 Options.min_write_buffer_number_to_merge: 1
2025/03/09-13:02:14.890728 1df4 Options.max_write_buffer_number_to_maintain: 0
2025/03/09-13:02:14.890732 1df4 Options.max_write_buffer_size_to_maintain: 1677721600
One of the 'index' column families:
2025/03/09-13:02:14.951017 3684 Options.write_buffer_size: 67108864
2025/03/09-13:02:14.951021 3684 Options.max_write_buffer_number: 25
2025/03/09-13:02:14.951024 3684 Options.compression: Snappy
2025/03/09-13:02:14.951026 3684 Options.bottommost_compression: Disabled
2025/03/09-13:02:14.951029 3684 Options.prefix_extractor: nullptr
2025/03/09-13:02:14.951031 3684 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2025/03/09-13:02:14.951034 3684 Options.num_levels: 7
2025/03/09-13:02:14.951036 3684 Options.min_write_buffer_number_to_merge: 1
2025/03/09-13:02:14.951039 3684 Options.max_write_buffer_number_to_maintain: 0
2025/03/09-13:02:14.951041 3684 Options.max_write_buffer_size_to_maintain: 0
Notice the last line in each excerpt. Does zero indicate use of some other option? I notice setting this to larger and larger values didnt solve the problem on long running transactions. I use the same options but the final param isnt set the same on anything but default column family.
The log for the main 'table' is over 6 megs. It has a number of column families that function as indexes so the data is repeated for each column family.
I rolled the dice and took the end of the log file and pasted it here. Remember that this is for a successful run with commit each time and not
for a failed scenario, so in that respect not sure how applicable it is. If I should include something else please let me know.
Thanks again,
Jon
-----------------------snip
Uptime(secs): 48612.9 total, 4800.1 interval
Flush(GB): cumulative 0.646, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.15 GB write, 0.05 MB/s write, 1.53 GB read, 0.03 MB/s read, 63970.9 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 82 last_copies: 0 last_secs: 8.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338462 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153715 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/4 117.42 MB 0.0 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27365.49 0.00 87 314.546 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 14/9 649.30 MB 0.0 1.4 0.5 0.9 2.0 1.2 0.0 3.1 0.0 0.0 63380.44 0.00 93 681.510 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10524.10 0.00 74 142.218 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 48612.9 total, 600.0 interval
Flush(GB): cumulative 0.659, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.05 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63380.4 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 527159925
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1473A0#8424 capacity: 64.00 KB seed: 679176613 usage: 21.40 KB table_size: 1024 occupancy: 6 collections: 82 last_copies: 0 last_secs: 9.4e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,20.89 KB,32.6401%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapRangeDomain] **
** Level 0 read latency histogram (micros):
Count: 1204885 Average: 1.0155 StdDev: 9.69
Min: 0 Median: 0.6132 Max: 8398
Percentiles: P50: 0.61 P75: 0.92 P99: 5.50 P99.9: 8.57 P99.99: 20.28
--------------------------------
2025/03/10-02:32:27.907085 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 84153899
rocksdb.block.cache.hit COUNT : 39802
rocksdb.block.cache.add COUNT : 9405565
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562238
rocksdb.block.cache.index.hit COUNT : 39359
rocksdb.block.cache.index.add COUNT : 561659
rocksdb.block.cache.index.bytes.insert COUNT : 8337261724990
rocksdb.block.cache.filter.miss COUNT : 62174964
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 21416697
rocksdb.block.cache.data.hit COUNT : 443
rocksdb.block.cache.data.add COUNT : 8843906
rocksdb.block.cache.data.bytes.insert COUNT : 36382842614
rocksdb.block.cache.bytes.read COUNT : 723426447814
rocksdb.block.cache.bytes.write COUNT : 8373644567604
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61574807
rocksdb.bloom.filter.full.positive COUNT : 599517
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7477033
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44862192
rocksdb.number.keys.read COUNT : 7477033
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29077225956
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 19
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 19
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 12160
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 19
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 640
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 445
rocksdb.wal.bytes COUNT : 29077225956
rocksdb.write.self COUNT : 8643913
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11221692
rocksdb.compact.read.bytes COUNT : 12757803182
rocksdb.compact.write.bytes COUNT : 11166914019
rocksdb.flush.write.bytes COUNT : 4373551762
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4852
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17365064
rocksdb.number.block.decompressed COUNT : 21978935
rocksdb.bytes.compressed.from COUNT : 78901789659
rocksdb.bytes.compressed.to COUNT : 15262592322
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1106508044244
rocksdb.bytes.decompressed.to COUNT : 8430066089225
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 979
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 28687398048
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6294688663827
rocksdb.last.level.read.count COUNT : 14634458
rocksdb.non.last.level.read.bytes COUNT : 14946183865965
rocksdb.non.last.level.read.count COUNT : 69521361
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 56
rocksdb.last.level.seek.data.useful.no.filter COUNT : 56
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 155
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 154
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 84154539
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1637.049033 P95 : 8660.467132 P99 : 21449.820388 P100 : 480574.000000 COUNT : 7477033 SUM : 19483829452
rocksdb.db.write.micros P50 : 3648.947613 P95 : 9350.611959 P99 : 15016.417230 P100 : 1134347.000000 COUNT : 11221692 SUM : 47348787684
rocksdb.compaction.times.micros P50 : 1131521739.130435 P95 : 14233333333.333321 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 116 SUM : 310803780244
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 116 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5733.333333 P95 : 13923.274854 P99 : 19851.000000 P100 : 19851.000000 COUNT : 444 SUM : 3317436
rocksdb.compaction.outfile.sync.micros P50 : 8662.500000 P95 : 19897.435897 P99 : 20425.000000 P100 : 20425.000000 COUNT : 205 SUM : 1858978
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2541.304348 P95 : 7597.500000 P99 : 12404.416667 P100 : 15266.000000 COUNT : 567 SUM : 1711182
rocksdb.table.open.io.micros P50 : 3656.818182 P95 : 31382.352941 P99 : 69545.454545 P100 : 161013.000000 COUNT : 640 SUM : 5586999
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.049513 P95 : 46.778506 P99 : 94.998510 P100 : 31378.000000 COUNT : 12572791 SUM : 284454417
rocksdb.read.block.get.micros P50 : 20.467842 P95 : 107.308502 P99 : 609.671760 P100 : 120452.000000 COUNT : 71581108 SUM : 6520881670
rocksdb.write.raw.block.micros P50 : 2.686856 P95 : 12.958579 P99 : 21.061155 P100 : 35024.000000 COUNT : 17367011 SUM : 87780369
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.514886 P95 : 0.978283 P99 : 2.602639 P100 : 22586.000000 COUNT : 84155819 SUM : 36446713
rocksdb.file.read.flush.micros P50 : 0.509954 P95 : 0.968913 P99 : 1.704444 P100 : 5.000000 COUNT : 2664 SUM : 894
rocksdb.file.read.compaction.micros P50 : 0.566012 P95 : 2.678872 P99 : 4.926265 P100 : 10153.000000 COUNT : 12574545 SUM : 10121524
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.683207 P95 : 4.504876 P99 : 9.090606 P100 : 30849.000000 COUNT : 34734671 SUM : 55951726
rocksdb.file.write.flush.micros P50 : 0.623307 P95 : 1.940324 P99 : 5.060630 P100 : 12135.000000 COUNT : 9607810 SUM : 11689928
rocksdb.file.write.compaction.micros P50 : 0.709270 P95 : 5.299654 P99 : 9.455126 P100 : 30849.000000 COUNT : 25126861 SUM : 44261798
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7477033 SUM : 0
rocksdb.bytes.per.write P50 : 2564.308407 P95 : 6569.235911 P99 : 9394.576395 P100 : 12932.000000 COUNT : 8643913 SUM : 29077225956
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140327868.852459 P95 : 258000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 444 SUM : 63731042776
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 627 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:32:28.781888 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:32:28.782370 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741599148 to in-memory stats history
2025/03/10-02:32:28.782880 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:32:28.783787 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
2025/03/10-02:33:22.763101 3670 EVENT_LOG_v1 {"time_micros": 1741599202762501, "cf_name": "com.neocoretechs.relatrix.RangeDomainMap", "job": 785, "event": "table_file_creation", "file_number": 1117, "file_size": 9406249, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44251921, "largest_seqno": 44853340, "table_properties": {"data_size": 8622560, "index_size": 5834291, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11118, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeDomainMap", "column_family_id": 3, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44853340, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592433, "oldest_key_time": 1741599045, "newest_key_time": 1741592433, "file_creation_time": 1741599045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1117, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:33:22.764431 3670 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.RangeDomainMap] [JOB 785] Flush lasted 157241746 microseconds, and 0 cpu microseconds.
2025/03/10-02:33:22.865640 3670 (Original Log Time 2025/03/10-02:33:22.763325) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.RangeDomainMap] [JOB 785] Level-0 flush table #1117: 9406249 bytes OK
2025/03/10-02:33:22.865676 3670 (Original Log Time 2025/03/10-02:33:22.765304) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.RangeDomainMap] Level-0 commit flush result of table #1117 started
2025/03/10-02:33:22.865685 3670 (Original Log Time 2025/03/10-02:33:22.864924) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.RangeDomainMap] Level-0 commit flush result of table #1117: memtable #1 done
2025/03/10-02:33:22.865691 3670 (Original Log Time 2025/03/10-02:33:22.865047) EVENT_LOG_v1 {"time_micros": 1741599202865015, "job": 785, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [3, 0, 0, 0, 0, 5, 5], "immutable_memtables": 0}
2025/03/10-02:33:22.865698 3670 (Original Log Time 2025/03/10-02:33:22.865139) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.RangeDomainMap] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[3 0 0 0 0 5 5] max score 0.79, estimated pending compaction bytes 0
2025/03/10-02:33:22.865714 3670 [db\db_impl\db_impl_files.cc:496] [JOB 785] Try to delete WAL files size 9073284, prev total WAL file size 399074312, number of live WAL files 7.
2025/03/10-02:33:22.866519 3670 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001090.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5469225557, max_trash_db_ratio 0.250000
2025/03/10-02:33:26.879561 4908 [db\db_impl\db_impl_write.cc:2474] [default] New memtable created with log file: #1118. Immutable memtables: 0.
2025/03/10-02:33:26.879691 4908 [db\column_family.cc:1099] [default] Increasing compaction threads because of estimated pending compaction bytes 544477314
2025/03/10-02:33:26.880049 371c [db\db_impl\db_impl.cc:1676] [JOB 786] Syncing log #1116
2025/03/10-02:33:26.893188 371c (Original Log Time 2025/03/10-02:33:26.880014) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [default], flush slots available 6, compaction slots available 18, flush slots scheduled 1, compaction slots scheduled 5
2025/03/10-02:33:26.893248 371c [db\flush_job.cc:906] [default] [JOB 786] Flushing memtable id 75 with next log file: 1118
2025/03/10-02:33:26.893311 371c EVENT_LOG_v1 {"time_micros": 1741599206893284, "job": 786, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66850904, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:33:26.893324 371c [db\flush_job.cc:952] [default] [JOB 786] Level-0 flush table #1119: started
2025/03/10-02:33:36.583905 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.RangeMapDomain] New memtable created with log file: #1120. Immutable memtables: 0.
2025/03/10-02:33:36.584238 1664 [db\db_impl\db_impl.cc:1676] [JOB 787] Syncing log #1118
2025/03/10-02:33:36.587412 1664 (Original Log Time 2025/03/10-02:33:36.584218) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.RangeMapDomain], flush slots available 6, compaction slots available 18, flush slots scheduled 2, compaction slots scheduled 5
2025/03/10-02:33:36.587433 1664 [db\flush_job.cc:906] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Flushing memtable id 75 with next log file: 1120
2025/03/10-02:33:36.587474 1664 EVENT_LOG_v1 {"time_micros": 1741599216587453, "job": 787, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66850992, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:33:36.587483 1664 [db\flush_job.cc:952] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Level-0 flush table #1121: started
2025/03/10-02:34:10.179621 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.DomainRangeMap] New memtable created with log file: #1122. Immutable memtables: 0.
2025/03/10-02:34:10.179767 4908 [db\column_family.cc:1099] [com.neocoretechs.relatrix.DomainRangeMap] Increasing compaction threads because of estimated pending compaction bytes 542398748
2025/03/10-02:34:10.180282 4690 [db\db_impl\db_impl.cc:1676] [JOB 788] Syncing log #1120
2025/03/10-02:34:10.184738 4690 (Original Log Time 2025/03/10-02:34:10.180205) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.DomainRangeMap], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 5
2025/03/10-02:34:10.184794 4690 [db\flush_job.cc:906] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Flushing memtable id 75 with next log file: 1122
2025/03/10-02:34:10.184866 4690 EVENT_LOG_v1 {"time_micros": 1741599250184834, "job": 788, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66849904, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:34:10.184877 4690 [db\flush_job.cc:952] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Level-0 flush table #1123: started
2025/03/10-02:35:06.675765 3a44 [db\compaction\compaction_job.cc:1672] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 766] Generated table #1114: 236259 keys, 21698156 bytes, temperature: kUnknown
2025/03/10-02:35:06.675972 3a44 EVENT_LOG_v1 {"time_micros": 1741599306675852, "cf_name": "com.neocoretechs.relatrix.RangeMapDomain", "job": 766, "event": "table_file_creation", "file_number": 1114, "file_size": 21698156, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 27487300, "largest_seqno": 43665381, "table_properties": {"data_size": 19967491, "index_size": 12677770, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 295365, "raw_key_size": 122854680, "raw_average_key_size": 520, "raw_value_size": 30241152, "raw_average_value_size": 128, "num_data_blocks": 24153, "num_entries": 236259, "num_filter_entries": 236259, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeMapDomain", "column_family_id": 2, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 43665381, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741568512, "oldest_key_time": 1741584538, "newest_key_time": 0, "file_creation_time": 1741598188, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1114, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:35:07.368211 3a44 (Original Log Time 2025/03/10-02:35:07.212389) [db\compaction\compaction_job.cc:1746] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 766] Compacted 5@0 files to L5 => 245417867 bytes
2025/03/10-02:35:07.368358 3a44 (Original Log Time 2025/03/10-02:35:07.367891) [db\compaction\compaction_job.cc:933] [com.neocoretechs.relatrix.RangeMapDomain] compacted to: base level 5 level multiplier 10.00 max bytes base 268435456 files[1 0 0 0 0 5 6] max score 0.91, estimated pending compaction bytes 0, MB/sec: 0.0 rd, 0.0 wr, level 5, files in(5, 0) filtered(0, 0) out(5 +0 blob) MB in(235.5, 0.0 +0.0 blob) filtered(0.0, 0.0) out(234.0 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 2696352, records dropped: 0 output_compression: Snappy
2025/03/10-02:35:07.368387 3a44 (Original Log Time 2025/03/10-02:35:07.368001) EVENT_LOG_v1 {"time_micros": 1741599307367932, "job": 766, "event": "compaction_finished", "compaction_time_micros": 14086083179, "compaction_time_cpu_micros": 0, "output_level": 5, "num_output_files": 5, "total_output_size": 245417867, "num_input_records": 2696352, "num_output_records": 2696352, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [1, 0, 0, 0, 0, 5, 6]}
2025/03/10-02:36:16.379825 371c EVENT_LOG_v1 {"time_micros": 1741599376379532, "cf_name": "default", "job": 786, "event": "table_file_creation", "file_number": 1119, "file_size": 10233173, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44265905, "largest_seqno": 44867324, "table_properties": {"data_size": 9343957, "index_size": 5844940, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11138, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44867324, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592588, "oldest_key_time": 1741599206, "newest_key_time": 1741592588, "file_creation_time": 1741599206, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1119, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:36:16.380050 371c [db\flush_job.cc:1100] [default] [JOB 786] Flush lasted 169486870 microseconds, and 0 cpu microseconds.
2025/03/10-02:36:16.477078 371c [db\column_family.cc:1099] [default] Increasing compaction threads because of estimated pending compaction bytes 573108288
2025/03/10-02:36:16.477548 371c (Original Log Time 2025/03/10-02:36:16.380017) [db\flush_job.cc:1052] [default] [JOB 786] Level-0 flush table #1119: 10233173 bytes OK
2025/03/10-02:36:16.477568 371c (Original Log Time 2025/03/10-02:36:16.380093) [db\memtable_list.cc:584] [default] Level-0 commit flush result of table #1119 started
2025/03/10-02:36:16.477575 371c (Original Log Time 2025/03/10-02:36:16.476967) [db\memtable_list.cc:789] [default] Level-0 commit flush result of table #1119: memtable #1 done
2025/03/10-02:36:16.477603 371c (Original Log Time 2025/03/10-02:36:16.477065) EVENT_LOG_v1 {"time_micros": 1741599376477033, "job": 786, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [6, 0, 0, 0, 0, 4, 6], "immutable_memtables": 0}
2025/03/10-02:36:16.477617 371c (Original Log Time 2025/03/10-02:36:16.477143) [db\db_impl\db_impl_compaction_flush.cc:319] [default] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[6 0 0 0 0 4 6] max score 0.25, estimated pending compaction bytes 573108288
2025/03/10-02:36:16.477630 371c [db\db_impl\db_impl_files.cc:496] [JOB 786] Try to delete WAL files size 594332, prev total WAL file size 400686016, number of live WAL files 9.
2025/03/10-02:36:16.478379 371c [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001093.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5501156886, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.117721 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.MapRangeDomain] New memtable created with log file: #1124. Immutable memtables: 0.
2025/03/10-02:36:26.118136 2630 [db\db_impl\db_impl.cc:1676] [JOB 789] Syncing log #1122
2025/03/10-02:36:26.121586 2630 (Original Log Time 2025/03/10-02:36:26.118102) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.MapRangeDomain], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 4
2025/03/10-02:36:26.121636 2630 [db\flush_job.cc:906] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Flushing memtable id 75 with next log file: 1124
2025/03/10-02:36:26.121699 2630 EVENT_LOG_v1 {"time_micros": 1741599386121669, "job": 789, "event": "flush_started", "num_memtables": 1, "num_entries": 100244, "num_deletes": 0, "total_data_size": 65359088, "memory_usage": 66851432, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:36:26.121715 2630 [db\flush_job.cc:952] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Level-0 flush table #1125: started
2025/03/10-02:36:26.147983 1664 EVENT_LOG_v1 {"time_micros": 1741599386147879, "cf_name": "com.neocoretechs.relatrix.RangeMapDomain", "job": 787, "event": "table_file_creation", "file_number": 1121, "file_size": 9291179, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44266821, "largest_seqno": 44868240, "table_properties": {"data_size": 8532140, "index_size": 5406035, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 10302, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeMapDomain", "column_family_id": 2, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44868240, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592598, "oldest_key_time": 1741599216, "newest_key_time": 1741592598, "file_creation_time": 1741599216, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1121, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:36:26.148127 1664 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Flush lasted 169560717 microseconds, and 0 cpu microseconds.
2025/03/10-02:36:26.278810 1664 (Original Log Time 2025/03/10-02:36:26.148059) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Level-0 flush table #1121: 9291179 bytes OK
2025/03/10-02:36:26.278848 1664 (Original Log Time 2025/03/10-02:36:26.148161) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.RangeMapDomain] Level-0 commit flush result of table #1121 started
2025/03/10-02:36:26.278855 1664 (Original Log Time 2025/03/10-02:36:26.278221) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.RangeMapDomain] Level-0 commit flush result of table #1121: memtable #1 done
2025/03/10-02:36:26.278860 1664 (Original Log Time 2025/03/10-02:36:26.278351) EVENT_LOG_v1 {"time_micros": 1741599386278321, "job": 787, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [2, 0, 0, 0, 0, 5, 6], "immutable_memtables": 0}
2025/03/10-02:36:26.278865 1664 (Original Log Time 2025/03/10-02:36:26.278415) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.RangeMapDomain] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[2 0 0 0 0 5 6] max score 0.91, estimated pending compaction bytes 0
2025/03/10-02:36:26.354724 1664 [db\db_impl\db_impl_files.cc:496] [JOB 787] Try to delete WAL files size 2094436, prev total WAL file size 400683420, number of live WAL files 9.
2025/03/10-02:36:26.384832 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/000937.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5510448065, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.384995 1664 EVENT_LOG_v1 {"time_micros": 1741599386384968, "job": 787, "event": "table_file_deletion", "file_number": 937}
2025/03/10-02:36:26.399378 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/000980.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5355396571, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.399495 1664 EVENT_LOG_v1 {"time_micros": 1741599386399475, "job": 787, "event": "table_file_deletion", "file_number": 980}
2025/03/10-02:36:26.410848 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001039.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5318734090, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.410937 1664 EVENT_LOG_v1 {"time_micros": 1741599386410917, "job": 787, "event": "table_file_deletion", "file_number": 1039}
2025/03/10-02:36:26.419833 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001047.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5282054591, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.419978 1664 EVENT_LOG_v1 {"time_micros": 1741599386419959, "job": 787, "event": "table_file_deletion", "file_number": 1047}
2025/03/10-02:36:26.423087 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001066.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5272813986, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.423189 1664 EVENT_LOG_v1 {"time_micros": 1741599386423170, "job": 787, "event": "table_file_deletion", "file_number": 1066}
2025/03/10-02:36:26.423971 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001095.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5263522296, max_trash_db_ratio 0.250000
2025/03/10-02:37:03.464137 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.MapDomainRange] New memtable created with log file: #1126. Immutable memtables: 0.
2025/03/10-02:37:03.464215 4908 [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapDomainRange] Increasing compaction threads because of estimated pending compaction bytes 623824574
2025/03/10-02:37:03.464598 1dbc [db\db_impl\db_impl.cc:1676] [JOB 790] Syncing log #1124
2025/03/10-02:37:03.468917 1dbc (Original Log Time 2025/03/10-02:37:03.464544) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.MapDomainRange], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 4
2025/03/10-02:37:03.468997 1dbc [db\flush_job.cc:906] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Flushing memtable id 75 with next log file: 1126
2025/03/10-02:37:03.469076 1dbc EVENT_LOG_v1 {"time_micros": 1741599423469049, "job": 790, "event": "flush_started", "num_memtables": 1, "num_entries": 100232, "num_deletes": 0, "total_data_size": 65351264, "memory_usage": 66851824, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:37:03.469088 1dbc [db\flush_job.cc:952] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Level-0 flush table #1127: started
2025/03/10-02:38:18.574279 4690 EVENT_LOG_v1 {"time_micros": 1741599498574213, "cf_name": "com.neocoretechs.relatrix.DomainRangeMap", "job": 788, "event": "table_file_creation", "file_number": 1123, "file_size": 10212447, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44270049, "largest_seqno": 44871468, "table_properties": {"data_size": 9343356, "index_size": 5844415, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11137, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.DomainRangeMap", "column_family_id": 5, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44871468, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592632, "oldest_key_time": 1741599250, "newest_key_time": 1741592632, "file_creation_time": 1741599250, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1123, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:38:18.574340 4690 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Flush lasted 248389610 microseconds, and 0 cpu microseconds.
2025/03/10-02:38:18.686859 4690 [db\column_family.cc:1099] [com.neocoretechs.relatrix.DomainRangeMap] Increasing compaction threads because of estimated pending compaction bytes 570971153
2025/03/10-02:38:18.687545 4690 (Original Log Time 2025/03/10-02:38:18.574327) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Level-0 flush table #1123: 10212447 bytes OK
2025/03/10-02:38:18.687570 4690 (Original Log Time 2025/03/10-02:38:18.574348) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.DomainRangeMap] Level-0 commit flush result of table #1123 started
2025/03/10-02:38:18.687579 4690 (Original Log Time 2025/03/10-02:38:18.686666) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.DomainRangeMap] Level-0 commit flush result of table #1123: memtable #1 done
2025/03/10-02:38:18.687584 4690 (Original Log Time 2025/03/10-02:38:18.686811) EVENT_LOG_v1 {"time_micros": 1741599498686774, "job": 788, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [6, 0, 0, 0, 0, 4, 6], "immutable_memtables": 0}
2025/03/10-02:38:18.687589 4690 (Original Log Time 2025/03/10-02:38:18.686959) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.DomainRangeMap] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[6 0 0 0 0 4 6] max score 0.25, estimated pending compaction bytes 570971153
2025/03/10-02:38:18.687645 4690 [db\db_impl\db_impl_files.cc:496] [JOB 788] Try to delete WAL files size 8328496, prev total WAL file size 405814392, number of live WAL files 9.
2025/03/10-02:38:18.688769 4690 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001097.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5273734743, max_trash_db_ratio 0.250000
2025/03/10-02:39:12.444091 2630 EVENT_LOG_v1 {"time_micros": 1741599552444033, "cf_name": "com.neocoretechs.relatrix.MapRangeDomain", "job": 789, "event": "table_file_creation", "file_number": 1125, "file_size": 9564067, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44282885, "largest_seqno": 44884328, "table_properties": {"data_size": 8793532, "index_size": 5406501, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52126880, "raw_average_key_size": 520, "raw_value_size": 12831232, "raw_average_value_size": 128, "num_data_blocks": 10303, "num_entries": 100244, "num_filter_entries": 100244, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.MapRangeDomain", "column_family_id": 4, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44884328, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592769, "oldest_key_time": 1741599386, "newest_key_time": 1741592769, "file_creation_time": 1741599386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1125, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:39:12.444173 2630 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Flush lasted 166322594 microseconds, and 0 cpu microseconds.
2025/03/10-02:39:12.546928 2630 [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapRangeDomain] Increasing compaction threads because of estimated pending compaction bytes 552612976
2025/03/10-02:39:12.547586 2630 (Original Log Time 2025/03/10-02:39:12.444149) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Level-0 flush table #1125: 9564067 bytes OK
2025/03/10-02:39:12.547614 2630 (Original Log Time 2025/03/10-02:39:12.444186) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.MapRangeDomain] Level-0 commit flush result of table #1125 started
2025/03/10-02:39:12.547620 2630 (Original Log Time 2025/03/10-02:39:12.546760) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.MapRangeDomain] Level-0 commit flush result of table #1125: memtable #1 done
2025/03/10-02:39:12.547624 2630 (Original Log Time 2025/03/10-02:39:12.546907) EVENT_LOG_v1 {"time_micros": 1741599552546868, "job": 789, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [5, 0, 0, 0, 0, 5, 5], "immutable_memtables": 0}
2025/03/10-02:39:12.547631 2630 (Original Log Time 2025/03/10-02:39:12.547018) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.MapRangeDomain] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[5 0 0 0 0 5 5] max score 0.25, estimated pending compaction bytes 552612976
2025/03/10-02:39:12.547651 2630 [db\db_impl\db_impl_files.cc:496] [JOB 789] Try to delete WAL files size 2372136, prev total WAL file size 400927308, number of live WAL files 8.
2025/03/10-02:39:12.548821 2630 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001099.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5283298810, max_trash_db_ratio 0.250000
2025/03/10-02:40:55.193050 1dbc EVENT_LOG_v1 {"time_micros": 1741599655192992, "cf_name": "com.neocoretechs.relatrix.MapDomainRange", "job": 790, "event": "table_file_creation", "file_number": 1127, "file_size": 10393393, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44286541, "largest_seqno": 44887912, "table_properties": {"data_size": 9563253, "index_size": 5844175, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52120640, "raw_average_key_size": 520, "raw_value_size": 12829696, "raw_average_value_size": 128, "num_data_blocks": 11137, "num_entries": 100232, "num_filter_entries": 100232, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.MapDomainRange", "column_family_id": 1, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44887912, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592808, "oldest_key_time": 1741599423, "newest_key_time": 1741592808, "file_creation_time": 1741599423, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1127, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:40:55.193133 1dbc [db\flush_job.cc:1100] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Flush lasted 231724228 microseconds, and 0 cpu microseconds.
2025/03/10-02:40:55.317272 1dbc [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapDomainRange] Increasing compaction threads because of estimated pending compaction bytes 650907564
2025/03/10-02:40:55.318044 1dbc (Original Log Time 2025/03/10-02:40:55.193114) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Level-0 flush table #1127: 10393393 bytes OK
2025/03/10-02:40:55.318088 1dbc (Original Log Time 2025/03/10-02:40:55.193143) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.MapDomainRange] Level-0 commit flush result of table #1127 started
2025/03/10-02:40:55.318103 1dbc (Original Log Time 2025/03/10-02:40:55.317089) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.MapDomainRange] Level-0 commit flush result of table #1127: memtable #1 done
2025/03/10-02:40:55.318109 1dbc (Original Log Time 2025/03/10-02:40:55.317244) EVENT_LOG_v1 {"time_micros": 1741599655317203, "job": 790, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [5, 0, 0, 0, 0, 6, 5], "immutable_memtables": 0}
2025/03/10-02:40:55.318115 1dbc (Original Log Time 2025/03/10-02:40:55.317385) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.MapDomainRange] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[5 0 0 0 0 6 5] max score 0.25, estimated pending compaction bytes 650907564
2025/03/10-02:40:55.318136 1dbc [db\db_impl\db_impl_files.cc:496] [JOB 790] Try to delete WAL files size 367771924, prev total WAL file size 404851452, number of live WAL files 7.
2025/03/10-02:40:55.420278 1dbc [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001102.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5293692203, max_trash_db_ratio 0.250000
2025/03/10-02:42:27.915281 10f0 [db\db_impl\db_impl.cc:1210] ------- DUMPING STATS -------
2025/03/10-02:42:27.915446 10f0 [db\db_impl\db_impl.cc:1211]
** DB Stats **
Uptime(secs): 49213.0 total, 600.0 interval
Cumulative writes: 11M writes, 44M keys, 8658K commit groups, 1.3 writes per commit group, ingest: 27.11 GB, 0.56 MB/s
Cumulative WAL: 11M writes, 0 syncs, 11235888.00 writes per sync, written: 27.11 GB, 0.56 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 14K writes, 56K keys, 14K commit groups, 1.0 writes per commit group, ingest: 35.14 MB, 0.06 MB/s
Interval WAL: 14K writes, 0 syncs, 14196.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 6/5 117.61 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.6 0.0 0.1 23850.34 0.00 87 274.142 4789K 0 0.0 0.0
L5 4/4 233.24 MB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 1.6 0.0 0.0 19999.34 0.00 2 9999.668 4893K 0 0.0 0.0
L6 6/0 372.99 MB 0.0 0.9 0.4 0.5 0.9 0.4 0.0 2.4 0.1 0.0 18283.37 0.00 6 3047.229 9502K 0 0.0 0.0
Sum 16/9 723.85 MB 0.0 1.8 0.7 1.2 2.5 1.4 0.0 3.5 0.0 0.0 62133.05 0.00 95 654.032 19M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 169.49 0.00 1 169.487 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.7 1.2 1.8 0.7 0.0 0.0 0.0 0.0 51089.19 0.00 20 2554.459 19M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 11043.86 0.00 75 147.251 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49213.0 total, 600.0 interval
Flush(GB): cumulative 0.717, interval 0.010
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.53 GB write, 0.05 MB/s write, 1.83 GB read, 0.04 MB/s read, 62133.1 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 169.5 seconds
Estimated pending compaction bytes: 573108288
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4808E5F0#8424 capacity: 64.00 KB seed: 679176613 usage: 552.62 MB table_size: 1024 occupancy: 128 collections: 83 last_copies: 0 last_secs: 0.000236 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(94,377.84 KB,590.373%) IndexBlock(26,552.21 MB,883542%) Misc(7,24.07 KB,37.6068%)
** File Read Latency Histogram By Level [default] **
** Level 0 read latency histogram (micros):
Count: 57949178 Average: 0.3114 StdDev: 10.83
Min: 0 Median: 0.5049 Max: 17689
Percentiles: P50: 0.50 P75: 0.76 P99: 1.00 P99.9: 3.52 P99.99: 18.68
------------------------------------------------------
[ 0, 1 ] 57386333 99.029% 99.029% ####################
( 1, 2 ] 396990 0.685% 99.714%
( 2, 3 ] 91972 0.159% 99.873%
( 3, 4 ] 30936 0.053% 99.926%
( 4, 6 ] 17620 0.030% 99.956%
( 6, 10 ] 12980 0.022% 99.979%
( 10, 15 ] 5062 0.009% 99.987%
( 15, 22 ] 2837 0.005% 99.992%
( 22, 34 ] 1352 0.002% 99.995%
( 34, 51 ] 796 0.001% 99.996%
( 51, 76 ] 585 0.001% 99.997%
( 76, 110 ] 306 0.001% 99.998%
( 110, 170 ] 443 0.001% 99.998%
( 170, 250 ] 466 0.001% 99.999%
( 250, 380 ] 244 0.000% 100.000%
( 380, 580 ] 149 0.000% 100.000%
( 580, 870 ] 63 0.000% 100.000%
( 870, 1300 ] 49 0.000% 100.000%
( 1300, 1900 ] 25 0.000% 100.000%
( 1900, 2900 ] 18 0.000% 100.000%
( 2900, 4400 ] 23 0.000% 100.000%
( 4400, 6600 ] 27 0.000% 100.000%
( 6600, 9900 ] 17 0.000% 100.000%
( 9900, 14000 ] 17 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 4722629 Average: 0.8465 StdDev: 33.76
Min: 0 Median: 0.5409 Max: 18132
Percentiles: P50: 0.54 P75: 0.81 P99: 3.74 P99.9: 15.48 P99.99: 248.46
------------------------------------------------------
[ 0, 1 ] 4365456 92.437% 92.437% ##################
( 1, 2 ] 216051 4.575% 97.012% #
( 2, 3 ] 66688 1.412% 98.424%
( 3, 4 ] 36886 0.781% 99.205%
( 4, 6 ] 25206 0.534% 99.739%
( 6, 10 ] 4488 0.095% 99.834%
( 10, 15 ] 3002 0.064% 99.897%
( 15, 22 ] 1878 0.040% 99.937%
( 22, 34 ] 841 0.018% 99.955%
( 34, 51 ] 451 0.010% 99.964%
( 51, 76 ] 304 0.006% 99.971%
( 76, 110 ] 208 0.004% 99.975%
( 110, 170 ] 327 0.007% 99.982%
( 170, 250 ] 378 0.008% 99.990%
( 250, 380 ] 196 0.004% 99.994%
( 380, 580 ] 115 0.002% 99.997%
( 580, 870 ] 45 0.001% 99.998%
( 870, 1300 ] 31 0.001% 99.998%
( 1300, 1900 ] 26 0.001% 99.999%
( 1900, 2900 ] 28 0.001% 99.999%
( 2900, 4400 ] 15 0.000% 100.000%
( 4400, 6600 ] 11 0.000% 100.000%
( 6600, 9900 ] 13 0.000% 100.000%
( 9900, 14000 ] 14 0.000% 100.001%
( 14000, 22000 ] 7 0.000% 100.001%
** Level 6 read latency histogram (micros):
Count: 11850015 Average: 0.5676 StdDev: 23.47
Min: 0 Median: 0.5152 Max: 22586
Percentiles: P50: 0.52 P75: 0.77 P99: 2.12 P99.9: 8.97 P99.99: 165.17
------------------------------------------------------
[ 0, 1 ] 11500359 97.049% 97.049% ###################
( 1, 2 ] 224725 1.896% 98.946%
( 2, 3 ] 55886 0.472% 99.417%
( 3, 4 ] 31652 0.267% 99.684%
( 4, 6 ] 21438 0.181% 99.865%
( 6, 10 ] 5536 0.047% 99.912%
( 10, 15 ] 3888 0.033% 99.945%
( 15, 22 ] 2417 0.020% 99.965%
( 22, 34 ] 1086 0.009% 99.974%
( 34, 51 ] 678 0.006% 99.980%
( 51, 76 ] 460 0.004% 99.984%
( 76, 110 ] 282 0.002% 99.986%
( 110, 170 ] 460 0.004% 99.990%
( 170, 250 ] 518 0.004% 99.995%
( 250, 380 ] 277 0.002% 99.997%
( 380, 580 ] 140 0.001% 99.998%
( 580, 870 ] 73 0.001% 99.999%
( 870, 1300 ] 43 0.000% 99.999%
( 1300, 1900 ] 23 0.000% 99.999%
( 1900, 2900 ] 24 0.000% 100.000%
( 2900, 4400 ] 16 0.000% 100.000%
( 4400, 6600 ] 13 0.000% 100.000%
( 6600, 9900 ] 22 0.000% 100.000%
( 9900, 14000 ] 10 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
( 22000, 33000 ] 2 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 138.12 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.7 0.0 0.0 27393.10 0.00 88 311.285 5189K 0 0.0 0.0
L5 6/5 244.44 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 15581.11 0.00 1 15581.113 2496K 0 0.0 0.0
L6 5/0 337.37 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.3 0.0 0.0 18723.88 0.00 5 3744.776 8859K 0 0.0 0.0
Sum 16/9 719.94 MB 0.0 1.6 0.6 1.0 2.3 1.3 0.0 3.1 0.0 0.0 61698.09 0.00 94 656.363 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 231.72 0.00 1 231.724 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 0.0 0.0 51268.12 0.00 19 2698.322 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10429.98 0.00 75 139.066 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49213.0 total, 600.0 interval
Flush(GB): cumulative 0.725, interval 0.010
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.28 GB write, 0.05 MB/s write, 1.58 GB read, 0.03 MB/s read, 61698.1 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 231.7 seconds
Estimated pending compaction bytes: 650907564
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B145800#8424 capacity: 64.00 KB seed: 679176613 usage: 20.09 KB table_size: 1024 occupancy: 6 collections: 83 last_copies: 0 last_secs: 9.7e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,19.58 KB,30.5923%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapDomainRange] **
** Level 0 read latency histogram (micros):
Count: 1326256 Average: 0.6955 StdDev: 2.06
Min: 0 Median: 0.5462 Max: 2084
Percentiles: P50: 0.55 P75: 0.82 P99: 3.73 P99.9: 5.83 P99.99: 14.10
------------------------------------------------------
[ 0, 1 ] 1214027 91.538% 91.538% ##################
( 1, 2 ] 55827 4.209% 95.747% #
( 2, 3 ] 30142 2.273% 98.020%
( 3, 4 ] 17699 1.335% 99.354%
( 4, 6 ] 7915 0.597% 99.951%
( 6, 10 ] 365 0.028% 99.979%
( 10, 15 ] 181 0.014% 99.992%
( 15, 22 ] 64 0.005% 99.997%
( 22, 34 ] 14 0.001% 99.998%
( 34, 51 ] 8 0.001% 99.999%
( 51, 76 ] 7 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 3 0.000% 100.000%
( 170, 250 ] 2 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 1900, 2900 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 140390 Average: 1.2136 StdDev: 1.02
Min: 0 Median: 0.6531 Max: 225
Percentiles: P50: 0.65 P75: 0.98 P99: 3.63 P99.9: 5.81 P99.99: 17.17
------------------------------------------------------
[ 0, 1 ] 107478 76.557% 76.557% ###############
( 1, 2 ] 25082 17.866% 94.423% ####
( 2, 3 ] 5064 3.607% 98.030% #
( 3, 4 ] 2150 1.531% 99.561%
( 4, 6 ] 525 0.374% 99.935%
( 6, 10 ] 22 0.016% 99.951%
( 10, 15 ] 50 0.036% 99.986%
( 15, 22 ] 16 0.011% 99.998%
( 22, 34 ] 2 0.001% 99.999%
( 170, 250 ] 1 0.001% 100.000%
** Level 6 read latency histogram (micros):
Count: 585868 Average: 0.4337 StdDev: 0.52
Min: 0 Median: 0.5019 Max: 70
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.81 P99.99: 3.07
------------------------------------------------------
[ 0, 1 ] 583635 99.619% 99.619% ####################
( 1, 2 ] 2027 0.346% 99.965%
( 2, 3 ] 146 0.025% 99.990%
( 3, 4 ] 19 0.003% 99.993%
( 4, 6 ] 14 0.002% 99.995%
( 6, 10 ] 21 0.004% 99.999%
( 10, 15 ] 3 0.001% 99.999%
( 22, 34 ] 1 0.000% 100.000%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 17.70 MB 0.5 0.6 0.0 0.6 1.2 0.6 0.0 1.9 0.0 0.0 33659.09 0.00 88 382.490 6492K 0 0.0 0.0
L5 5/0 234.05 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14086.08 0.00 1 14086.083 2696K 0 0.0 0.0
L6 6/0 382.27 MB 0.0 1.0 0.4 0.6 1.0 0.4 0.0 2.4 0.0 0.0 28876.18 0.00 6 4812.697 11M 0 0.0 0.0
Sum 13/0 634.02 MB 0.0 1.8 0.6 1.1 2.4 1.2 0.0 3.7 0.0 0.0 76621.35 0.00 95 806.541 20M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 27.4 0.0 0.0 14255.64 0.00 2 7127.822 2696K 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.6 1.1 1.7 0.6 0.0 0.0 0.0 0.0 65740.36 0.00 20 3287.018 20M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.6 0.6 0.0 0.0 0.0 0.1 10881.00 0.00 75 145.080 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.649, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.39 GB write, 0.05 MB/s write, 1.77 GB read, 0.04 MB/s read, 76621.4 seconds
Interval compaction: 0.24 GB write, 0.40 MB/s write, 0.23 GB read, 0.39 MB/s read, 14255.6 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1451A0#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 83 last_copies: 0 last_secs: 0.000106 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeMapDomain] **
** Level 0 read latency histogram (micros):
Count: 1413077 Average: 1.2271 StdDev: 9.64
Min: 0 Median: 0.6627 Max: 8104
Percentiles: P50: 0.66 P75: 0.99 P99: 5.71 P99.9: 9.22 P99.99: 21.21
------------------------------------------------------
[ 0, 1 ] 1066214 75.453% 75.453% ###############
( 1, 2 ] 109660 7.760% 83.214% ##
( 2, 3 ] 81218 5.748% 88.961% #
( 3, 4 ] 83713 5.924% 94.885% #
( 4, 6 ] 68155 4.823% 99.709% #
( 6, 10 ] 3364 0.238% 99.947%
( 10, 15 ] 278 0.020% 99.966%
( 15, 22 ] 376 0.027% 99.993%
( 22, 34 ] 91 0.006% 99.999%
( 34, 51 ] 10 0.001% 100.000%
( 51, 76 ] 5 0.000% 100.000%
( 76, 110 ] 3 0.000% 100.001%
( 110, 170 ] 5 0.000% 100.001%
( 170, 250 ] 3 0.000% 100.001%
( 250, 380 ] 6 0.000% 100.002%
( 380, 580 ] 3 0.000% 100.002%
( 580, 870 ] 1 0.000% 100.002%
( 870, 1300 ] 1 0.000% 100.002%
( 2900, 4400 ] 2 0.000% 100.002%
( 4400, 6600 ] 1 0.000% 100.002%
( 6600, 9900 ] 1 0.000% 100.002%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.2000 StdDev: 1.64
Min: 0 Median: 0.6250 Max: 7
Percentiles: P50: 0.62 P75: 0.94 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 24 80.000% 80.000% ################
( 1, 2 ] 1 3.333% 83.333% #
( 2, 3 ] 2 6.667% 90.000% #
( 3, 4 ] 1 3.333% 93.333% #
( 4, 6 ] 1 3.333% 96.667% #
( 6, 10 ] 1 3.333% 100.000% #
** Level 6 read latency histogram (micros):
Count: 729569 Average: 0.6299 StdDev: 0.96
Min: 0 Median: 0.5363 Max: 228
Percentiles: P50: 0.54 P75: 0.80 P99: 3.88 P99.9: 5.86 P99.99: 12.12
------------------------------------------------------
[ 0, 1 ] 680216 93.235% 93.235% ###################
( 1, 2 ] 19455 2.667% 95.902% #
( 2, 3 ] 13798 1.891% 97.793%
( 3, 4 ] 10056 1.378% 99.172%
( 4, 6 ] 5722 0.784% 99.956%
( 6, 10 ] 227 0.031% 99.987%
( 10, 15 ] 52 0.007% 99.994%
( 15, 22 ] 31 0.004% 99.998%
( 22, 34 ] 3 0.000% 99.999%
( 34, 51 ] 5 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 2 0.000% 100.000%
( 170, 250 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 132.68 MB 0.8 0.5 0.0 0.5 1.2 0.7 0.0 1.8 0.0 0.0 30705.11 0.00 88 348.922 6086K 0 0.0 0.0
L5 5/0 203.05 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14829.33 0.00 1 14829.330 2297K 0 0.0 0.0
L6 5/0 311.16 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.4 0.0 0.0 18593.75 0.00 5 3718.751 9436K 0 0.0 0.0
Sum 13/0 646.89 MB 0.0 1.5 0.5 1.0 2.2 1.2 0.0 3.3 0.0 0.0 64128.19 0.00 94 682.215 17M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 157.24 0.00 1 157.242 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 0.0 0.0 53344.34 0.00 19 2807.597 17M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10783.85 0.00 75 143.785 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.654, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.16 GB write, 0.04 MB/s write, 1.53 GB read, 0.03 MB/s read, 64128.2 seconds
Interval compaction: 0.01 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 157.2 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 83 last_copies: 0 last_secs: 0.000804 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338468 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153721 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 126.54 MB 0.2 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27531.81 0.00 88 312.862 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 15/9 658.42 MB 0.0 1.4 0.5 0.9 2.1 1.2 0.0 3.1 0.0 0.0 63546.76 0.00 94 676.029 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 166.32 0.00 1 166.323 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10690.42 0.00 75 142.539 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.667, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.06 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63546.8 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 166.3 seconds
Estimated pending compaction bytes: 552612976
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-cou
2025/03/10-02:42:27.917280 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 84855421
rocksdb.block.cache.hit COUNT : 40410
rocksdb.block.cache.add COUNT : 9963600
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562334
rocksdb.block.cache.index.hit COUNT : 39931
rocksdb.block.cache.index.add COUNT : 561755
rocksdb.block.cache.index.bytes.insert COUNT : 8338897591042
rocksdb.block.cache.filter.miss COUNT : 62245068
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 22048019
rocksdb.block.cache.data.hit COUNT : 479
rocksdb.block.cache.data.add COUNT : 9401845
rocksdb.block.cache.data.bytes.insert COUNT : 38677982614
rocksdb.block.cache.bytes.read COUNT : 734769928357
rocksdb.block.cache.bytes.write COUNT : 8377575573656
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61644265
rocksdb.bloom.filter.full.positive COUNT : 600152
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7486497
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44918976
rocksdb.number.keys.read COUNT : 7486497
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29114069308
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 20
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 20
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 12800
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 20
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 651
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 450
rocksdb.wal.bytes COUNT : 29114069308
rocksdb.write.self COUNT : 8658109
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11235888
rocksdb.compact.read.bytes COUNT : 12855384020
rocksdb.compact.write.bytes COUNT : 11231603791
rocksdb.flush.write.bytes COUNT : 4432659197
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4865
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17496350
rocksdb.number.block.decompressed COUNT : 22610353
rocksdb.bytes.compressed.from COUNT : 79476712356
rocksdb.bytes.compressed.to COUNT : 15378064446
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1107238770330
rocksdb.bytes.decompressed.to COUNT : 8434242489384
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 990
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 29077128576
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6303263916768
rocksdb.last.level.read.count COUNT : 14947116
rocksdb.non.last.level.read.bytes COUNT : 14966419565917
rocksdb.non.last.level.read.count COUNT : 69910258
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 60
rocksdb.last.level.seek.data.useful.no.filter COUNT : 60
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 162
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 162
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 84856072
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1637.995042 P95 : 8675.666511 P99 : 21470.523047 P100 : 480574.000000 COUNT : 7486497 SUM : 19531030122
rocksdb.db.write.micros P50 : 3648.626495 P95 : 9356.253566 P99 : 15091.103915 P100 : 1134347.000000 COUNT : 11235888 SUM : 47423883820
rocksdb.compaction.times.micros P50 : 1135326086.956522 P95 : 15149999999.999992 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 117 SUM : 324889863423
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 117 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5758.823529 P95 : 13940.406977 P99 : 19851.000000 P100 : 19851.000000 COUNT : 450 SUM : 3367958
rocksdb.compaction.outfile.sync.micros P50 : 8800.000000 P95 : 19940.000000 P99 : 20425.000000 P100 : 20425.000000 COUNT : 206 SUM : 1873526
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2542.004773 P95 : 7545.000000 P99 : 12380.500000 P100 : 15266.000000 COUNT : 574 SUM : 1731031
rocksdb.table.open.io.micros P50 : 3683.632287 P95 : 31647.297297 P99 : 69770.833333 P100 : 161013.000000 COUNT : 651 SUM : 5793382
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.075252 P95 : 46.932629 P99 : 95.217033 P100 : 31378.000000 COUNT : 12646174 SUM : 287663409
rocksdb.read.block.get.micros P50 : 20.355231 P95 : 107.503408 P99 : 600.166407 P100 : 120452.000000 COUNT : 72209247 SUM : 6549297075
rocksdb.write.raw.block.micros P50 : 2.695149 P95 : 13.070022 P99 : 21.136183 P100 : 35024.000000 COUNT : 17498318 SUM : 89210151
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.515132 P95 : 0.978752 P99 : 2.622808 P100 : 22586.000000 COUNT : 84857374 SUM : 37156172
rocksdb.file.read.flush.micros P50 : 0.510783 P95 : 0.970488 P99 : 1.810811 P100 : 9.000000 COUNT : 2700 SUM : 932
rocksdb.file.read.compaction.micros P50 : 0.566456 P95 : 2.693088 P99 : 4.938561 P100 : 10153.000000 COUNT : 12647958 SUM : 10221643
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.685065 P95 : 4.572709 P99 : 9.122048 P100 : 30849.000000 COUNT : 34997292 SUM : 56864892
rocksdb.file.write.flush.micros P50 : 0.626533 P95 : 1.970771 P99 : 5.494276 P100 : 15662.000000 COUNT : 9723684 SUM : 12132670
rocksdb.file.write.compaction.micros P50 : 0.710607 P95 : 5.322749 P99 : 9.464570 P100 : 30849.000000 COUNT : 25273608 SUM : 44732222
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7486497 SUM : 0
rocksdb.bytes.per.write P50 : 2563.950234 P95 : 6568.334649 P99 : 9393.342542 P100 : 12932.000000 COUNT : 8658109 SUM : 29114069308
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140978260.869565 P95 : 255000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 450 SUM : 64873768541
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 636 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:42:28.808694 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:42:28.809247 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741599748 to in-memory stats history
2025/03/10-02:42:28.809565 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:42:28.809833 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
2025/03/10-02:46:24.001993 1524 [db\compaction\compaction_job.cc:1672] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 783] Generated table #1111: 967830 keys, 99327999 bytes, temperature: kUnknown
2025/03/10-02:46:24.002235 1524 EVENT_LOG_v1 {"time_micros": 1741599984002119, "cf_name": "com.neocoretechs.relatrix.DomainRangeMap", "job": 783, "event": "table_file_creation", "file_number": 1111, "file_size": 99327999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19103998, "largest_seqno": 44270025, "table_properties": {"data_size": 90973914, "index_size": 56446559, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1209797, "raw_key_size": 503271600, "raw_average_key_size": 520, "raw_value_size": 123882240, "raw_average_value_size": 128, "num_data_blocks": 107522, "num_entries": 967830, "num_filter_entries": 967830, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.DomainRangeMap", "column_family_id": 5, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44270025, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741562309, "oldest_key_time": 1741592632, "newest_key_time": 0, "file_creation_time": 1741597194, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1111, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:52:27.927401 10f0 [db\db_impl\db_impl.cc:1210] ------- DUMPING STATS -------
2025/03/10-02:52:27.927675 10f0 [db\db_impl\db_impl.cc:1211]
** DB Stats **
Uptime(secs): 49813.0 total, 600.0 interval
Cumulative writes: 11M writes, 44M keys, 8671K commit groups, 1.3 writes per commit group, ingest: 27.15 GB, 0.56 MB/s
Cumulative WAL: 11M writes, 0 syncs, 11249502.00 writes per sync, written: 27.15 GB, 0.56 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 13K writes, 54K keys, 13K commit groups, 1.0 writes per commit group, ingest: 33.70 MB, 0.06 MB/s
Interval WAL: 13K writes, 0 syncs, 13614.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 6/5 117.61 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.6 0.0 0.1 23850.34 0.00 87 274.142 4789K 0 0.0 0.0
L5 4/4 233.24 MB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 1.6 0.0 0.0 19999.34 0.00 2 9999.668 4893K 0 0.0 0.0
L6 6/0 372.99 MB 0.0 0.9 0.4 0.5 0.9 0.4 0.0 2.4 0.1 0.0 18283.37 0.00 6 3047.229 9502K 0 0.0 0.0
Sum 16/9 723.85 MB 0.0 1.8 0.7 1.2 2.5 1.4 0.0 3.5 0.0 0.0 62133.05 0.00 95 654.032 19M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.7 1.2 1.8 0.7 0.0 0.0 0.0 0.0 51089.19 0.00 20 2554.459 19M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 11043.86 0.00 75 147.251 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.717, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.53 GB write, 0.05 MB/s write, 1.83 GB read, 0.04 MB/s read, 62133.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 573108288
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4808E5F0#8424 capacity: 64.00 KB seed: 679176613 usage: 558.20 MB table_size: 1024 occupancy: 130 collections: 84 last_copies: 0 last_secs: 0.003327 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(95,381.75 KB,596.483%) IndexBlock(27,557.79 MB,892461%) Misc(7,24.11 KB,37.6755%)
** File Read Latency Histogram By Level [default] **
** Level 0 read latency histogram (micros):
Count: 58102622 Average: 0.3140 StdDev: 11.51
Min: 0 Median: 0.5050 Max: 24509
Percentiles: P50: 0.51 P75: 0.76 P99: 1.00 P99.9: 3.55 P99.99: 19.18
------------------------------------------------------
[ 0, 1 ] 57526995 99.009% 99.009% ####################
( 1, 2 ] 406847 0.700% 99.710%
( 2, 3 ] 93433 0.161% 99.870%
( 3, 4 ] 31488 0.054% 99.925%
( 4, 6 ] 17922 0.031% 99.955%
( 6, 10 ] 13226 0.023% 99.978%
( 10, 15 ] 5170 0.009% 99.987%
( 15, 22 ] 2899 0.005% 99.992%
( 22, 34 ] 1398 0.002% 99.994%
( 34, 51 ] 821 0.001% 99.996%
( 51, 76 ] 610 0.001% 99.997%
( 76, 110 ] 320 0.001% 99.997%
( 110, 170 ] 468 0.001% 99.998%
( 170, 250 ] 483 0.001% 99.999%
( 250, 380 ] 251 0.000% 99.999%
( 380, 580 ] 163 0.000% 100.000%
( 580, 870 ] 68 0.000% 100.000%
( 870, 1300 ] 53 0.000% 100.000%
( 1300, 1900 ] 28 0.000% 100.000%
( 1900, 2900 ] 19 0.000% 100.000%
( 2900, 4400 ] 23 0.000% 100.000%
( 4400, 6600 ] 27 0.000% 100.000%
( 6600, 9900 ] 17 0.000% 100.000%
( 9900, 14000 ] 19 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
( 22000, 33000 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 4884804 Average: 0.8481 StdDev: 33.37
Min: 0 Median: 0.5410 Max: 18132
Percentiles: P50: 0.54 P75: 0.81 P99: 3.72 P99.9: 15.67 P99.99: 248.90
------------------------------------------------------
[ 0, 1 ] 4515007 92.430% 92.430% ##################
( 1, 2 ] 225013 4.606% 97.036% #
( 2, 3 ] 68693 1.406% 98.442%
( 3, 4 ] 37647 0.771% 99.213%
( 4, 6 ] 25545 0.523% 99.736%
( 6, 10 ] 4704 0.096% 99.832%
( 10, 15 ] 3124 0.064% 99.896%
( 15, 22 ] 1939 0.040% 99.936%
( 22, 34 ] 885 0.018% 99.954%
( 34, 51 ] 477 0.010% 99.964%
( 51, 76 ] 317 0.006% 99.970%
( 76, 110 ] 220 0.005% 99.975%
( 110, 170 ] 350 0.007% 99.982%
( 170, 250 ] 400 0.008% 99.990%
( 250, 380 ] 203 0.004% 99.994%
( 380, 580 ] 123 0.003% 99.997%
( 580, 870 ] 45 0.001% 99.998%
( 870, 1300 ] 32 0.001% 99.998%
( 1300, 1900 ] 28 0.001% 99.999%
( 1900, 2900 ] 29 0.001% 100.000%
( 2900, 4400 ] 15 0.000% 100.000%
( 4400, 6600 ] 12 0.000% 100.000%
( 6600, 9900 ] 13 0.000% 100.000%
( 9900, 14000 ] 14 0.000% 100.001%
( 14000, 22000 ] 7 0.000% 100.001%
** Level 6 read latency histogram (micros):
Count: 12171538 Average: 0.5770 StdDev: 24.07
Min: 0 Median: 0.5156 Max: 22586
Percentiles: P50: 0.52 P75: 0.77 P99: 2.14 P99.9: 9.29 P99.99: 176.00
------------------------------------------------------
[ 0, 1 ] 11803183 96.974% 96.974% ###################
( 1, 2 ] 238190 1.957% 98.931%
( 2, 3 ] 58470 0.480% 99.411%
( 3, 4 ] 32599 0.268% 99.679%
( 4, 6 ] 22035 0.181% 99.860%
( 6, 10 ] 5950 0.049% 99.909%
( 10, 15 ] 4110 0.034% 99.942%
( 15, 22 ] 2542 0.021% 99.963%
( 22, 34 ] 1171 0.010% 99.973%
( 34, 51 ] 731 0.006% 99.979%
( 51, 76 ] 492 0.004% 99.983%
( 76, 110 ] 299 0.002% 99.985%
( 110, 170 ] 507 0.004% 99.990%
( 170, 250 ] 558 0.005% 99.994%
( 250, 380 ] 302 0.002% 99.997%
( 380, 580 ] 162 0.001% 99.998%
( 580, 870 ] 84 0.001% 99.999%
( 870, 1300 ] 50 0.000% 99.999%
( 1300, 1900 ] 29 0.000% 99.999%
( 1900, 2900 ] 25 0.000% 100.000%
( 2900, 4400 ] 18 0.000% 100.000%
( 4400, 6600 ] 13 0.000% 100.000%
( 6600, 9900 ] 22 0.000% 100.000%
( 9900, 14000 ] 11 0.000% 100.000%
( 14000, 22000 ] 8 0.000% 100.000%
( 22000, 33000 ] 2 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 138.12 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.7 0.0 0.0 27393.10 0.00 88 311.285 5189K 0 0.0 0.0
L5 6/5 244.44 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 15581.11 0.00 1 15581.113 2496K 0 0.0 0.0
L6 5/0 337.37 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.3 0.0 0.0 18723.88 0.00 5 3744.776 8859K 0 0.0 0.0
Sum 16/9 719.94 MB 0.0 1.6 0.6 1.0 2.3 1.3 0.0 3.1 0.0 0.0 61698.09 0.00 94 656.363 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 0.0 0.0 51268.12 0.00 19 2698.322 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10429.98 0.00 75 139.066 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.725, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.28 GB write, 0.05 MB/s write, 1.58 GB read, 0.03 MB/s read, 61698.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 650907564
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B145800#8424 capacity: 64.00 KB seed: 679176613 usage: 20.08 KB table_size: 1024 occupancy: 6 collections: 84 last_copies: 0 last_secs: 0.000185 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,19.57 KB,30.5832%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapDomainRange] **
** Level 0 read latency histogram (micros):
Count: 1334181 Average: 0.6970 StdDev: 2.06
Min: 0 Median: 0.5464 Max: 2084
Percentiles: P50: 0.55 P75: 0.82 P99: 3.73 P99.9: 5.83 P99.99: 14.14
------------------------------------------------------
[ 0, 1 ] 1220981 91.515% 91.515% ##################
( 1, 2 ] 56526 4.237% 95.752% #
( 2, 3 ] 30326 2.273% 98.025%
( 3, 4 ] 17768 1.332% 99.357%
( 4, 6 ] 7928 0.594% 99.951%
( 6, 10 ] 367 0.028% 99.979%
( 10, 15 ] 183 0.014% 99.992%
( 15, 22 ] 66 0.005% 99.997%
( 22, 34 ] 14 0.001% 99.998%
( 34, 51 ] 8 0.001% 99.999%
( 51, 76 ] 7 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 3 0.000% 100.000%
( 170, 250 ] 2 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 1900, 2900 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 155633 Average: 1.1798 StdDev: 1.01
Min: 0 Median: 0.6417 Max: 225
Percentiles: P50: 0.64 P75: 0.96 P99: 3.60 P99.9: 5.82 P99.99: 17.11
------------------------------------------------------
[ 0, 1 ] 121272 77.922% 77.922% ################
( 1, 2 ] 26035 16.728% 94.650% ###
( 2, 3 ] 5397 3.468% 98.118% #
( 3, 4 ] 2272 1.460% 99.578%
( 4, 6 ] 552 0.355% 99.933%
( 6, 10 ] 25 0.016% 99.949%
( 10, 15 ] 59 0.038% 99.987%
( 15, 22 ] 18 0.012% 99.998%
( 22, 34 ] 2 0.001% 99.999%
( 170, 250 ] 1 0.001% 100.000%
** Level 6 read latency histogram (micros):
Count: 585868 Average: 0.4337 StdDev: 0.52
Min: 0 Median: 0.5019 Max: 70
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.81 P99.99: 3.07
------------------------------------------------------
[ 0, 1 ] 583635 99.619% 99.619% ####################
( 1, 2 ] 2027 0.346% 99.965%
( 2, 3 ] 146 0.025% 99.990%
( 3, 4 ] 19 0.003% 99.993%
( 4, 6 ] 14 0.002% 99.995%
( 6, 10 ] 21 0.004% 99.999%
( 10, 15 ] 3 0.001% 99.999%
( 22, 34 ] 1 0.000% 100.000%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 17.70 MB 0.5 0.6 0.0 0.6 1.2 0.6 0.0 1.9 0.0 0.0 33659.09 0.00 88 382.490 6492K 0 0.0 0.0
L5 5/0 234.05 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14086.08 0.00 1 14086.083 2696K 0 0.0 0.0
L6 6/0 382.27 MB 0.0 1.0 0.4 0.6 1.0 0.4 0.0 2.4 0.0 0.0 28876.18 0.00 6 4812.697 11M 0 0.0 0.0
Sum 13/0 634.02 MB 0.0 1.8 0.6 1.1 2.4 1.2 0.0 3.7 0.0 0.0 76621.35 0.00 95 806.541 20M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.6 1.1 1.7 0.6 0.0 0.0 0.0 0.0 65740.36 0.00 20 3287.018 20M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.6 0.6 0.0 0.0 0.0 0.1 10881.00 0.00 75 145.080 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.649, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.39 GB write, 0.05 MB/s write, 1.77 GB read, 0.04 MB/s read, 76621.4 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1451A0#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 84 last_copies: 0 last_secs: 0.000113 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeMapDomain] **
** Level 0 read latency histogram (micros):
Count: 1413077 Average: 1.2271 StdDev: 9.64
Min: 0 Median: 0.6627 Max: 8104
Percentiles: P50: 0.66 P75: 0.99 P99: 5.71 P99.9: 9.22 P99.99: 21.21
------------------------------------------------------
[ 0, 1 ] 1066214 75.453% 75.453% ###############
( 1, 2 ] 109660 7.760% 83.214% ##
( 2, 3 ] 81218 5.748% 88.961% #
( 3, 4 ] 83713 5.924% 94.885% #
( 4, 6 ] 68155 4.823% 99.709% #
( 6, 10 ] 3364 0.238% 99.947%
( 10, 15 ] 278 0.020% 99.966%
( 15, 22 ] 376 0.027% 99.993%
( 22, 34 ] 91 0.006% 99.999%
( 34, 51 ] 10 0.001% 100.000%
( 51, 76 ] 5 0.000% 100.000%
( 76, 110 ] 3 0.000% 100.001%
( 110, 170 ] 5 0.000% 100.001%
( 170, 250 ] 3 0.000% 100.001%
( 250, 380 ] 6 0.000% 100.002%
( 380, 580 ] 3 0.000% 100.002%
( 580, 870 ] 1 0.000% 100.002%
( 870, 1300 ] 1 0.000% 100.002%
( 2900, 4400 ] 2 0.000% 100.002%
( 4400, 6600 ] 1 0.000% 100.002%
( 6600, 9900 ] 1 0.000% 100.002%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.2000 StdDev: 1.64
Min: 0 Median: 0.6250 Max: 7
Percentiles: P50: 0.62 P75: 0.94 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 24 80.000% 80.000% ################
( 1, 2 ] 1 3.333% 83.333% #
( 2, 3 ] 2 6.667% 90.000% #
( 3, 4 ] 1 3.333% 93.333% #
( 4, 6 ] 1 3.333% 96.667% #
( 6, 10 ] 1 3.333% 100.000% #
** Level 6 read latency histogram (micros):
Count: 729569 Average: 0.6299 StdDev: 0.96
Min: 0 Median: 0.5363 Max: 228
Percentiles: P50: 0.54 P75: 0.80 P99: 3.88 P99.9: 5.86 P99.99: 12.12
------------------------------------------------------
[ 0, 1 ] 680216 93.235% 93.235% ###################
( 1, 2 ] 19455 2.667% 95.902% #
( 2, 3 ] 13798 1.891% 97.793%
( 3, 4 ] 10056 1.378% 99.172%
( 4, 6 ] 5722 0.784% 99.956%
( 6, 10 ] 227 0.031% 99.987%
( 10, 15 ] 52 0.007% 99.994%
( 15, 22 ] 31 0.004% 99.998%
( 22, 34 ] 3 0.000% 99.999%
( 34, 51 ] 5 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 2 0.000% 100.000%
( 170, 250 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 132.68 MB 0.8 0.5 0.0 0.5 1.2 0.7 0.0 1.8 0.0 0.0 30705.11 0.00 88 348.922 6086K 0 0.0 0.0
L5 5/0 203.05 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14829.33 0.00 1 14829.330 2297K 0 0.0 0.0
L6 5/0 311.16 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.4 0.0 0.0 18593.75 0.00 5 3718.751 9436K 0 0.0 0.0
Sum 13/0 646.89 MB 0.0 1.5 0.5 1.0 2.2 1.2 0.0 3.3 0.0 0.0 64128.19 0.00 94 682.215 17M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 0.0 0.0 53344.34 0.00 19 2807.597 17M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10783.85 0.00 75 143.785 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49812.9 total, 600.0 interval
Flush(GB): cumulative 0.654, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.16 GB write, 0.04 MB/s write, 1.53 GB read, 0.03 MB/s read, 64128.2 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 84 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338468 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153721 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 126.54 MB 0.2 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27531.81 0.00 88 312.862 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 15/9 658.42 MB 0.0 1.4 0.5 0.9 2.1 1.2 0.0 3.1 0.0 0.0 63546.76 0.00 94 676.029 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10690.42 0.00 75 142.539 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49812.9 total, 600.0 interval
Flush(GB): cumulative 0.667, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.06 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63546.8 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 552612976
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-fi
2025/03/10-02:52:27.930202 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 85552653
rocksdb.block.cache.hit COUNT : 41081
rocksdb.block.cache.add COUNT : 10504884
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562400
rocksdb.block.cache.index.hit COUNT : 40568
rocksdb.block.cache.index.add COUNT : 561820
rocksdb.block.cache.index.bytes.insert COUNT : 8339544976718
rocksdb.block.cache.filter.miss COUNT : 62315567
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 22674686
rocksdb.block.cache.data.hit COUNT : 513
rocksdb.block.cache.data.add COUNT : 9943064
rocksdb.block.cache.data.bytes.insert COUNT : 40904311365
rocksdb.block.cache.bytes.read COUNT : 746026143256
rocksdb.block.cache.bytes.write COUNT : 8380449288083
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61714076
rocksdb.bloom.filter.full.positive COUNT : 600840
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7495573
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44973432
rocksdb.number.keys.read COUNT : 7495573
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29149402176
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 21
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 21
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 13440
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 21
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 651
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 450
rocksdb.wal.bytes COUNT : 29149402176
rocksdb.write.self COUNT : 8671723
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11249502
rocksdb.compact.read.bytes COUNT : 12932865003
rocksdb.compact.write.bytes COUNT : 11312057422
rocksdb.flush.write.bytes COUNT : 4432659197
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4866
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17581801
rocksdb.number.block.decompressed COUNT : 23237087
rocksdb.bytes.compressed.from COUNT : 79875111066
rocksdb.bytes.compressed.to COUNT : 15457015262
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1107848202640
rocksdb.bytes.decompressed.to COUNT : 8437452291437
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 990
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 29077128576
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6311453550243
rocksdb.last.level.read.count COUNT : 15268647
rocksdb.non.last.level.read.bytes COUNT : 14986141453844
rocksdb.non.last.level.read.count COUNT : 70285960
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 65
rocksdb.last.level.seek.data.useful.no.filter COUNT : 65
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 171
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 171
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 85553305
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1638.904531 P95 : 8691.586075 P99 : 21490.214538 P100 : 480574.000000 COUNT : 7495573 SUM : 19576295658
rocksdb.db.write.micros P50 : 3648.631460 P95 : 9363.462626 P99 : 15173.419228 P100 : 1134347.000000 COUNT : 11249502 SUM : 47504150161
rocksdb.compaction.times.micros P50 : 1135326086.956522 P95 : 15149999999.999992 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 117 SUM : 324889863423
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 117 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5758.823529 P95 : 13940.406977 P99 : 19851.000000 P100 : 19851.000000 COUNT : 450 SUM : 3367958
rocksdb.compaction.outfile.sync.micros P50 : 8937.500000 P95 : 19980.487805 P99 : 20425.000000 P100 : 20425.000000 COUNT : 207 SUM : 1889170
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2542.004773 P95 : 7545.000000 P99 : 12380.500000 P100 : 15266.000000 COUNT : 574 SUM : 1731031
rocksdb.table.open.io.micros P50 : 3683.632287 P95 : 31647.297297 P99 : 69770.833333 P100 : 161013.000000 COUNT : 651 SUM : 5793382
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.105779 P95 : 47.110369 P99 : 95.394151 P100 : 31378.000000 COUNT : 12731623 SUM : 290508347
rocksdb.read.block.get.micros P50 : 20.246355 P95 : 107.700812 P99 : 593.767490 P100 : 120452.000000 COUNT : 72821031 SUM : 6577404152
rocksdb.write.raw.block.micros P50 : 2.700550 P95 : 13.118892 P99 : 21.191437 P100 : 35024.000000 COUNT : 17583772 SUM : 90152053
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.515372 P95 : 0.979208 P99 : 2.641595 P100 : 24509.000000 COUNT : 85554607 SUM : 37883460
rocksdb.file.read.flush.micros P50 : 0.510783 P95 : 0.970488 P99 : 1.810811 P100 : 9.000000 COUNT : 2700 SUM : 932
rocksdb.file.read.compaction.micros P50 : 0.566834 P95 : 2.705904 P99 : 4.955817 P100 : 10153.000000 COUNT : 12733408 SUM : 10330754
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.686240 P95 : 4.611566 P99 : 9.142013 P100 : 30849.000000 COUNT : 35168201 SUM : 57470454
rocksdb.file.write.flush.micros P50 : 0.626533 P95 : 1.970771 P99 : 5.494276 P100 : 15662.000000 COUNT : 9723684 SUM : 12132670
rocksdb.file.write.compaction.micros P50 : 0.712177 P95 : 5.350363 P99 : 9.481061 P100 : 30849.000000 COUNT : 25444517 SUM : 45337784
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7495573 SUM : 0
rocksdb.bytes.per.write P50 : 2563.608209 P95 : 6567.470337 P99 : 9392.159274 P100 : 12932.000000 COUNT : 8671723 SUM : 29149402176
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140978260.869565 P95 : 255000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 450 SUM : 64873768541
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 643 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:52:28.830615 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:52:28.831106 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741600348 to in-memory stats history
2025/03/10-02:52:28.831232 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:52:28.831761 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
-------end of log
Jon Groff
V.P. R&D Microcaliper Devices, LLC (mailto:j...@microcaliperdevices.com)
I am using RocksJava in a server environment with OptimisticTransactionDb, and upon commit I am getting constant Busy returns in the RocksDbException status. In small singe user instances I can wait it out, and eventually the commit goes through, but adding users causes it to be starved out and no amount of retries/waits succeeds, and one user seems to own the entire resource. If I let the transactions get larger before commit, I get a message about the max_write_buffer_size_to_maintain being too small instead of a Busy.
I tried increasing the number of background threads, the numbers that show in the logs that max_write_buffer_size_to_maintain is up over a few gigabytes, committing even more, waiting even longer, and changing transactions after every commit, but the result is the same.
If you can advise on this, or hopefully have seen it before and found a simple expedient, I would be eternally grateful.
Sincerely,
Jon Groff
--
Adam Retter
skype: adam.retter
tweet: adamretter
http://www.adamretter.org.uk
--
You received this message because you are subscribed to the Google Groups "rocksdb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rocksdb+u...@googlegroups.com (mailto:rocksdb+u...@googlegroups.com).
To view this discussion visit https://groups.google.com/d/msgid/rocksdb/CAPK0iciL7BW4obA%3D0hnkEhDh78boGhvqY_8XSZ5555pDucqUNg%40mail.gmail.com.
Thanks for getting back to me. This is tricky because this system is composed of multiple RocksDB databases, one for each class holding its instances and a key, and a main 'Relation' DB holding groupings of the keys and 5 column families that function as indexes with the keys in different orders. It's loosely based on category theory so the keys represent domain->map->range triplets. In short, there are quite a few log files involved and I am not at all an expert yet at interpreting whats truly relevant in log files.
One question I had is in relation to options, I use the same overall option in the opening the man db and column families. The Java API only lets you set certain attributes and I notice that as far as max_write_buffer_size_to_maintain the logs report that option as follows:
Default Column Family:
2025/03/09-13:02:14.890694 1df4 Options.write_buffer_size: 67108864
2025/03/09-13:02:14.890699 1df4 Options.max_write_buffer_number: 25
2025/03/09-13:02:14.890703 1df4 Options.compression: Snappy
2025/03/09-13:02:14.890707 1df4 Options.bottommost_compression: Disabled
2025/03/09-13:02:14.890711 1df4 Options.prefix_extractor: nullptr
2025/03/09-13:02:14.890716 1df4 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2025/03/09-13:02:14.890720 1df4 Options.num_levels: 7
2025/03/09-13:02:14.890724 1df4 Options.min_write_buffer_number_to_merge: 1
2025/03/09-13:02:14.890728 1df4 Options.max_write_buffer_number_to_maintain: 0
2025/03/09-13:02:14.890732 1df4 Options.max_write_buffer_size_to_maintain: 1677721600
One of the 'index' column families:
2025/03/09-13:02:14.951017 3684 Options.write_buffer_size: 67108864
2025/03/09-13:02:14.951021 3684 Options.max_write_buffer_number: 25
2025/03/09-13:02:14.951024 3684 Options.compression: Snappy
2025/03/09-13:02:14.951026 3684 Options.bottommost_compression: Disabled
2025/03/09-13:02:14.951029 3684 Options.prefix_extractor: nullptr
2025/03/09-13:02:14.951031 3684 Options.memtable_insert_with_hint_prefix_extractor: nullptr
2025/03/09-13:02:14.951034 3684 Options.num_levels: 7
2025/03/09-13:02:14.951036 3684 Options.min_write_buffer_number_to_merge: 1
2025/03/09-13:02:14.951039 3684 Options.max_write_buffer_number_to_maintain: 0
2025/03/09-13:02:14.951041 3684 Options.max_write_buffer_size_to_maintain: 0
Notice the last line in each excerpt. Does zero indicate use of some other option? I notice setting this to larger and larger values didnt solve the problem on long running transactions. I use the same options but the final param isnt set the same on anything but default column family.
The log for the main 'table' is over 6 megs. It has a number of column families that function as indexes so the data is repeated for each column family.
I rolled the dice and took the end of the log file and pasted it here. Remember that this is for a successful run with commit each time and not
for a failed scenario, so in that respect not sure how applicable it is. If I should include something else please let me know.
Thanks again,
Jon
-----------------------snip
Uptime(secs): 48612.9 total, 4800.1 interval
Flush(GB): cumulative 0.646, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.15 GB write, 0.05 MB/s write, 1.53 GB read, 0.03 MB/s read, 63970.9 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 82 last_copies: 0 last_secs: 8.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338462 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153715 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/4 117.42 MB 0.0 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27365.49 0.00 87 314.546 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 14/9 649.30 MB 0.0 1.4 0.5 0.9 2.0 1.2 0.0 3.1 0.0 0.0 63380.44 0.00 93 681.510 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10524.10 0.00 74 142.218 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 48612.9 total, 600.0 interval
Flush(GB): cumulative 0.659, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.05 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63380.4 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 527159925
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1473A0#8424 capacity: 64.00 KB seed: 679176613 usage: 21.40 KB table_size: 1024 occupancy: 6 collections: 82 last_copies: 0 last_secs: 9.4e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,20.89 KB,32.6401%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapRangeDomain] **
** Level 0 read latency histogram (micros):
Count: 1204885 Average: 1.0155 StdDev: 9.69
Min: 0 Median: 0.6132 Max: 8398
Percentiles: P50: 0.61 P75: 0.92 P99: 5.50 P99.9: 8.57 P99.99: 20.28
--------------------------------
2025/03/10-02:32:27.907085 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 84153899
rocksdb.block.cache.hit COUNT : 39802
rocksdb.block.cache.add COUNT : 9405565
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562238
rocksdb.block.cache.index.hit COUNT : 39359
rocksdb.block.cache.index.add COUNT : 561659
rocksdb.block.cache.index.bytes.insert COUNT : 8337261724990
rocksdb.block.cache.filter.miss COUNT : 62174964
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 21416697
rocksdb.block.cache.data.hit COUNT : 443
rocksdb.block.cache.data.add COUNT : 8843906
rocksdb.block.cache.data.bytes.insert COUNT : 36382842614
rocksdb.block.cache.bytes.read COUNT : 723426447814
rocksdb.block.cache.bytes.write COUNT : 8373644567604
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61574807
rocksdb.bloom.filter.full.positive COUNT : 599517
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7477033
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44862192
rocksdb.number.keys.read COUNT : 7477033
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29077225956
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 19
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 19
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 12160
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 19
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 640
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 445
rocksdb.wal.bytes COUNT : 29077225956
rocksdb.write.self COUNT : 8643913
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11221692
rocksdb.compact.read.bytes COUNT : 12757803182
rocksdb.compact.write.bytes COUNT : 11166914019
rocksdb.flush.write.bytes COUNT : 4373551762
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4852
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17365064
rocksdb.number.block.decompressed COUNT : 21978935
rocksdb.bytes.compressed.from COUNT : 78901789659
rocksdb.bytes.compressed.to COUNT : 15262592322
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1106508044244
rocksdb.bytes.decompressed.to COUNT : 8430066089225
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 979
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 28687398048
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6294688663827
rocksdb.last.level.read.count COUNT : 14634458
rocksdb.non.last.level.read.bytes COUNT : 14946183865965
rocksdb.non.last.level.read.count COUNT : 69521361
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 56
rocksdb.last.level.seek.data.useful.no.filter COUNT : 56
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 155
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 154
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 84154539
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1637.049033 P95 : 8660.467132 P99 : 21449.820388 P100 : 480574.000000 COUNT : 7477033 SUM : 19483829452
rocksdb.db.write.micros P50 : 3648.947613 P95 : 9350.611959 P99 : 15016.417230 P100 : 1134347.000000 COUNT : 11221692 SUM : 47348787684
rocksdb.compaction.times.micros P50 : 1131521739.130435 P95 : 14233333333.333321 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 116 SUM : 310803780244
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 116 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5733.333333 P95 : 13923.274854 P99 : 19851.000000 P100 : 19851.000000 COUNT : 444 SUM : 3317436
rocksdb.compaction.outfile.sync.micros P50 : 8662.500000 P95 : 19897.435897 P99 : 20425.000000 P100 : 20425.000000 COUNT : 205 SUM : 1858978
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2541.304348 P95 : 7597.500000 P99 : 12404.416667 P100 : 15266.000000 COUNT : 567 SUM : 1711182
rocksdb.table.open.io.micros P50 : 3656.818182 P95 : 31382.352941 P99 : 69545.454545 P100 : 161013.000000 COUNT : 640 SUM : 5586999
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.049513 P95 : 46.778506 P99 : 94.998510 P100 : 31378.000000 COUNT : 12572791 SUM : 284454417
rocksdb.read.block.get.micros P50 : 20.467842 P95 : 107.308502 P99 : 609.671760 P100 : 120452.000000 COUNT : 71581108 SUM : 6520881670
rocksdb.write.raw.block.micros P50 : 2.686856 P95 : 12.958579 P99 : 21.061155 P100 : 35024.000000 COUNT : 17367011 SUM : 87780369
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.514886 P95 : 0.978283 P99 : 2.602639 P100 : 22586.000000 COUNT : 84155819 SUM : 36446713
rocksdb.file.read.flush.micros P50 : 0.509954 P95 : 0.968913 P99 : 1.704444 P100 : 5.000000 COUNT : 2664 SUM : 894
rocksdb.file.read.compaction.micros P50 : 0.566012 P95 : 2.678872 P99 : 4.926265 P100 : 10153.000000 COUNT : 12574545 SUM : 10121524
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.683207 P95 : 4.504876 P99 : 9.090606 P100 : 30849.000000 COUNT : 34734671 SUM : 55951726
rocksdb.file.write.flush.micros P50 : 0.623307 P95 : 1.940324 P99 : 5.060630 P100 : 12135.000000 COUNT : 9607810 SUM : 11689928
rocksdb.file.write.compaction.micros P50 : 0.709270 P95 : 5.299654 P99 : 9.455126 P100 : 30849.000000 COUNT : 25126861 SUM : 44261798
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7477033 SUM : 0
rocksdb.bytes.per.write P50 : 2564.308407 P95 : 6569.235911 P99 : 9394.576395 P100 : 12932.000000 COUNT : 8643913 SUM : 29077225956
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140327868.852459 P95 : 258000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 444 SUM : 63731042776
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 627 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:32:28.781888 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:32:28.782370 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741599148 to in-memory stats history
2025/03/10-02:32:28.782880 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:32:28.783787 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
2025/03/10-02:33:22.763101 3670 EVENT_LOG_v1 {"time_micros": 1741599202762501, "cf_name": "com.neocoretechs.relatrix.RangeDomainMap", "job": 785, "event": "table_file_creation", "file_number": 1117, "file_size": 9406249, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44251921, "largest_seqno": 44853340, "table_properties": {"data_size": 8622560, "index_size": 5834291, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11118, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeDomainMap", "column_family_id": 3, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44853340, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592433, "oldest_key_time": 1741599045, "newest_key_time": 1741592433, "file_creation_time": 1741599045, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1117, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:33:22.764431 3670 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.RangeDomainMap] [JOB 785] Flush lasted 157241746 microseconds, and 0 cpu microseconds.
2025/03/10-02:33:22.865640 3670 (Original Log Time 2025/03/10-02:33:22.763325) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.RangeDomainMap] [JOB 785] Level-0 flush table #1117: 9406249 bytes OK
2025/03/10-02:33:22.865676 3670 (Original Log Time 2025/03/10-02:33:22.765304) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.RangeDomainMap] Level-0 commit flush result of table #1117 started
2025/03/10-02:33:22.865685 3670 (Original Log Time 2025/03/10-02:33:22.864924) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.RangeDomainMap] Level-0 commit flush result of table #1117: memtable #1 done
2025/03/10-02:33:22.865691 3670 (Original Log Time 2025/03/10-02:33:22.865047) EVENT_LOG_v1 {"time_micros": 1741599202865015, "job": 785, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [3, 0, 0, 0, 0, 5, 5], "immutable_memtables": 0}
2025/03/10-02:33:22.865698 3670 (Original Log Time 2025/03/10-02:33:22.865139) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.RangeDomainMap] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[3 0 0 0 0 5 5] max score 0.79, estimated pending compaction bytes 0
2025/03/10-02:33:22.865714 3670 [db\db_impl\db_impl_files.cc:496] [JOB 785] Try to delete WAL files size 9073284, prev total WAL file size 399074312, number of live WAL files 7.
2025/03/10-02:33:22.866519 3670 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001090.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5469225557, max_trash_db_ratio 0.250000
2025/03/10-02:33:26.879561 4908 [db\db_impl\db_impl_write.cc:2474] [default] New memtable created with log file: #1118. Immutable memtables: 0.
2025/03/10-02:33:26.879691 4908 [db\column_family.cc:1099] [default] Increasing compaction threads because of estimated pending compaction bytes 544477314
2025/03/10-02:33:26.880049 371c [db\db_impl\db_impl.cc:1676] [JOB 786] Syncing log #1116
2025/03/10-02:33:26.893188 371c (Original Log Time 2025/03/10-02:33:26.880014) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [default], flush slots available 6, compaction slots available 18, flush slots scheduled 1, compaction slots scheduled 5
2025/03/10-02:33:26.893248 371c [db\flush_job.cc:906] [default] [JOB 786] Flushing memtable id 75 with next log file: 1118
2025/03/10-02:33:26.893311 371c EVENT_LOG_v1 {"time_micros": 1741599206893284, "job": 786, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66850904, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:33:26.893324 371c [db\flush_job.cc:952] [default] [JOB 786] Level-0 flush table #1119: started
2025/03/10-02:33:36.583905 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.RangeMapDomain] New memtable created with log file: #1120. Immutable memtables: 0.
2025/03/10-02:33:36.584238 1664 [db\db_impl\db_impl.cc:1676] [JOB 787] Syncing log #1118
2025/03/10-02:33:36.587412 1664 (Original Log Time 2025/03/10-02:33:36.584218) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.RangeMapDomain], flush slots available 6, compaction slots available 18, flush slots scheduled 2, compaction slots scheduled 5
2025/03/10-02:33:36.587433 1664 [db\flush_job.cc:906] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Flushing memtable id 75 with next log file: 1120
2025/03/10-02:33:36.587474 1664 EVENT_LOG_v1 {"time_micros": 1741599216587453, "job": 787, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66850992, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:33:36.587483 1664 [db\flush_job.cc:952] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Level-0 flush table #1121: started
2025/03/10-02:34:10.179621 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.DomainRangeMap] New memtable created with log file: #1122. Immutable memtables: 0.
2025/03/10-02:34:10.179767 4908 [db\column_family.cc:1099] [com.neocoretechs.relatrix.DomainRangeMap] Increasing compaction threads because of estimated pending compaction bytes 542398748
2025/03/10-02:34:10.180282 4690 [db\db_impl\db_impl.cc:1676] [JOB 788] Syncing log #1120
2025/03/10-02:34:10.184738 4690 (Original Log Time 2025/03/10-02:34:10.180205) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.DomainRangeMap], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 5
2025/03/10-02:34:10.184794 4690 [db\flush_job.cc:906] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Flushing memtable id 75 with next log file: 1122
2025/03/10-02:34:10.184866 4690 EVENT_LOG_v1 {"time_micros": 1741599250184834, "job": 788, "event": "flush_started", "num_memtables": 1, "num_entries": 100240, "num_deletes": 0, "total_data_size": 65356480, "memory_usage": 66849904, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:34:10.184877 4690 [db\flush_job.cc:952] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Level-0 flush table #1123: started
2025/03/10-02:35:06.675765 3a44 [db\compaction\compaction_job.cc:1672] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 766] Generated table #1114: 236259 keys, 21698156 bytes, temperature: kUnknown
2025/03/10-02:35:06.675972 3a44 EVENT_LOG_v1 {"time_micros": 1741599306675852, "cf_name": "com.neocoretechs.relatrix.RangeMapDomain", "job": 766, "event": "table_file_creation", "file_number": 1114, "file_size": 21698156, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 27487300, "largest_seqno": 43665381, "table_properties": {"data_size": 19967491, "index_size": 12677770, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 295365, "raw_key_size": 122854680, "raw_average_key_size": 520, "raw_value_size": 30241152, "raw_average_value_size": 128, "num_data_blocks": 24153, "num_entries": 236259, "num_filter_entries": 236259, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeMapDomain", "column_family_id": 2, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 43665381, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741568512, "oldest_key_time": 1741584538, "newest_key_time": 0, "file_creation_time": 1741598188, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1114, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:35:07.368211 3a44 (Original Log Time 2025/03/10-02:35:07.212389) [db\compaction\compaction_job.cc:1746] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 766] Compacted 5@0 files to L5 => 245417867 bytes
2025/03/10-02:35:07.368358 3a44 (Original Log Time 2025/03/10-02:35:07.367891) [db\compaction\compaction_job.cc:933] [com.neocoretechs.relatrix.RangeMapDomain] compacted to: base level 5 level multiplier 10.00 max bytes base 268435456 files[1 0 0 0 0 5 6] max score 0.91, estimated pending compaction bytes 0, MB/sec: 0.0 rd, 0.0 wr, level 5, files in(5, 0) filtered(0, 0) out(5 +0 blob) MB in(235.5, 0.0 +0.0 blob) filtered(0.0, 0.0) out(234.0 +0.0 blob), read-write-amplify(2.0) write-amplify(1.0) OK, records in: 2696352, records dropped: 0 output_compression: Snappy
2025/03/10-02:35:07.368387 3a44 (Original Log Time 2025/03/10-02:35:07.368001) EVENT_LOG_v1 {"time_micros": 1741599307367932, "job": 766, "event": "compaction_finished", "compaction_time_micros": 14086083179, "compaction_time_cpu_micros": 0, "output_level": 5, "num_output_files": 5, "total_output_size": 245417867, "num_input_records": 2696352, "num_output_records": 2696352, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [1, 0, 0, 0, 0, 5, 6]}
2025/03/10-02:36:16.379825 371c EVENT_LOG_v1 {"time_micros": 1741599376379532, "cf_name": "default", "job": 786, "event": "table_file_creation", "file_number": 1119, "file_size": 10233173, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44265905, "largest_seqno": 44867324, "table_properties": {"data_size": 9343957, "index_size": 5844940, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11138, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44867324, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592588, "oldest_key_time": 1741599206, "newest_key_time": 1741592588, "file_creation_time": 1741599206, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1119, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:36:16.380050 371c [db\flush_job.cc:1100] [default] [JOB 786] Flush lasted 169486870 microseconds, and 0 cpu microseconds.
2025/03/10-02:36:16.477078 371c [db\column_family.cc:1099] [default] Increasing compaction threads because of estimated pending compaction bytes 573108288
2025/03/10-02:36:16.477548 371c (Original Log Time 2025/03/10-02:36:16.380017) [db\flush_job.cc:1052] [default] [JOB 786] Level-0 flush table #1119: 10233173 bytes OK
2025/03/10-02:36:16.477568 371c (Original Log Time 2025/03/10-02:36:16.380093) [db\memtable_list.cc:584] [default] Level-0 commit flush result of table #1119 started
2025/03/10-02:36:16.477575 371c (Original Log Time 2025/03/10-02:36:16.476967) [db\memtable_list.cc:789] [default] Level-0 commit flush result of table #1119: memtable #1 done
2025/03/10-02:36:16.477603 371c (Original Log Time 2025/03/10-02:36:16.477065) EVENT_LOG_v1 {"time_micros": 1741599376477033, "job": 786, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [6, 0, 0, 0, 0, 4, 6], "immutable_memtables": 0}
2025/03/10-02:36:16.477617 371c (Original Log Time 2025/03/10-02:36:16.477143) [db\db_impl\db_impl_compaction_flush.cc:319] [default] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[6 0 0 0 0 4 6] max score 0.25, estimated pending compaction bytes 573108288
2025/03/10-02:36:16.477630 371c [db\db_impl\db_impl_files.cc:496] [JOB 786] Try to delete WAL files size 594332, prev total WAL file size 400686016, number of live WAL files 9.
2025/03/10-02:36:16.478379 371c [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001093.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5501156886, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.117721 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.MapRangeDomain] New memtable created with log file: #1124. Immutable memtables: 0.
2025/03/10-02:36:26.118136 2630 [db\db_impl\db_impl.cc:1676] [JOB 789] Syncing log #1122
2025/03/10-02:36:26.121586 2630 (Original Log Time 2025/03/10-02:36:26.118102) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.MapRangeDomain], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 4
2025/03/10-02:36:26.121636 2630 [db\flush_job.cc:906] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Flushing memtable id 75 with next log file: 1124
2025/03/10-02:36:26.121699 2630 EVENT_LOG_v1 {"time_micros": 1741599386121669, "job": 789, "event": "flush_started", "num_memtables": 1, "num_entries": 100244, "num_deletes": 0, "total_data_size": 65359088, "memory_usage": 66851432, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:36:26.121715 2630 [db\flush_job.cc:952] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Level-0 flush table #1125: started
2025/03/10-02:36:26.147983 1664 EVENT_LOG_v1 {"time_micros": 1741599386147879, "cf_name": "com.neocoretechs.relatrix.RangeMapDomain", "job": 787, "event": "table_file_creation", "file_number": 1121, "file_size": 9291179, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44266821, "largest_seqno": 44868240, "table_properties": {"data_size": 8532140, "index_size": 5406035, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 10302, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.RangeMapDomain", "column_family_id": 2, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44868240, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592598, "oldest_key_time": 1741599216, "newest_key_time": 1741592598, "file_creation_time": 1741599216, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1121, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:36:26.148127 1664 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Flush lasted 169560717 microseconds, and 0 cpu microseconds.
2025/03/10-02:36:26.278810 1664 (Original Log Time 2025/03/10-02:36:26.148059) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.RangeMapDomain] [JOB 787] Level-0 flush table #1121: 9291179 bytes OK
2025/03/10-02:36:26.278848 1664 (Original Log Time 2025/03/10-02:36:26.148161) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.RangeMapDomain] Level-0 commit flush result of table #1121 started
2025/03/10-02:36:26.278855 1664 (Original Log Time 2025/03/10-02:36:26.278221) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.RangeMapDomain] Level-0 commit flush result of table #1121: memtable #1 done
2025/03/10-02:36:26.278860 1664 (Original Log Time 2025/03/10-02:36:26.278351) EVENT_LOG_v1 {"time_micros": 1741599386278321, "job": 787, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [2, 0, 0, 0, 0, 5, 6], "immutable_memtables": 0}
2025/03/10-02:36:26.278865 1664 (Original Log Time 2025/03/10-02:36:26.278415) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.RangeMapDomain] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[2 0 0 0 0 5 6] max score 0.91, estimated pending compaction bytes 0
2025/03/10-02:36:26.354724 1664 [db\db_impl\db_impl_files.cc:496] [JOB 787] Try to delete WAL files size 2094436, prev total WAL file size 400683420, number of live WAL files 9.
2025/03/10-02:36:26.384832 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/000937.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5510448065, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.384995 1664 EVENT_LOG_v1 {"time_micros": 1741599386384968, "job": 787, "event": "table_file_deletion", "file_number": 937}
2025/03/10-02:36:26.399378 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/000980.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5355396571, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.399495 1664 EVENT_LOG_v1 {"time_micros": 1741599386399475, "job": 787, "event": "table_file_deletion", "file_number": 980}
2025/03/10-02:36:26.410848 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001039.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5318734090, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.410937 1664 EVENT_LOG_v1 {"time_micros": 1741599386410917, "job": 787, "event": "table_file_deletion", "file_number": 1039}
2025/03/10-02:36:26.419833 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001047.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5282054591, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.419978 1664 EVENT_LOG_v1 {"time_micros": 1741599386419959, "job": 787, "event": "table_file_deletion", "file_number": 1047}
2025/03/10-02:36:26.423087 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001066.sst immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5272813986, max_trash_db_ratio 0.250000
2025/03/10-02:36:26.423189 1664 EVENT_LOG_v1 {"time_micros": 1741599386423170, "job": 787, "event": "table_file_deletion", "file_number": 1066}
2025/03/10-02:36:26.423971 1664 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001095.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5263522296, max_trash_db_ratio 0.250000
2025/03/10-02:37:03.464137 4908 [db\db_impl\db_impl_write.cc:2474] [com.neocoretechs.relatrix.MapDomainRange] New memtable created with log file: #1126. Immutable memtables: 0.
2025/03/10-02:37:03.464215 4908 [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapDomainRange] Increasing compaction threads because of estimated pending compaction bytes 623824574
2025/03/10-02:37:03.464598 1dbc [db\db_impl\db_impl.cc:1676] [JOB 790] Syncing log #1124
2025/03/10-02:37:03.468917 1dbc (Original Log Time 2025/03/10-02:37:03.464544) [db\db_impl\db_impl_compaction_flush.cc:3287] Calling FlushMemTableToOutputFile with column family [com.neocoretechs.relatrix.MapDomainRange], flush slots available 6, compaction slots available 18, flush slots scheduled 3, compaction slots scheduled 4
2025/03/10-02:37:03.468997 1dbc [db\flush_job.cc:906] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Flushing memtable id 75 with next log file: 1126
2025/03/10-02:37:03.469076 1dbc EVENT_LOG_v1 {"time_micros": 1741599423469049, "job": 790, "event": "flush_started", "num_memtables": 1, "num_entries": 100232, "num_deletes": 0, "total_data_size": 65351264, "memory_usage": 66851824, "num_range_deletes": 0, "flush_reason": "Write Buffer Full"}
2025/03/10-02:37:03.469088 1dbc [db\flush_job.cc:952] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Level-0 flush table #1127: started
2025/03/10-02:38:18.574279 4690 EVENT_LOG_v1 {"time_micros": 1741599498574213, "cf_name": "com.neocoretechs.relatrix.DomainRangeMap", "job": 788, "event": "table_file_creation", "file_number": 1123, "file_size": 10212447, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44270049, "largest_seqno": 44871468, "table_properties": {"data_size": 9343356, "index_size": 5844415, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52124800, "raw_average_key_size": 520, "raw_value_size": 12830720, "raw_average_value_size": 128, "num_data_blocks": 11137, "num_entries": 100240, "num_filter_entries": 100240, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.DomainRangeMap", "column_family_id": 5, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44871468, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592632, "oldest_key_time": 1741599250, "newest_key_time": 1741592632, "file_creation_time": 1741599250, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1123, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:38:18.574340 4690 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Flush lasted 248389610 microseconds, and 0 cpu microseconds.
2025/03/10-02:38:18.686859 4690 [db\column_family.cc:1099] [com.neocoretechs.relatrix.DomainRangeMap] Increasing compaction threads because of estimated pending compaction bytes 570971153
2025/03/10-02:38:18.687545 4690 (Original Log Time 2025/03/10-02:38:18.574327) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 788] Level-0 flush table #1123: 10212447 bytes OK
2025/03/10-02:38:18.687570 4690 (Original Log Time 2025/03/10-02:38:18.574348) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.DomainRangeMap] Level-0 commit flush result of table #1123 started
2025/03/10-02:38:18.687579 4690 (Original Log Time 2025/03/10-02:38:18.686666) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.DomainRangeMap] Level-0 commit flush result of table #1123: memtable #1 done
2025/03/10-02:38:18.687584 4690 (Original Log Time 2025/03/10-02:38:18.686811) EVENT_LOG_v1 {"time_micros": 1741599498686774, "job": 788, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [6, 0, 0, 0, 0, 4, 6], "immutable_memtables": 0}
2025/03/10-02:38:18.687589 4690 (Original Log Time 2025/03/10-02:38:18.686959) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.DomainRangeMap] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[6 0 0 0 0 4 6] max score 0.25, estimated pending compaction bytes 570971153
2025/03/10-02:38:18.687645 4690 [db\db_impl\db_impl_files.cc:496] [JOB 788] Try to delete WAL files size 8328496, prev total WAL file size 405814392, number of live WAL files 9.
2025/03/10-02:38:18.688769 4690 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001097.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5273734743, max_trash_db_ratio 0.250000
2025/03/10-02:39:12.444091 2630 EVENT_LOG_v1 {"time_micros": 1741599552444033, "cf_name": "com.neocoretechs.relatrix.MapRangeDomain", "job": 789, "event": "table_file_creation", "file_number": 1125, "file_size": 9564067, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44282885, "largest_seqno": 44884328, "table_properties": {"data_size": 8793532, "index_size": 5406501, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52126880, "raw_average_key_size": 520, "raw_value_size": 12831232, "raw_average_value_size": 128, "num_data_blocks": 10303, "num_entries": 100244, "num_filter_entries": 100244, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.MapRangeDomain", "column_family_id": 4, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44884328, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592769, "oldest_key_time": 1741599386, "newest_key_time": 1741592769, "file_creation_time": 1741599386, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1125, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:39:12.444173 2630 [db\flush_job.cc:1100] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Flush lasted 166322594 microseconds, and 0 cpu microseconds.
2025/03/10-02:39:12.546928 2630 [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapRangeDomain] Increasing compaction threads because of estimated pending compaction bytes 552612976
2025/03/10-02:39:12.547586 2630 (Original Log Time 2025/03/10-02:39:12.444149) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.MapRangeDomain] [JOB 789] Level-0 flush table #1125: 9564067 bytes OK
2025/03/10-02:39:12.547614 2630 (Original Log Time 2025/03/10-02:39:12.444186) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.MapRangeDomain] Level-0 commit flush result of table #1125 started
2025/03/10-02:39:12.547620 2630 (Original Log Time 2025/03/10-02:39:12.546760) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.MapRangeDomain] Level-0 commit flush result of table #1125: memtable #1 done
2025/03/10-02:39:12.547624 2630 (Original Log Time 2025/03/10-02:39:12.546907) EVENT_LOG_v1 {"time_micros": 1741599552546868, "job": 789, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [5, 0, 0, 0, 0, 5, 5], "immutable_memtables": 0}
2025/03/10-02:39:12.547631 2630 (Original Log Time 2025/03/10-02:39:12.547018) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.MapRangeDomain] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[5 0 0 0 0 5 5] max score 0.25, estimated pending compaction bytes 552612976
2025/03/10-02:39:12.547651 2630 [db\db_impl\db_impl_files.cc:496] [JOB 789] Try to delete WAL files size 2372136, prev total WAL file size 400927308, number of live WAL files 8.
2025/03/10-02:39:12.548821 2630 [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001099.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5283298810, max_trash_db_ratio 0.250000
2025/03/10-02:40:55.193050 1dbc EVENT_LOG_v1 {"time_micros": 1741599655192992, "cf_name": "com.neocoretechs.relatrix.MapDomainRange", "job": 790, "event": "table_file_creation", "file_number": 1127, "file_size": 10393393, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 44286541, "largest_seqno": 44887912, "table_properties": {"data_size": 9563253, "index_size": 5844175, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 125317, "raw_key_size": 52120640, "raw_average_key_size": 520, "raw_value_size": 12829696, "raw_average_value_size": 128, "num_data_blocks": 11137, "num_entries": 100232, "num_filter_entries": 100232, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.MapDomainRange", "column_family_id": 1, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44887912, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741592808, "oldest_key_time": 1741599423, "newest_key_time": 1741592808, "file_creation_time": 1741599423, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1127, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:40:55.193133 1dbc [db\flush_job.cc:1100] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Flush lasted 231724228 microseconds, and 0 cpu microseconds.
2025/03/10-02:40:55.317272 1dbc [db\column_family.cc:1099] [com.neocoretechs.relatrix.MapDomainRange] Increasing compaction threads because of estimated pending compaction bytes 650907564
2025/03/10-02:40:55.318044 1dbc (Original Log Time 2025/03/10-02:40:55.193114) [db\flush_job.cc:1052] [com.neocoretechs.relatrix.MapDomainRange] [JOB 790] Level-0 flush table #1127: 10393393 bytes OK
2025/03/10-02:40:55.318088 1dbc (Original Log Time 2025/03/10-02:40:55.193143) [db\memtable_list.cc:584] [com.neocoretechs.relatrix.MapDomainRange] Level-0 commit flush result of table #1127 started
2025/03/10-02:40:55.318103 1dbc (Original Log Time 2025/03/10-02:40:55.317089) [db\memtable_list.cc:789] [com.neocoretechs.relatrix.MapDomainRange] Level-0 commit flush result of table #1127: memtable #1 done
2025/03/10-02:40:55.318109 1dbc (Original Log Time 2025/03/10-02:40:55.317244) EVENT_LOG_v1 {"time_micros": 1741599655317203, "job": 790, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [5, 0, 0, 0, 0, 6, 5], "immutable_memtables": 0}
2025/03/10-02:40:55.318115 1dbc (Original Log Time 2025/03/10-02:40:55.317385) [db\db_impl\db_impl_compaction_flush.cc:319] [com.neocoretechs.relatrix.MapDomainRange] Level summary: base level 5 level multiplier 10.00 max bytes base 268435456 files[5 0 0 0 0 6 5] max score 0.25, estimated pending compaction bytes 650907564
2025/03/10-02:40:55.318136 1dbc [db\db_impl\db_impl_files.cc:496] [JOB 790] Try to delete WAL files size 367771924, prev total WAL file size 404851452, number of live WAL files 7.
2025/03/10-02:40:55.420278 1dbc [file\delete_scheduler.cc:78] Deleted file c:\etc\db\Relatrix2\NasaApacheJul95com.neocoretechs.relatrix.Relation/001102.log immediately, rate_bytes_per_sec 0, total_trash_size 0, total_size 5293692203, max_trash_db_ratio 0.250000
2025/03/10-02:42:27.915281 10f0 [db\db_impl\db_impl.cc:1210] ------- DUMPING STATS -------
2025/03/10-02:42:27.915446 10f0 [db\db_impl\db_impl.cc:1211]
** DB Stats **
Uptime(secs): 49213.0 total, 600.0 interval
Cumulative writes: 11M writes, 44M keys, 8658K commit groups, 1.3 writes per commit group, ingest: 27.11 GB, 0.56 MB/s
Cumulative WAL: 11M writes, 0 syncs, 11235888.00 writes per sync, written: 27.11 GB, 0.56 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 14K writes, 56K keys, 14K commit groups, 1.0 writes per commit group, ingest: 35.14 MB, 0.06 MB/s
Interval WAL: 14K writes, 0 syncs, 14196.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 6/5 117.61 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.6 0.0 0.1 23850.34 0.00 87 274.142 4789K 0 0.0 0.0
L5 4/4 233.24 MB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 1.6 0.0 0.0 19999.34 0.00 2 9999.668 4893K 0 0.0 0.0
L6 6/0 372.99 MB 0.0 0.9 0.4 0.5 0.9 0.4 0.0 2.4 0.1 0.0 18283.37 0.00 6 3047.229 9502K 0 0.0 0.0
Sum 16/9 723.85 MB 0.0 1.8 0.7 1.2 2.5 1.4 0.0 3.5 0.0 0.0 62133.05 0.00 95 654.032 19M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 169.49 0.00 1 169.487 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.7 1.2 1.8 0.7 0.0 0.0 0.0 0.0 51089.19 0.00 20 2554.459 19M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 11043.86 0.00 75 147.251 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49213.0 total, 600.0 interval
Flush(GB): cumulative 0.717, interval 0.010
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.53 GB write, 0.05 MB/s write, 1.83 GB read, 0.04 MB/s read, 62133.1 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 169.5 seconds
Estimated pending compaction bytes: 573108288
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4808E5F0#8424 capacity: 64.00 KB seed: 679176613 usage: 552.62 MB table_size: 1024 occupancy: 128 collections: 83 last_copies: 0 last_secs: 0.000236 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(94,377.84 KB,590.373%) IndexBlock(26,552.21 MB,883542%) Misc(7,24.07 KB,37.6068%)
** File Read Latency Histogram By Level [default] **
** Level 0 read latency histogram (micros):
Count: 57949178 Average: 0.3114 StdDev: 10.83
Min: 0 Median: 0.5049 Max: 17689
Percentiles: P50: 0.50 P75: 0.76 P99: 1.00 P99.9: 3.52 P99.99: 18.68
------------------------------------------------------
[ 0, 1 ] 57386333 99.029% 99.029% ####################
( 1, 2 ] 396990 0.685% 99.714%
( 2, 3 ] 91972 0.159% 99.873%
( 3, 4 ] 30936 0.053% 99.926%
( 4, 6 ] 17620 0.030% 99.956%
( 6, 10 ] 12980 0.022% 99.979%
( 10, 15 ] 5062 0.009% 99.987%
( 15, 22 ] 2837 0.005% 99.992%
( 22, 34 ] 1352 0.002% 99.995%
( 34, 51 ] 796 0.001% 99.996%
( 51, 76 ] 585 0.001% 99.997%
( 76, 110 ] 306 0.001% 99.998%
( 110, 170 ] 443 0.001% 99.998%
( 170, 250 ] 466 0.001% 99.999%
( 250, 380 ] 244 0.000% 100.000%
( 380, 580 ] 149 0.000% 100.000%
( 580, 870 ] 63 0.000% 100.000%
( 870, 1300 ] 49 0.000% 100.000%
( 1300, 1900 ] 25 0.000% 100.000%
( 1900, 2900 ] 18 0.000% 100.000%
( 2900, 4400 ] 23 0.000% 100.000%
( 4400, 6600 ] 27 0.000% 100.000%
( 6600, 9900 ] 17 0.000% 100.000%
( 9900, 14000 ] 17 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 4722629 Average: 0.8465 StdDev: 33.76
Min: 0 Median: 0.5409 Max: 18132
Percentiles: P50: 0.54 P75: 0.81 P99: 3.74 P99.9: 15.48 P99.99: 248.46
------------------------------------------------------
[ 0, 1 ] 4365456 92.437% 92.437% ##################
( 1, 2 ] 216051 4.575% 97.012% #
( 2, 3 ] 66688 1.412% 98.424%
( 3, 4 ] 36886 0.781% 99.205%
( 4, 6 ] 25206 0.534% 99.739%
( 6, 10 ] 4488 0.095% 99.834%
( 10, 15 ] 3002 0.064% 99.897%
( 15, 22 ] 1878 0.040% 99.937%
( 22, 34 ] 841 0.018% 99.955%
( 34, 51 ] 451 0.010% 99.964%
( 51, 76 ] 304 0.006% 99.971%
( 76, 110 ] 208 0.004% 99.975%
( 110, 170 ] 327 0.007% 99.982%
( 170, 250 ] 378 0.008% 99.990%
( 250, 380 ] 196 0.004% 99.994%
( 380, 580 ] 115 0.002% 99.997%
( 580, 870 ] 45 0.001% 99.998%
( 870, 1300 ] 31 0.001% 99.998%
( 1300, 1900 ] 26 0.001% 99.999%
( 1900, 2900 ] 28 0.001% 99.999%
( 2900, 4400 ] 15 0.000% 100.000%
( 4400, 6600 ] 11 0.000% 100.000%
( 6600, 9900 ] 13 0.000% 100.000%
( 9900, 14000 ] 14 0.000% 100.001%
( 14000, 22000 ] 7 0.000% 100.001%
** Level 6 read latency histogram (micros):
Count: 11850015 Average: 0.5676 StdDev: 23.47
Min: 0 Median: 0.5152 Max: 22586
Percentiles: P50: 0.52 P75: 0.77 P99: 2.12 P99.9: 8.97 P99.99: 165.17
------------------------------------------------------
[ 0, 1 ] 11500359 97.049% 97.049% ###################
( 1, 2 ] 224725 1.896% 98.946%
( 2, 3 ] 55886 0.472% 99.417%
( 3, 4 ] 31652 0.267% 99.684%
( 4, 6 ] 21438 0.181% 99.865%
( 6, 10 ] 5536 0.047% 99.912%
( 10, 15 ] 3888 0.033% 99.945%
( 15, 22 ] 2417 0.020% 99.965%
( 22, 34 ] 1086 0.009% 99.974%
( 34, 51 ] 678 0.006% 99.980%
( 51, 76 ] 460 0.004% 99.984%
( 76, 110 ] 282 0.002% 99.986%
( 110, 170 ] 460 0.004% 99.990%
( 170, 250 ] 518 0.004% 99.995%
( 250, 380 ] 277 0.002% 99.997%
( 380, 580 ] 140 0.001% 99.998%
( 580, 870 ] 73 0.001% 99.999%
( 870, 1300 ] 43 0.000% 99.999%
( 1300, 1900 ] 23 0.000% 99.999%
( 1900, 2900 ] 24 0.000% 100.000%
( 2900, 4400 ] 16 0.000% 100.000%
( 4400, 6600 ] 13 0.000% 100.000%
( 6600, 9900 ] 22 0.000% 100.000%
( 9900, 14000 ] 10 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
( 22000, 33000 ] 2 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 138.12 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.7 0.0 0.0 27393.10 0.00 88 311.285 5189K 0 0.0 0.0
L5 6/5 244.44 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 15581.11 0.00 1 15581.113 2496K 0 0.0 0.0
L6 5/0 337.37 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.3 0.0 0.0 18723.88 0.00 5 3744.776 8859K 0 0.0 0.0
Sum 16/9 719.94 MB 0.0 1.6 0.6 1.0 2.3 1.3 0.0 3.1 0.0 0.0 61698.09 0.00 94 656.363 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 231.72 0.00 1 231.724 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 0.0 0.0 51268.12 0.00 19 2698.322 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10429.98 0.00 75 139.066 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49213.0 total, 600.0 interval
Flush(GB): cumulative 0.725, interval 0.010
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.28 GB write, 0.05 MB/s write, 1.58 GB read, 0.03 MB/s read, 61698.1 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 231.7 seconds
Estimated pending compaction bytes: 650907564
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B145800#8424 capacity: 64.00 KB seed: 679176613 usage: 20.09 KB table_size: 1024 occupancy: 6 collections: 83 last_copies: 0 last_secs: 9.7e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,19.58 KB,30.5923%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapDomainRange] **
** Level 0 read latency histogram (micros):
Count: 1326256 Average: 0.6955 StdDev: 2.06
Min: 0 Median: 0.5462 Max: 2084
Percentiles: P50: 0.55 P75: 0.82 P99: 3.73 P99.9: 5.83 P99.99: 14.10
------------------------------------------------------
[ 0, 1 ] 1214027 91.538% 91.538% ##################
( 1, 2 ] 55827 4.209% 95.747% #
( 2, 3 ] 30142 2.273% 98.020%
( 3, 4 ] 17699 1.335% 99.354%
( 4, 6 ] 7915 0.597% 99.951%
( 6, 10 ] 365 0.028% 99.979%
( 10, 15 ] 181 0.014% 99.992%
( 15, 22 ] 64 0.005% 99.997%
( 22, 34 ] 14 0.001% 99.998%
( 34, 51 ] 8 0.001% 99.999%
( 51, 76 ] 7 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 3 0.000% 100.000%
( 170, 250 ] 2 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 1900, 2900 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 140390 Average: 1.2136 StdDev: 1.02
Min: 0 Median: 0.6531 Max: 225
Percentiles: P50: 0.65 P75: 0.98 P99: 3.63 P99.9: 5.81 P99.99: 17.17
------------------------------------------------------
[ 0, 1 ] 107478 76.557% 76.557% ###############
( 1, 2 ] 25082 17.866% 94.423% ####
( 2, 3 ] 5064 3.607% 98.030% #
( 3, 4 ] 2150 1.531% 99.561%
( 4, 6 ] 525 0.374% 99.935%
( 6, 10 ] 22 0.016% 99.951%
( 10, 15 ] 50 0.036% 99.986%
( 15, 22 ] 16 0.011% 99.998%
( 22, 34 ] 2 0.001% 99.999%
( 170, 250 ] 1 0.001% 100.000%
** Level 6 read latency histogram (micros):
Count: 585868 Average: 0.4337 StdDev: 0.52
Min: 0 Median: 0.5019 Max: 70
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.81 P99.99: 3.07
------------------------------------------------------
[ 0, 1 ] 583635 99.619% 99.619% ####################
( 1, 2 ] 2027 0.346% 99.965%
( 2, 3 ] 146 0.025% 99.990%
( 3, 4 ] 19 0.003% 99.993%
( 4, 6 ] 14 0.002% 99.995%
( 6, 10 ] 21 0.004% 99.999%
( 10, 15 ] 3 0.001% 99.999%
( 22, 34 ] 1 0.000% 100.000%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 17.70 MB 0.5 0.6 0.0 0.6 1.2 0.6 0.0 1.9 0.0 0.0 33659.09 0.00 88 382.490 6492K 0 0.0 0.0
L5 5/0 234.05 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14086.08 0.00 1 14086.083 2696K 0 0.0 0.0
L6 6/0 382.27 MB 0.0 1.0 0.4 0.6 1.0 0.4 0.0 2.4 0.0 0.0 28876.18 0.00 6 4812.697 11M 0 0.0 0.0
Sum 13/0 634.02 MB 0.0 1.8 0.6 1.1 2.4 1.2 0.0 3.7 0.0 0.0 76621.35 0.00 95 806.541 20M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 27.4 0.0 0.0 14255.64 0.00 2 7127.822 2696K 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.6 1.1 1.7 0.6 0.0 0.0 0.0 0.0 65740.36 0.00 20 3287.018 20M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.6 0.6 0.0 0.0 0.0 0.1 10881.00 0.00 75 145.080 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.649, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.39 GB write, 0.05 MB/s write, 1.77 GB read, 0.04 MB/s read, 76621.4 seconds
Interval compaction: 0.24 GB write, 0.40 MB/s write, 0.23 GB read, 0.39 MB/s read, 14255.6 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1451A0#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 83 last_copies: 0 last_secs: 0.000106 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeMapDomain] **
** Level 0 read latency histogram (micros):
Count: 1413077 Average: 1.2271 StdDev: 9.64
Min: 0 Median: 0.6627 Max: 8104
Percentiles: P50: 0.66 P75: 0.99 P99: 5.71 P99.9: 9.22 P99.99: 21.21
------------------------------------------------------
[ 0, 1 ] 1066214 75.453% 75.453% ###############
( 1, 2 ] 109660 7.760% 83.214% ##
( 2, 3 ] 81218 5.748% 88.961% #
( 3, 4 ] 83713 5.924% 94.885% #
( 4, 6 ] 68155 4.823% 99.709% #
( 6, 10 ] 3364 0.238% 99.947%
( 10, 15 ] 278 0.020% 99.966%
( 15, 22 ] 376 0.027% 99.993%
( 22, 34 ] 91 0.006% 99.999%
( 34, 51 ] 10 0.001% 100.000%
( 51, 76 ] 5 0.000% 100.000%
( 76, 110 ] 3 0.000% 100.001%
( 110, 170 ] 5 0.000% 100.001%
( 170, 250 ] 3 0.000% 100.001%
( 250, 380 ] 6 0.000% 100.002%
( 380, 580 ] 3 0.000% 100.002%
( 580, 870 ] 1 0.000% 100.002%
( 870, 1300 ] 1 0.000% 100.002%
( 2900, 4400 ] 2 0.000% 100.002%
( 4400, 6600 ] 1 0.000% 100.002%
( 6600, 9900 ] 1 0.000% 100.002%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.2000 StdDev: 1.64
Min: 0 Median: 0.6250 Max: 7
Percentiles: P50: 0.62 P75: 0.94 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 24 80.000% 80.000% ################
( 1, 2 ] 1 3.333% 83.333% #
( 2, 3 ] 2 6.667% 90.000% #
( 3, 4 ] 1 3.333% 93.333% #
( 4, 6 ] 1 3.333% 96.667% #
( 6, 10 ] 1 3.333% 100.000% #
** Level 6 read latency histogram (micros):
Count: 729569 Average: 0.6299 StdDev: 0.96
Min: 0 Median: 0.5363 Max: 228
Percentiles: P50: 0.54 P75: 0.80 P99: 3.88 P99.9: 5.86 P99.99: 12.12
------------------------------------------------------
[ 0, 1 ] 680216 93.235% 93.235% ###################
( 1, 2 ] 19455 2.667% 95.902% #
( 2, 3 ] 13798 1.891% 97.793%
( 3, 4 ] 10056 1.378% 99.172%
( 4, 6 ] 5722 0.784% 99.956%
( 6, 10 ] 227 0.031% 99.987%
( 10, 15 ] 52 0.007% 99.994%
( 15, 22 ] 31 0.004% 99.998%
( 22, 34 ] 3 0.000% 99.999%
( 34, 51 ] 5 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 2 0.000% 100.000%
( 170, 250 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 132.68 MB 0.8 0.5 0.0 0.5 1.2 0.7 0.0 1.8 0.0 0.0 30705.11 0.00 88 348.922 6086K 0 0.0 0.0
L5 5/0 203.05 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14829.33 0.00 1 14829.330 2297K 0 0.0 0.0
L6 5/0 311.16 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.4 0.0 0.0 18593.75 0.00 5 3718.751 9436K 0 0.0 0.0
Sum 13/0 646.89 MB 0.0 1.5 0.5 1.0 2.2 1.2 0.0 3.3 0.0 0.0 64128.19 0.00 94 682.215 17M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 157.24 0.00 1 157.242 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 0.0 0.0 53344.34 0.00 19 2807.597 17M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10783.85 0.00 75 143.785 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.654, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.16 GB write, 0.04 MB/s write, 1.53 GB read, 0.03 MB/s read, 64128.2 seconds
Interval compaction: 0.01 GB write, 0.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 157.2 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 83 last_copies: 0 last_secs: 0.000804 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338468 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153721 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 126.54 MB 0.2 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27531.81 0.00 88 312.862 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 15/9 658.42 MB 0.0 1.4 0.5 0.9 2.1 1.2 0.0 3.1 0.0 0.0 63546.76 0.00 94 676.029 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.1 166.32 0.00 1 166.323 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10690.42 0.00 75 142.539 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49212.9 total, 600.0 interval
Flush(GB): cumulative 0.667, interval 0.009
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.06 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63546.8 seconds
Interval compaction: 0.01 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 166.3 seconds
Estimated pending compaction bytes: 552612976
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-cou
2025/03/10-02:42:27.917280 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 84855421
rocksdb.block.cache.hit COUNT : 40410
rocksdb.block.cache.add COUNT : 9963600
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562334
rocksdb.block.cache.index.hit COUNT : 39931
rocksdb.block.cache.index.add COUNT : 561755
rocksdb.block.cache.index.bytes.insert COUNT : 8338897591042
rocksdb.block.cache.filter.miss COUNT : 62245068
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 22048019
rocksdb.block.cache.data.hit COUNT : 479
rocksdb.block.cache.data.add COUNT : 9401845
rocksdb.block.cache.data.bytes.insert COUNT : 38677982614
rocksdb.block.cache.bytes.read COUNT : 734769928357
rocksdb.block.cache.bytes.write COUNT : 8377575573656
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61644265
rocksdb.bloom.filter.full.positive COUNT : 600152
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7486497
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44918976
rocksdb.number.keys.read COUNT : 7486497
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29114069308
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 20
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 20
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 12800
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 20
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 651
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 450
rocksdb.wal.bytes COUNT : 29114069308
rocksdb.write.self COUNT : 8658109
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11235888
rocksdb.compact.read.bytes COUNT : 12855384020
rocksdb.compact.write.bytes COUNT : 11231603791
rocksdb.flush.write.bytes COUNT : 4432659197
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4865
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17496350
rocksdb.number.block.decompressed COUNT : 22610353
rocksdb.bytes.compressed.from COUNT : 79476712356
rocksdb.bytes.compressed.to COUNT : 15378064446
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1107238770330
rocksdb.bytes.decompressed.to COUNT : 8434242489384
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 990
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 29077128576
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6303263916768
rocksdb.last.level.read.count COUNT : 14947116
rocksdb.non.last.level.read.bytes COUNT : 14966419565917
rocksdb.non.last.level.read.count COUNT : 69910258
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 60
rocksdb.last.level.seek.data.useful.no.filter COUNT : 60
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 162
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 162
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 84856072
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1637.995042 P95 : 8675.666511 P99 : 21470.523047 P100 : 480574.000000 COUNT : 7486497 SUM : 19531030122
rocksdb.db.write.micros P50 : 3648.626495 P95 : 9356.253566 P99 : 15091.103915 P100 : 1134347.000000 COUNT : 11235888 SUM : 47423883820
rocksdb.compaction.times.micros P50 : 1135326086.956522 P95 : 15149999999.999992 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 117 SUM : 324889863423
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 117 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5758.823529 P95 : 13940.406977 P99 : 19851.000000 P100 : 19851.000000 COUNT : 450 SUM : 3367958
rocksdb.compaction.outfile.sync.micros P50 : 8800.000000 P95 : 19940.000000 P99 : 20425.000000 P100 : 20425.000000 COUNT : 206 SUM : 1873526
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2542.004773 P95 : 7545.000000 P99 : 12380.500000 P100 : 15266.000000 COUNT : 574 SUM : 1731031
rocksdb.table.open.io.micros P50 : 3683.632287 P95 : 31647.297297 P99 : 69770.833333 P100 : 161013.000000 COUNT : 651 SUM : 5793382
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.075252 P95 : 46.932629 P99 : 95.217033 P100 : 31378.000000 COUNT : 12646174 SUM : 287663409
rocksdb.read.block.get.micros P50 : 20.355231 P95 : 107.503408 P99 : 600.166407 P100 : 120452.000000 COUNT : 72209247 SUM : 6549297075
rocksdb.write.raw.block.micros P50 : 2.695149 P95 : 13.070022 P99 : 21.136183 P100 : 35024.000000 COUNT : 17498318 SUM : 89210151
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.515132 P95 : 0.978752 P99 : 2.622808 P100 : 22586.000000 COUNT : 84857374 SUM : 37156172
rocksdb.file.read.flush.micros P50 : 0.510783 P95 : 0.970488 P99 : 1.810811 P100 : 9.000000 COUNT : 2700 SUM : 932
rocksdb.file.read.compaction.micros P50 : 0.566456 P95 : 2.693088 P99 : 4.938561 P100 : 10153.000000 COUNT : 12647958 SUM : 10221643
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.685065 P95 : 4.572709 P99 : 9.122048 P100 : 30849.000000 COUNT : 34997292 SUM : 56864892
rocksdb.file.write.flush.micros P50 : 0.626533 P95 : 1.970771 P99 : 5.494276 P100 : 15662.000000 COUNT : 9723684 SUM : 12132670
rocksdb.file.write.compaction.micros P50 : 0.710607 P95 : 5.322749 P99 : 9.464570 P100 : 30849.000000 COUNT : 25273608 SUM : 44732222
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7486497 SUM : 0
rocksdb.bytes.per.write P50 : 2563.950234 P95 : 6568.334649 P99 : 9393.342542 P100 : 12932.000000 COUNT : 8658109 SUM : 29114069308
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140978260.869565 P95 : 255000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 450 SUM : 64873768541
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 636 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:42:28.808694 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:42:28.809247 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741599748 to in-memory stats history
2025/03/10-02:42:28.809565 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:42:28.809833 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
2025/03/10-02:46:24.001993 1524 [db\compaction\compaction_job.cc:1672] [com.neocoretechs.relatrix.DomainRangeMap] [JOB 783] Generated table #1111: 967830 keys, 99327999 bytes, temperature: kUnknown
2025/03/10-02:46:24.002235 1524 EVENT_LOG_v1 {"time_micros": 1741599984002119, "cf_name": "com.neocoretechs.relatrix.DomainRangeMap", "job": 783, "event": "table_file_creation", "file_number": 1111, "file_size": 99327999, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19103998, "largest_seqno": 44270025, "table_properties": {"data_size": 90973914, "index_size": 56446559, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1209797, "raw_key_size": 503271600, "raw_average_key_size": 520, "raw_value_size": 123882240, "raw_average_value_size": 128, "num_data_blocks": 107522, "num_entries": 967830, "num_filter_entries": 967830, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 6, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "com.neocoretechs.relatrix.DomainRangeMap", "column_family_id": 5, "comparator": "com.neocoretechs.rocksack.SerializedComparator", "user_defined_timestamps_persisted": 1, "key_largest_seqno": 44270025, "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "Snappy", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1741562309, "oldest_key_time": 1741592632, "newest_key_time": 0, "file_creation_time": 1741597194, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "649ce9b8-fd21-11ef-9f33-047bcb461b77", "db_session_id": "LSK2JJ5P72N5CU6EPPPZ", "orig_file_number": 1111, "seqno_to_time_mapping": "N/A"}}
2025/03/10-02:52:27.927401 10f0 [db\db_impl\db_impl.cc:1210] ------- DUMPING STATS -------
2025/03/10-02:52:27.927675 10f0 [db\db_impl\db_impl.cc:1211]
** DB Stats **
Uptime(secs): 49813.0 total, 600.0 interval
Cumulative writes: 11M writes, 44M keys, 8671K commit groups, 1.3 writes per commit group, ingest: 27.15 GB, 0.56 MB/s
Cumulative WAL: 11M writes, 0 syncs, 11249502.00 writes per sync, written: 27.15 GB, 0.56 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 13K writes, 54K keys, 13K commit groups, 1.0 writes per commit group, ingest: 33.70 MB, 0.06 MB/s
Interval WAL: 13K writes, 0 syncs, 13614.00 writes per sync, written: 0.03 GB, 0.06 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 6/5 117.61 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.6 0.0 0.1 23850.34 0.00 87 274.142 4789K 0 0.0 0.0
L5 4/4 233.24 MB 0.0 0.5 0.3 0.2 0.5 0.3 0.0 1.6 0.0 0.0 19999.34 0.00 2 9999.668 4893K 0 0.0 0.0
L6 6/0 372.99 MB 0.0 0.9 0.4 0.5 0.9 0.4 0.0 2.4 0.1 0.0 18283.37 0.00 6 3047.229 9502K 0 0.0 0.0
Sum 16/9 723.85 MB 0.0 1.8 0.7 1.2 2.5 1.4 0.0 3.5 0.0 0.0 62133.05 0.00 95 654.032 19M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.7 1.2 1.8 0.7 0.0 0.0 0.0 0.0 51089.19 0.00 20 2554.459 19M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 11043.86 0.00 75 147.251 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.717, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.53 GB write, 0.05 MB/s write, 1.83 GB read, 0.04 MB/s read, 62133.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 573108288
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4808E5F0#8424 capacity: 64.00 KB seed: 679176613 usage: 558.20 MB table_size: 1024 occupancy: 130 collections: 84 last_copies: 0 last_secs: 0.003327 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(95,381.75 KB,596.483%) IndexBlock(27,557.79 MB,892461%) Misc(7,24.11 KB,37.6755%)
** File Read Latency Histogram By Level [default] **
** Level 0 read latency histogram (micros):
Count: 58102622 Average: 0.3140 StdDev: 11.51
Min: 0 Median: 0.5050 Max: 24509
Percentiles: P50: 0.51 P75: 0.76 P99: 1.00 P99.9: 3.55 P99.99: 19.18
------------------------------------------------------
[ 0, 1 ] 57526995 99.009% 99.009% ####################
( 1, 2 ] 406847 0.700% 99.710%
( 2, 3 ] 93433 0.161% 99.870%
( 3, 4 ] 31488 0.054% 99.925%
( 4, 6 ] 17922 0.031% 99.955%
( 6, 10 ] 13226 0.023% 99.978%
( 10, 15 ] 5170 0.009% 99.987%
( 15, 22 ] 2899 0.005% 99.992%
( 22, 34 ] 1398 0.002% 99.994%
( 34, 51 ] 821 0.001% 99.996%
( 51, 76 ] 610 0.001% 99.997%
( 76, 110 ] 320 0.001% 99.997%
( 110, 170 ] 468 0.001% 99.998%
( 170, 250 ] 483 0.001% 99.999%
( 250, 380 ] 251 0.000% 99.999%
( 380, 580 ] 163 0.000% 100.000%
( 580, 870 ] 68 0.000% 100.000%
( 870, 1300 ] 53 0.000% 100.000%
( 1300, 1900 ] 28 0.000% 100.000%
( 1900, 2900 ] 19 0.000% 100.000%
( 2900, 4400 ] 23 0.000% 100.000%
( 4400, 6600 ] 27 0.000% 100.000%
( 6600, 9900 ] 17 0.000% 100.000%
( 9900, 14000 ] 19 0.000% 100.000%
( 14000, 22000 ] 7 0.000% 100.000%
( 22000, 33000 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 4884804 Average: 0.8481 StdDev: 33.37
Min: 0 Median: 0.5410 Max: 18132
Percentiles: P50: 0.54 P75: 0.81 P99: 3.72 P99.9: 15.67 P99.99: 248.90
------------------------------------------------------
[ 0, 1 ] 4515007 92.430% 92.430% ##################
( 1, 2 ] 225013 4.606% 97.036% #
( 2, 3 ] 68693 1.406% 98.442%
( 3, 4 ] 37647 0.771% 99.213%
( 4, 6 ] 25545 0.523% 99.736%
( 6, 10 ] 4704 0.096% 99.832%
( 10, 15 ] 3124 0.064% 99.896%
( 15, 22 ] 1939 0.040% 99.936%
( 22, 34 ] 885 0.018% 99.954%
( 34, 51 ] 477 0.010% 99.964%
( 51, 76 ] 317 0.006% 99.970%
( 76, 110 ] 220 0.005% 99.975%
( 110, 170 ] 350 0.007% 99.982%
( 170, 250 ] 400 0.008% 99.990%
( 250, 380 ] 203 0.004% 99.994%
( 380, 580 ] 123 0.003% 99.997%
( 580, 870 ] 45 0.001% 99.998%
( 870, 1300 ] 32 0.001% 99.998%
( 1300, 1900 ] 28 0.001% 99.999%
( 1900, 2900 ] 29 0.001% 100.000%
( 2900, 4400 ] 15 0.000% 100.000%
( 4400, 6600 ] 12 0.000% 100.000%
( 6600, 9900 ] 13 0.000% 100.000%
( 9900, 14000 ] 14 0.000% 100.001%
( 14000, 22000 ] 7 0.000% 100.001%
** Level 6 read latency histogram (micros):
Count: 12171538 Average: 0.5770 StdDev: 24.07
Min: 0 Median: 0.5156 Max: 22586
Percentiles: P50: 0.52 P75: 0.77 P99: 2.14 P99.9: 9.29 P99.99: 176.00
------------------------------------------------------
[ 0, 1 ] 11803183 96.974% 96.974% ###################
( 1, 2 ] 238190 1.957% 98.931%
( 2, 3 ] 58470 0.480% 99.411%
( 3, 4 ] 32599 0.268% 99.679%
( 4, 6 ] 22035 0.181% 99.860%
( 6, 10 ] 5950 0.049% 99.909%
( 10, 15 ] 4110 0.034% 99.942%
( 15, 22 ] 2542 0.021% 99.963%
( 22, 34 ] 1171 0.010% 99.973%
( 34, 51 ] 731 0.006% 99.979%
( 51, 76 ] 492 0.004% 99.983%
( 76, 110 ] 299 0.002% 99.985%
( 110, 170 ] 507 0.004% 99.990%
( 170, 250 ] 558 0.005% 99.994%
( 250, 380 ] 302 0.002% 99.997%
( 380, 580 ] 162 0.001% 99.998%
( 580, 870 ] 84 0.001% 99.999%
( 870, 1300 ] 50 0.000% 99.999%
( 1300, 1900 ] 29 0.000% 99.999%
( 1900, 2900 ] 25 0.000% 100.000%
( 2900, 4400 ] 18 0.000% 100.000%
( 4400, 6600 ] 13 0.000% 100.000%
( 6600, 9900 ] 22 0.000% 100.000%
( 9900, 14000 ] 11 0.000% 100.000%
( 14000, 22000 ] 8 0.000% 100.000%
( 22000, 33000 ] 2 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 138.12 MB 0.2 0.5 0.0 0.5 1.2 0.7 0.0 1.7 0.0 0.0 27393.10 0.00 88 311.285 5189K 0 0.0 0.0
L5 6/5 244.44 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 15581.11 0.00 1 15581.113 2496K 0 0.0 0.0
L6 5/0 337.37 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.3 0.0 0.0 18723.88 0.00 5 3744.776 8859K 0 0.0 0.0
Sum 16/9 719.94 MB 0.0 1.6 0.6 1.0 2.3 1.3 0.0 3.1 0.0 0.0 61698.09 0.00 94 656.363 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapDomainRange] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.6 0.6 1.0 1.6 0.6 0.0 0.0 0.0 0.0 51268.12 0.00 19 2698.322 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10429.98 0.00 75 139.066 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.725, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.28 GB write, 0.05 MB/s write, 1.58 GB read, 0.03 MB/s read, 61698.1 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 650907564
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B145800#8424 capacity: 64.00 KB seed: 679176613 usage: 20.08 KB table_size: 1024 occupancy: 6 collections: 84 last_copies: 0 last_secs: 0.000185 secs_since: 0
Block cache entry stats(count,size,portion): Misc(6,19.57 KB,30.5832%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.MapDomainRange] **
** Level 0 read latency histogram (micros):
Count: 1334181 Average: 0.6970 StdDev: 2.06
Min: 0 Median: 0.5464 Max: 2084
Percentiles: P50: 0.55 P75: 0.82 P99: 3.73 P99.9: 5.83 P99.99: 14.14
------------------------------------------------------
[ 0, 1 ] 1220981 91.515% 91.515% ##################
( 1, 2 ] 56526 4.237% 95.752% #
( 2, 3 ] 30326 2.273% 98.025%
( 3, 4 ] 17768 1.332% 99.357%
( 4, 6 ] 7928 0.594% 99.951%
( 6, 10 ] 367 0.028% 99.979%
( 10, 15 ] 183 0.014% 99.992%
( 15, 22 ] 66 0.005% 99.997%
( 22, 34 ] 14 0.001% 99.998%
( 34, 51 ] 8 0.001% 99.999%
( 51, 76 ] 7 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 3 0.000% 100.000%
( 170, 250 ] 2 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 1900, 2900 ] 1 0.000% 100.000%
** Level 5 read latency histogram (micros):
Count: 155633 Average: 1.1798 StdDev: 1.01
Min: 0 Median: 0.6417 Max: 225
Percentiles: P50: 0.64 P75: 0.96 P99: 3.60 P99.9: 5.82 P99.99: 17.11
------------------------------------------------------
[ 0, 1 ] 121272 77.922% 77.922% ################
( 1, 2 ] 26035 16.728% 94.650% ###
( 2, 3 ] 5397 3.468% 98.118% #
( 3, 4 ] 2272 1.460% 99.578%
( 4, 6 ] 552 0.355% 99.933%
( 6, 10 ] 25 0.016% 99.949%
( 10, 15 ] 59 0.038% 99.987%
( 15, 22 ] 18 0.012% 99.998%
( 22, 34 ] 2 0.001% 99.999%
( 170, 250 ] 1 0.001% 100.000%
** Level 6 read latency histogram (micros):
Count: 585868 Average: 0.4337 StdDev: 0.52
Min: 0 Median: 0.5019 Max: 70
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.81 P99.99: 3.07
------------------------------------------------------
[ 0, 1 ] 583635 99.619% 99.619% ####################
( 1, 2 ] 2027 0.346% 99.965%
( 2, 3 ] 146 0.025% 99.990%
( 3, 4 ] 19 0.003% 99.993%
( 4, 6 ] 14 0.002% 99.995%
( 6, 10 ] 21 0.004% 99.999%
( 10, 15 ] 3 0.001% 99.999%
( 22, 34 ] 1 0.000% 100.000%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 17.70 MB 0.5 0.6 0.0 0.6 1.2 0.6 0.0 1.9 0.0 0.0 33659.09 0.00 88 382.490 6492K 0 0.0 0.0
L5 5/0 234.05 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14086.08 0.00 1 14086.083 2696K 0 0.0 0.0
L6 6/0 382.27 MB 0.0 1.0 0.4 0.6 1.0 0.4 0.0 2.4 0.0 0.0 28876.18 0.00 6 4812.697 11M 0 0.0 0.0
Sum 13/0 634.02 MB 0.0 1.8 0.6 1.1 2.4 1.2 0.0 3.7 0.0 0.0 76621.35 0.00 95 806.541 20M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeMapDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.8 0.6 1.1 1.7 0.6 0.0 0.0 0.0 0.0 65740.36 0.00 20 3287.018 20M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.6 0.6 0.0 0.0 0.0 0.1 10881.00 0.00 75 145.080 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49813.0 total, 600.0 interval
Flush(GB): cumulative 0.649, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.39 GB write, 0.05 MB/s write, 1.77 GB read, 0.04 MB/s read, 76621.4 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B1451A0#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 84 last_copies: 0 last_secs: 0.000113 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeMapDomain] **
** Level 0 read latency histogram (micros):
Count: 1413077 Average: 1.2271 StdDev: 9.64
Min: 0 Median: 0.6627 Max: 8104
Percentiles: P50: 0.66 P75: 0.99 P99: 5.71 P99.9: 9.22 P99.99: 21.21
------------------------------------------------------
[ 0, 1 ] 1066214 75.453% 75.453% ###############
( 1, 2 ] 109660 7.760% 83.214% ##
( 2, 3 ] 81218 5.748% 88.961% #
( 3, 4 ] 83713 5.924% 94.885% #
( 4, 6 ] 68155 4.823% 99.709% #
( 6, 10 ] 3364 0.238% 99.947%
( 10, 15 ] 278 0.020% 99.966%
( 15, 22 ] 376 0.027% 99.993%
( 22, 34 ] 91 0.006% 99.999%
( 34, 51 ] 10 0.001% 100.000%
( 51, 76 ] 5 0.000% 100.000%
( 76, 110 ] 3 0.000% 100.001%
( 110, 170 ] 5 0.000% 100.001%
( 170, 250 ] 3 0.000% 100.001%
( 250, 380 ] 6 0.000% 100.002%
( 380, 580 ] 3 0.000% 100.002%
( 580, 870 ] 1 0.000% 100.002%
( 870, 1300 ] 1 0.000% 100.002%
( 2900, 4400 ] 2 0.000% 100.002%
( 4400, 6600 ] 1 0.000% 100.002%
( 6600, 9900 ] 1 0.000% 100.002%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.2000 StdDev: 1.64
Min: 0 Median: 0.6250 Max: 7
Percentiles: P50: 0.62 P75: 0.94 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 24 80.000% 80.000% ################
( 1, 2 ] 1 3.333% 83.333% #
( 2, 3 ] 2 6.667% 90.000% #
( 3, 4 ] 1 3.333% 93.333% #
( 4, 6 ] 1 3.333% 96.667% #
( 6, 10 ] 1 3.333% 100.000% #
** Level 6 read latency histogram (micros):
Count: 729569 Average: 0.6299 StdDev: 0.96
Min: 0 Median: 0.5363 Max: 228
Percentiles: P50: 0.54 P75: 0.80 P99: 3.88 P99.9: 5.86 P99.99: 12.12
------------------------------------------------------
[ 0, 1 ] 680216 93.235% 93.235% ###################
( 1, 2 ] 19455 2.667% 95.902% #
( 2, 3 ] 13798 1.891% 97.793%
( 3, 4 ] 10056 1.378% 99.172%
( 4, 6 ] 5722 0.784% 99.956%
( 6, 10 ] 227 0.031% 99.987%
( 10, 15 ] 52 0.007% 99.994%
( 15, 22 ] 31 0.004% 99.998%
( 22, 34 ] 3 0.000% 99.999%
( 34, 51 ] 5 0.001% 99.999%
( 76, 110 ] 1 0.000% 100.000%
( 110, 170 ] 2 0.000% 100.000%
( 170, 250 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 132.68 MB 0.8 0.5 0.0 0.5 1.2 0.7 0.0 1.8 0.0 0.0 30705.11 0.00 88 348.922 6086K 0 0.0 0.0
L5 5/0 203.05 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 14829.33 0.00 1 14829.330 2297K 0 0.0 0.0
L6 5/0 311.16 MB 0.0 0.8 0.3 0.5 0.8 0.3 0.0 2.4 0.0 0.0 18593.75 0.00 5 3718.751 9436K 0 0.0 0.0
Sum 13/0 646.89 MB 0.0 1.5 0.5 1.0 2.2 1.2 0.0 3.3 0.0 0.0 64128.19 0.00 94 682.215 17M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.RangeDomainMap] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 0.0 0.0 53344.34 0.00 19 2807.597 17M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10783.85 0.00 75 143.785 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49812.9 total, 600.0 interval
Flush(GB): cumulative 0.654, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.16 GB write, 0.04 MB/s write, 1.53 GB read, 0.03 MB/s read, 64128.2 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 0
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0
Block cache LRUCache@000001DA4B146C30#8424 capacity: 64.00 KB seed: 679176613 usage: 0.08 KB table_size: 1024 occupancy: 1 collections: 84 last_copies: 0 last_secs: 9.1e-05 secs_since: 0
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [com.neocoretechs.relatrix.RangeDomainMap] **
** Level 0 read latency histogram (micros):
Count: 1338468 Average: 0.8719 StdDev: 10.22
Min: 0 Median: 0.5801 Max: 10153
Percentiles: P50: 0.58 P75: 0.87 P99: 5.07 P99.9: 6.97 P99.99: 15.29
------------------------------------------------------
[ 0, 1 ] 1153721 86.197% 86.197% #################
( 1, 2 ] 69596 5.200% 91.397% #
( 2, 3 ] 49856 3.725% 95.122% #
( 3, 4 ] 38504 2.877% 97.998% #
( 4, 6 ] 25128 1.877% 99.876%
( 6, 10 ] 1341 0.100% 99.976%
( 10, 15 ] 184 0.014% 99.990%
( 15, 22 ] 102 0.008% 99.997%
( 22, 34 ] 31 0.002% 100.000%
( 34, 51 ] 3 0.000% 100.000%
( 51, 76 ] 6 0.000% 100.000%
( 110, 170 ] 1 0.000% 100.000%
( 250, 380 ] 1 0.000% 100.000%
( 2900, 4400 ] 2 0.000% 100.001%
( 9900, 14000 ] 1 0.000% 100.001%
** Level 5 read latency histogram (micros):
Count: 30 Average: 1.3667 StdDev: 1.94
Min: 0 Median: 0.6818 Max: 7
Percentiles: P50: 0.68 P75: 1.12 P99: 7.00 P99.9: 7.00 P99.99: 7.00
------------------------------------------------------
[ 0, 1 ] 22 73.333% 73.333% ###############
( 1, 2 ] 4 13.333% 86.667% ###
( 2, 3 ] 1 3.333% 90.000% #
( 4, 6 ] 1 3.333% 93.333% #
( 6, 10 ] 2 6.667% 100.000% #
** Level 6 read latency histogram (micros):
Count: 638097 Average: 0.4341 StdDev: 0.54
Min: 0 Median: 0.5020 Max: 92
Percentiles: P50: 0.50 P75: 0.75 P99: 0.99 P99.9: 1.83 P99.99: 3.22
------------------------------------------------------
[ 0, 1 ] 635548 99.601% 99.601% ####################
( 1, 2 ] 2300 0.360% 99.961%
( 2, 3 ] 181 0.028% 99.989%
( 3, 4 ] 19 0.003% 99.992%
( 4, 6 ] 9 0.001% 99.994%
( 6, 10 ] 23 0.004% 99.997%
( 10, 15 ] 11 0.002% 99.999%
( 22, 34 ] 2 0.000% 99.999%
( 34, 51 ] 1 0.000% 100.000%
( 51, 76 ] 2 0.000% 100.000%
( 76, 110 ] 1 0.000% 100.000%
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/4 126.54 MB 0.2 0.5 0.0 0.5 1.1 0.7 0.0 1.7 0.0 0.0 27531.81 0.00 88 312.862 5192K 0 0.0 0.0
L5 5/5 223.53 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 0.0 0.0 17037.94 0.00 1 17037.944 2497K 0 0.0 0.0
L6 5/0 308.34 MB 0.0 0.7 0.3 0.4 0.7 0.3 0.0 2.2 0.0 0.0 18977.00 0.00 5 3795.400 8453K 0 0.0 0.0
Sum 15/9 658.42 MB 0.0 1.4 0.5 0.9 2.1 1.2 0.0 3.1 0.0 0.0 63546.76 0.00 94 676.029 16M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
** Compaction Stats [com.neocoretechs.relatrix.MapRangeDomain] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 1.4 0.5 0.9 1.4 0.5 0.0 0.0 0.0 0.0 52856.34 0.00 19 2781.913 16M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.7 0.7 0.0 0.0 0.0 0.1 10690.42 0.00 75 142.539 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 49812.9 total, 600.0 interval
Flush(GB): cumulative 0.667, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2.06 GB write, 0.04 MB/s write, 1.42 GB read, 0.03 MB/s read, 63546.8 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Estimated pending compaction bytes: 552612976
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-fi
2025/03/10-02:52:27.930202 10f0 [db\db_impl\db_impl.cc:795] STATISTICS:
rocksdb.block.cache.miss COUNT : 85552653
rocksdb.block.cache.hit COUNT : 41081
rocksdb.block.cache.add COUNT : 10504884
rocksdb.block.cache.add.failures COUNT : 0
rocksdb.block.cache.index.miss COUNT : 562400
rocksdb.block.cache.index.hit COUNT : 40568
rocksdb.block.cache.index.add COUNT : 561820
rocksdb.block.cache.index.bytes.insert COUNT : 8339544976718
rocksdb.block.cache.filter.miss COUNT : 62315567
rocksdb.block.cache.filter.hit COUNT : 0
rocksdb.block.cache.filter.add COUNT : 0
rocksdb.block.cache.filter.bytes.insert COUNT : 0
rocksdb.block.cache.data.miss COUNT : 22674686
rocksdb.block.cache.data.hit COUNT : 513
rocksdb.block.cache.data.add COUNT : 9943064
rocksdb.block.cache.data.bytes.insert COUNT : 40904311365
rocksdb.block.cache.bytes.read COUNT : 746026143256
rocksdb.block.cache.bytes.write COUNT : 8380449288083
rocksdb.block.cache.compression.dict.miss COUNT : 0
rocksdb.block.cache.compression.dict.hit COUNT : 0
rocksdb.block.cache.compression.dict.add COUNT : 0
rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0
rocksdb.block.cache.add.redundant COUNT : 881
rocksdb.block.cache.index.add.redundant COUNT : 881
rocksdb.block.cache.filter.add.redundant COUNT : 0
rocksdb.block.cache.data.add.redundant COUNT : 0
rocksdb.block.cache.compression.dict.add.redundant COUNT : 0
rocksdb.secondary.cache.hits COUNT : 0
rocksdb.secondary.cache.filter.hits COUNT : 0
rocksdb.secondary.cache.index.hits COUNT : 0
rocksdb.secondary.cache.data.hits COUNT : 0
rocksdb.compressed.secondary.cache.dummy.hits COUNT : 0
rocksdb.compressed.secondary.cache.hits COUNT : 0
rocksdb.compressed.secondary.cache.promotions COUNT : 0
rocksdb.compressed.secondary.cache.promotion.skips COUNT : 0
rocksdb.bloom.filter.useful COUNT : 61714076
rocksdb.bloom.filter.full.positive COUNT : 600840
rocksdb.bloom.filter.full.true.positive COUNT : 0
rocksdb.bloom.filter.prefix.checked COUNT : 0
rocksdb.bloom.filter.prefix.useful COUNT : 0
rocksdb.bloom.filter.prefix.true.positive COUNT : 0
rocksdb.persistent.cache.hit COUNT : 0
rocksdb.persistent.cache.miss COUNT : 0
rocksdb.sim.block.cache.hit COUNT : 0
rocksdb.sim.block.cache.miss COUNT : 0
rocksdb.memtable.hit COUNT : 0
rocksdb.memtable.miss COUNT : 7495573
rocksdb.l0.hit COUNT : 0
rocksdb.l1.hit COUNT : 0
rocksdb.l2andup.hit COUNT : 0
rocksdb.compaction.key.drop.new COUNT : 0
rocksdb.compaction.key.drop.obsolete COUNT : 0
rocksdb.compaction.key.drop.range_del COUNT : 0
rocksdb.compaction.key.drop.user COUNT : 0
rocksdb.compaction.range_del.drop.obsolete COUNT : 0
rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0
rocksdb.compaction.cancelled COUNT : 0
rocksdb.number.keys.written COUNT : 44973432
rocksdb.number.keys.read COUNT : 7495573
rocksdb.number.keys.updated COUNT : 0
rocksdb.bytes.written COUNT : 29149402176
rocksdb.bytes.read COUNT : 0
rocksdb.number.db.seek COUNT : 21
rocksdb.number.db.next COUNT : 0
rocksdb.number.db.prev COUNT : 0
rocksdb.number.db.seek.found COUNT : 21
rocksdb.number.db.next.found COUNT : 0
rocksdb.number.db.prev.found COUNT : 0
rocksdb.db.iter.bytes.read COUNT : 13440
rocksdb.number.iter.skip COUNT : 0
rocksdb.number.reseeks.iteration COUNT : 0
rocksdb.num.iterator.created COUNT : 21
rocksdb.num.iterator.deleted COUNT : 0
rocksdb.no.file.opens COUNT : 651
rocksdb.no.file.errors COUNT : 0
rocksdb.stall.micros COUNT : 0
rocksdb.db.mutex.wait.micros COUNT : 0
rocksdb.number.multiget.get COUNT : 0
rocksdb.number.multiget.keys.read COUNT : 0
rocksdb.number.multiget.bytes.read COUNT : 0
rocksdb.number.multiget.keys.found COUNT : 0
rocksdb.number.merge.failures COUNT : 0
rocksdb.getupdatessince.calls COUNT : 0
rocksdb.wal.synced COUNT : 450
rocksdb.wal.bytes COUNT : 29149402176
rocksdb.write.self COUNT : 8671723
rocksdb.write.other COUNT : 2577779
rocksdb.write.wal COUNT : 11249502
rocksdb.compact.read.bytes COUNT : 12932865003
rocksdb.compact.write.bytes COUNT : 11312057422
rocksdb.flush.write.bytes COUNT : 4432659197
rocksdb.compact.read.marked.bytes COUNT : 0
rocksdb.compact.read.periodic.bytes COUNT : 0
rocksdb.compact.read.ttl.bytes COUNT : 0
rocksdb.compact.write.marked.bytes COUNT : 0
rocksdb.compact.write.periodic.bytes COUNT : 0
rocksdb.compact.write.ttl.bytes COUNT : 0
rocksdb.number.direct.load.table.properties COUNT : 0
rocksdb.number.superversion_acquires COUNT : 4866
rocksdb.number.superversion_releases COUNT : 241
rocksdb.number.superversion_cleanups COUNT : 208
rocksdb.number.block.compressed COUNT : 17581801
rocksdb.number.block.decompressed COUNT : 23237087
rocksdb.bytes.compressed.from COUNT : 79875111066
rocksdb.bytes.compressed.to COUNT : 15457015262
rocksdb.bytes.compression_bypassed COUNT : 0
rocksdb.bytes.compression.rejected COUNT : 0
rocksdb.number.block_compression_bypassed COUNT : 0
rocksdb.number.block_compression_rejected COUNT : 0
rocksdb.bytes.decompressed.from COUNT : 1107848202640
rocksdb.bytes.decompressed.to COUNT : 8437452291437
rocksdb.merge.operation.time.nanos COUNT : 0
rocksdb.filter.operation.time.nanos COUNT : 0
rocksdb.compaction.total.time.cpu_micros COUNT : 0
rocksdb.row.cache.hit COUNT : 0
rocksdb.row.cache.miss COUNT : 0
rocksdb.read.amp.estimate.useful.bytes COUNT : 0
rocksdb.read.amp.total.read.bytes COUNT : 0
rocksdb.number.rate_limiter.drains COUNT : 0
rocksdb.blobdb.num.put COUNT : 0
rocksdb.blobdb.num.write COUNT : 0
rocksdb.blobdb.num.get COUNT : 0
rocksdb.blobdb.num.multiget COUNT : 0
rocksdb.blobdb.num.seek COUNT : 0
rocksdb.blobdb.num.next COUNT : 0
rocksdb.blobdb.num.prev COUNT : 0
rocksdb.blobdb.num.keys.written COUNT : 0
rocksdb.blobdb.num.keys.read COUNT : 0
rocksdb.blobdb.bytes.written COUNT : 0
rocksdb.blobdb.bytes.read COUNT : 0
rocksdb.blobdb.write.inlined COUNT : 0
rocksdb.blobdb.write.inlined.ttl COUNT : 0
rocksdb.blobdb.write.blob COUNT : 0
rocksdb.blobdb.write.blob.ttl COUNT : 0
rocksdb.blobdb.blob.file.bytes.written COUNT : 0
rocksdb.blobdb.blob.file.bytes.read COUNT : 0
rocksdb.blobdb.blob.file.synced COUNT : 0
rocksdb.blobdb.blob.index.expired.count COUNT : 0
rocksdb.blobdb.blob.index.expired.size COUNT : 0
rocksdb.blobdb.blob.index.evicted.count COUNT : 0
rocksdb.blobdb.blob.index.evicted.size COUNT : 0
rocksdb.blobdb.gc.num.files COUNT : 0
rocksdb.blobdb.gc.num.new.files COUNT : 0
rocksdb.blobdb.gc.failures COUNT : 0
rocksdb.blobdb.gc.num.keys.relocated COUNT : 0
rocksdb.blobdb.gc.bytes.relocated COUNT : 0
rocksdb.blobdb.fifo.num.files.evicted COUNT : 0
rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0
rocksdb.blobdb.fifo.bytes.evicted COUNT : 0
rocksdb.blobdb.cache.miss COUNT : 0
rocksdb.blobdb.cache.hit COUNT : 0
rocksdb.blobdb.cache.add COUNT : 0
rocksdb.blobdb.cache.add.failures COUNT : 0
rocksdb.blobdb.cache.bytes.read COUNT : 0
rocksdb.blobdb.cache.bytes.write COUNT : 0
rocksdb.txn.overhead.mutex.prepare COUNT : 0
rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0
rocksdb.txn.overhead.duplicate.key COUNT : 0
rocksdb.txn.overhead.mutex.snapshot COUNT : 0
rocksdb.txn.get.tryagain COUNT : 0
rocksdb.files.marked.trash COUNT : 0
rocksdb.files.marked.trash.deleted COUNT : 0
rocksdb.files.deleted.immediately COUNT : 990
rocksdb.error.handler.bg.error.count COUNT : 0
rocksdb.error.handler.bg.io.error.count COUNT : 0
rocksdb.error.handler.bg.retryable.io.error.count COUNT : 0
rocksdb.error.handler.autoresume.count COUNT : 0
rocksdb.error.handler.autoresume.retry.total.count COUNT : 0
rocksdb.error.handler.autoresume.success.count COUNT : 0
rocksdb.memtable.payload.bytes.at.flush COUNT : 29077128576
rocksdb.memtable.garbage.bytes.at.flush COUNT : 0
rocksdb.verify_checksum.read.bytes COUNT : 0
rocksdb.backup.read.bytes COUNT : 0
rocksdb.backup.write.bytes COUNT : 0
rocksdb.remote.compact.read.bytes COUNT : 0
rocksdb.remote.compact.write.bytes COUNT : 0
rocksdb.hot.file.read.bytes COUNT : 0
rocksdb.warm.file.read.bytes COUNT : 0
rocksdb.cold.file.read.bytes COUNT : 0
rocksdb.hot.file.read.count COUNT : 0
rocksdb.warm.file.read.count COUNT : 0
rocksdb.cold.file.read.count COUNT : 0
rocksdb.last.level.read.bytes COUNT : 6311453550243
rocksdb.last.level.read.count COUNT : 15268647
rocksdb.non.last.level.read.bytes COUNT : 14986141453844
rocksdb.non.last.level.read.count COUNT : 70285960
rocksdb.last.level.seek.filtered COUNT : 0
rocksdb.last.level.seek.filter.match COUNT : 0
rocksdb.last.level.seek.data COUNT : 65
rocksdb.last.level.seek.data.useful.no.filter COUNT : 65
rocksdb.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.non.last.level.seek.filtered COUNT : 0
rocksdb.non.last.level.seek.filter.match COUNT : 0
rocksdb.non.last.level.seek.data COUNT : 171
rocksdb.non.last.level.seek.data.useful.no.filter COUNT : 171
rocksdb.non.last.level.seek.data.useful.filter.match COUNT : 0
rocksdb.block.checksum.compute.count COUNT : 85553305
rocksdb.block.checksum.mismatch.count COUNT : 0
rocksdb.multiget.coroutine.count COUNT : 0
rocksdb.read.async.micros COUNT : 0
rocksdb.async.read.error.count COUNT : 0
rocksdb.table.open.prefetch.tail.miss COUNT : 0
rocksdb.table.open.prefetch.tail.hit COUNT : 0
rocksdb.timestamp.filter.table.checked COUNT : 0
rocksdb.timestamp.filter.table.filtered COUNT : 0
rocksdb.readahead.trimmed COUNT : 0
rocksdb.fifo.max.size.compactions COUNT : 0
rocksdb.fifo.ttl.compactions COUNT : 0
rocksdb.prefetch.bytes COUNT : 0
rocksdb.prefetch.bytes.useful COUNT : 0
rocksdb.prefetch.hits COUNT : 0
rocksdb.footer.corruption.count COUNT : 0
rocksdb.file.read.corruption.retry.count COUNT : 0
rocksdb.file.read.corruption.retry.success.count COUNT : 0
rocksdb.db.get.micros P50 : 1638.904531 P95 : 8691.586075 P99 : 21490.214538 P100 : 480574.000000 COUNT : 7495573 SUM : 19576295658
rocksdb.db.write.micros P50 : 3648.631460 P95 : 9363.462626 P99 : 15173.419228 P100 : 1134347.000000 COUNT : 11249502 SUM : 47504150161
rocksdb.compaction.times.micros P50 : 1135326086.956522 P95 : 15149999999.999992 P99 : 17037943845.000000 P100 : 17037943845.000000 COUNT : 117 SUM : 324889863423
rocksdb.compaction.times.cpu_micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 117 SUM : 0
rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.sync.micros P50 : 5758.823529 P95 : 13940.406977 P99 : 19851.000000 P100 : 19851.000000 COUNT : 450 SUM : 3367958
rocksdb.compaction.outfile.sync.micros P50 : 8937.500000 P95 : 19980.487805 P99 : 20425.000000 P100 : 20425.000000 COUNT : 207 SUM : 1889170
rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.manifest.file.sync.micros P50 : 2542.004773 P95 : 7545.000000 P99 : 12380.500000 P100 : 15266.000000 COUNT : 574 SUM : 1731031
rocksdb.table.open.io.micros P50 : 3683.632287 P95 : 31647.297297 P99 : 69770.833333 P100 : 161013.000000 COUNT : 651 SUM : 5793382
rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.block.compaction.micros P50 : 9.105779 P95 : 47.110369 P99 : 95.394151 P100 : 31378.000000 COUNT : 12731623 SUM : 290508347
rocksdb.read.block.get.micros P50 : 20.246355 P95 : 107.700812 P99 : 593.767490 P100 : 120452.000000 COUNT : 72821031 SUM : 6577404152
rocksdb.write.raw.block.micros P50 : 2.700550 P95 : 13.118892 P99 : 21.191437 P100 : 35024.000000 COUNT : 17583772 SUM : 90152053
rocksdb.numfiles.in.singlecompaction P50 : 3.750000 P95 : 9.032000 P99 : 9.806400 P100 : 10.000000 COUNT : 121 SUM : 598
rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.read.micros P50 : 0.515372 P95 : 0.979208 P99 : 2.641595 P100 : 24509.000000 COUNT : 85554607 SUM : 37883460
rocksdb.file.read.flush.micros P50 : 0.510783 P95 : 0.970488 P99 : 1.810811 P100 : 9.000000 COUNT : 2700 SUM : 932
rocksdb.file.read.compaction.micros P50 : 0.566834 P95 : 2.705904 P99 : 4.955817 P100 : 10153.000000 COUNT : 12733408 SUM : 10330754
rocksdb.file.read.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.db.iterator.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.db.checksum.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.file.read.verify.file.checksums.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.sst.write.micros P50 : 0.686240 P95 : 4.611566 P99 : 9.142013 P100 : 30849.000000 COUNT : 35168201 SUM : 57470454
rocksdb.file.write.flush.micros P50 : 0.626533 P95 : 1.970771 P99 : 5.494276 P100 : 15662.000000 COUNT : 9723684 SUM : 12132670
rocksdb.file.write.compaction.micros P50 : 0.712177 P95 : 5.350363 P99 : 9.481061 P100 : 30849.000000 COUNT : 25444517 SUM : 45337784
rocksdb.file.write.db.open.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 7495573 SUM : 0
rocksdb.bytes.per.write P50 : 2563.608209 P95 : 6567.470337 P99 : 9392.159274 P100 : 12932.000000 COUNT : 8671723 SUM : 29149402176
rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.db.flush.micros P50 : 140978260.869565 P95 : 255000000.000000 P99 : 479663686.000000 P100 : 479663686.000000 COUNT : 450 SUM : 64873768541
rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 643 SUM : 0
rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0
2025/03/10-02:52:28.830615 10f0 [db\db_impl\db_impl.cc:1028] ------- PERSISTING STATS -------
2025/03/10-02:52:28.831106 10f0 [db\db_impl\db_impl.cc:1086] Storing 214 stats with timestamp 1741600348 to in-memory stats history
2025/03/10-02:52:28.831232 10f0 [db\db_impl\db_impl.cc:1099] [Pre-GC] In-memory stats history size: 1054620 bytes, slice count: 62
2025/03/10-02:52:28.831761 10f0 [db\db_impl\db_impl.cc:1108] [Post-GC] In-memory stats history size: 1054620 bytes, slice count: 61
-------end of log
Jon Groff
V.P. R&D Microcaliper Devices, LLC (mailto:j...@microcaliperdevices.com)
-----Original Message-----
From: Adam Retter <adam....@googlemail.com></adam....@googlemail.com>
Sent: Mar 10, 2025 1:46 AM
To: <j...@microcaliperdevices.com></j...@microcaliperdevices.com>
Cc: <roc...@googlegroups.com></roc...@googlegroups.com>
Subject: Re: 'Busy' constantly returned from OptimisticTransactionDb commit
Hi Jon, This is not something that I am familiar with. I just wondered if the RocksDB log gives you any indication of where it is spending its time, or perhaps a profiler or strace could shed some light?
On Sun, 9 Mar 2025 at 19:18, Jon Groff <jonat...@earthlink.net (mailto:jonat...@earthlink.net)=""> wrote:Greetings,</jonat...@earthlink.net>
From: Adam Retter <adam....@googlemail.com></adam....@googlemail.com>
Sent: Mar 10, 2025 1:46 AM
To: <j...@microcaliperdevices.com></j...@microcaliperdevices.com>
Cc: <roc...@googlegroups.com></roc...@googlegroups.com>
Subject: Re: 'Busy' constantly returned from OptimisticTransactionDb commit
Hi Jon, This is not something that I am familiar with. I just wondered if the RocksDB log gives you any indication of where it is spending its time, or perhaps a profiler or strace could shed some light?
I am using RocksJava in a server environment with OptimisticTransactionDb, and upon commit I am getting constant Busy returns in the RocksDbException status. In small singe user instances I can wait it out, and eventually the commit goes through, but adding users causes it to be starved out and no amount of retries/waits succeeds, and one user seems to own the entire resource. If I let the transactions get larger before commit, I get a message about the max_write_buffer_size_to_maintain being too small instead of a Busy.
I tried increasing the number of background threads, the numbers that show in the logs that max_write_buffer_size_to_maintain is up over a few gigabytes, committing even more, waiting even longer, and changing transactions after every commit, but the result is the same.
If you can advise on this, or hopefully have seen it before and found a simple expedient, I would be eternally grateful.
Sincerely,
Jon Groff
--
Adam Retter
skype: adam.retter
tweet: adamretter
http://www.adamretter.org.uk
You received this message because you are subscribed to the Google Groups "rocksdb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rocksdb+u...@googlegroups.com (mailto:rocksdb+u...@googlegroups.com).
To view this discussion visit https://groups.google.com/d/msgid/rocksdb/CAPK0iciL7BW4obA%3D0hnkEhDh78boGhvqY_8XSZ5555pDucqUNg%40mail.gmail.com.
Reply all
Reply to author
Forward
0 new messages