Hamsterdb as local cache

21 views
Skip to first unread message

BigJoe RawenGroup

unread,
May 23, 2014, 12:34:36 AM5/23/14
to hamster...@googlegroups.com
Hi all

Have any user experience with high hamsterdb load?

The local db around 50-100gb.
Read load around 50.000-120.000 per sec, and write around 20.000.
I dont using transactions but using recovery.
Inmem cache aroung 1gb.

Regards Joe

Christoph Rupp

unread,
May 23, 2014, 1:15:53 AM5/23/14
to hamster...@googlegroups.com
Hi Joe,

those numbers are your requirement? You can simulate that load quite easily with ham_bench (tools/ham_bench).

First create a database. You did not describe your keys and your records; the default key size is 16, the default record size is 1024. You can change that (including the key type) as described here: https://github.com/cruppstahl/hamsterdb/wiki/Evaluating-and-Benchmarking

this inserts 50 GBs:
./ham_bench --stop-bytes=5000000000 --use-recovery --cache=1000000000

now say you want to open that file and perform 1 mio additional read/write operations, 50% read and 50% write:
./ham_bench --open --use-recovery --find-pct=50 --cache=1000000000

On my machine (a commodity system, but with an SSD) loading the database has on avg 65k ops/sec.
The second command has 260k inserts/sec and 100k find/sec.

Best regards
Christoph


--
You received this message because you are subscribed to the Google Groups "hamsterdb User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hamsterdb-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages