lmdb in cluster

[dv]

Can an lmdb databse be partitioned/distributed across multiple computers?  For example, a single db could be too large for a single machine/memory combination and it would be safer to partition across a cluster of machines.

[Tim Spurway]

hey dv,

The whole point of Hustle is to distribute lmdb across a cluster, and provide a full column oriented relational front end.

If you are dealing with just the lmdb interface, you will have an ordered key/value store on a single machine (a very fast one, mind you).  If this is all you need, then by all means, keep using the lmdb interface.  It provides a superior feature/performance profile to any other db out there.

However, if you need to have a distributed, tabular database with relational semantics (joins, etc.) then you should give Hustle a try.  

cheers,

tim

On Sat, Apr 19, 2014 at 1:11 PM, dv <dinesh...@hotmail.com> wrote:

Can an lmdb databse be partitioned/distributed across multiple computers?  For example, a single db could be too large for a single machine/memory combination and it would be safer to partition across a cluster of machines.

--
You received this message because you are subscribed to the Google Groups "hustle-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hustle-users...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[dv]

The need is for a fast key/value store right now with potential for >1tb db size and lmdb is perfect for that. It would be nice if the lmdb db could be partioned/distributed to spread the memory resources. Btw, Chango's open source projects including Disco are very impressive.