Does Riak cluster maintain fully connected erlang network?

32 views
Skip to first unread message

Sharas

unread,
Jan 28, 2012, 10:02:28 AM1/28/12
to NOSQL
Hi,

I wonder does Riak maintain fully connected erlang node network
between machines?

As far as I know erlang cluster can be more or less 20-25 machines,
because it costs to keep erlang network connected (pinging going on
between nodes).

I wonder does this limit influence Riak then?

Thanks,

Sharas

Jeremiah Peschka

unread,
Feb 7, 2012, 12:22:16 PM2/7/12
to nosql-di...@googlegroups.com
There have been improvements to Riak to bring the ring size above 20-25 machines. I would check on the riak users mailing list to ask for advice around this.
---
Jeremiah Peschka
Managing Director, Brent Ozar PLF, LLC



Sharas

--
You received this message because you are subscribed to the Google Groups "NOSQL" group.
To post to this group, send email to nosql-di...@googlegroups.com.
To unsubscribe from this group, send email to nosql-discussi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/nosql-discussion?hl=en.


Greg Burd

unread,
Feb 7, 2012, 1:16:16 PM2/7/12
to nosql-di...@googlegroups.com
I work for Basho and I have personally helped deploy clusters larger
than 60 nodes in size with the 1.0.3 release of Riak (our current
release). We were not hitting limits at 60 nodes (even with PB of
data stored and nearly a billion requests serviced per day) and future
releases will be able to scale much larger than that. So far
distributed Erlang (disterl) has not been an issue and we use it to
communicate between nodes in the cluster. We have seen TCP Incast
issues at such scales
(http://www.snookles.com/slf-blog/2012/01/05/tcp-incast-what-is-it/)
so network infrastructure is an important component of such large
scale distributed databases.

-greg

Reply all
Reply to author
Forward
0 new messages