Scaling beanstalkd

[Danny Asmussen]

Hi guys,

I'm trying to find details how to scale up beanstalkd horizontally, can it be done? I can't find any details, used serveral hours now (not with Amazon)

[Michael Barrow]

beanstalkd horizontal scaling must be done on the client side. Each of the clients would connect to multiple servers and then use a failover, round-robin, or sharding algorithm to switch between the different servers. Depending on your client library, it may support this ability out of the box.

michael at barrow dot me

+1.541.600.2027

"Do not anticipate trouble, or

worry about what may never happen.

Keep in the sunlight." -- B. Franklin

On Wed, Oct 28, 2015 at 1:53 AM, Danny Asmussen <wood...@gmail.com> wrote:

Hi guys,

I'm trying to find details how to scale up beanstalkd horizontally, can it be done? I can't find any details, used serveral hours now (not with Amazon)

--
You received this message because you are subscribed to the Google Groups "beanstalk-talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beanstalk-tal...@googlegroups.com.
To post to this group, send email to beansta...@googlegroups.com.
Visit this group at http://groups.google.com/group/beanstalk-talk.
For more options, visit https://groups.google.com/d/optout.

[Thomas Tsiakalakis]

we made something similar by using haproxy. (for failover but should also be possible for round robin).

just make sure to _not_ set "timeout client" and "timeout server" or your worker connection will be closed every x seconds.