need help on how to setup multiple php beanstalkd workers

[Ebot Tabi]

Hi there
i am new to beanstalkd, looking very interesting and right tool for my
php application, will be grateful to know how to setup multiple php
worker running on daemon mode and how to manage them and their memory
usages. i am currently trying to setup with the php client class:
pheanstalk,

Regards

[Gordon Heydon]

Hi

You are on the right track. I wrote the beanstalkd integration for Drupal and it is currently being used on Drupal.org

All you need to do us write a cli php application and then to have multiple workers just run the php application multiple times adding watches on the same queues and then when you grab a job from the queue beanstalkd will make sure the job will go to only 1 worker.

The biggest problem is going to be your php since if to connect to a. Existing application it us not built to run forever and sooner or later you will run out of memory and have to restart.

Gordon

Sent from my iPhone

> --
> You received this message because you are subscribed to the Google Groups "beanstalk-talk" group.
> To post to this group, send email to beansta...@googlegroups.com.
> To unsubscribe from this group, send email to beanstalk-tal...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.
>

[Chad Kouse]

I use a process control system called supervisord - haven't had any
issues with it for the past 2 years.

Http://supervisord.org

Then I just make a program group with a line that looks like:
command=/usr/bin/php my_consumer.php

Provides good logging and auto restart

--chad

[Daniel Olfelt]

I have to agree with Chad. I also use supervisord. Plus, you can use tools in superlance to add memory management and email alerts.

Daniel

[Ebot Tabi]

Thanks guys,
i successfully get multiple workers running with supervisor you guys
rocks, now i am working to get inside kohana 2.3.4, isn't easy, but
trying to see how to get it inside so that i can use it the core of
kohana features.

Regards and thanks

On Dec 19, 2:42 am, Daniel Olfelt <dolf...@gmail.com> wrote:
> I have to agree with Chad. I also use supervisord. Plus, you can use tools
> in superlance to add memory management and email alerts.
>
> Daniel

> On Dec 18, 2011 7:00 PM, "Chad Kouse" <chad.ko...@gmail.com> wrote:
>
>
>
>
>
>
>
> > I use a process control system called supervisord - haven't had any
> > issues with it for the past 2 years.
>
> > Http://supervisord.org
>
> > Then I just make a program group with a line that looks like:
> > command=/usr/bin/php my_consumer.php
>
> > Provides good logging and auto restart
>
> > --chad
>

[Daniel Olfelt]

It should be fairly easy to do. I am using Kohana 3.2 and it was quite easy to create a daemon controller and run that from the command line. I even implemented some code to prevent it being viewed outside the CLI. Here is a SO article that shows you the basics of running a KO controller from the command line in 2.x and 3.x: http://stackoverflow.com/questions/2133433/kohana-command-line

Hope this helps,
Daniel

[Ebot Tabi]

thanks Daniel, all you guys rock, your help is awesome guys

On 23 déc, 08:35, Daniel Olfelt <dolf...@gmail.com> wrote:
> It should be fairly easy to do. I am using Kohana 3.2 and it was quite easy
> to create a daemon controller and run that from the command line. I even
> implemented some code to prevent it being viewed outside the CLI. Here is a
> SO article that shows you the basics of running a KO controller from the
> command line in 2.x and 3.x:http://stackoverflow.com/questions/2133433/kohana-command-line
>
> Hope this helps,
> Daniel
>

[Steffan Choi]

very nice

--
Best regards,

Steffan Choi

[Fred Wang]

This is a patch to added back the -d and daemon 

copy this file to that dir and 

you can use this command to add back the -d args 

patch main.c beanstalkd-daemon.patch

--
You received this message because you are subscribed to the Google Groups "beanstalk-talk" group.
To post to this group, send email to beansta...@googlegroups.com.
To unsubscribe from this group, send email to beanstalk-tal...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.

--
--Sempr

[Fred Wang]

This is a patch to added back the -d and daemon 

copy this file to that dir and 

you can use this command to add back the -d args 

patch main.c beanstalkd-daemon.patch

On Sun, Dec 18, 2011 at 8:26 PM, Ebot Tabi <ebot...@gmail.com> wrote:

--
You received this message because you are subscribed to the Google Groups "beanstalk-talk" group.
To post to this group, send email to beansta...@googlegroups.com.
To unsubscribe from this group, send email to beanstalk-tal...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.

--
------

Fred Wang @ HUST STI

[Sempr]

Sorry, maybe i have send the wrong email.

On Feb 4, 1:57 pm, Fred Wang <iamse...@gmail.com> wrote:
> This is a patch to added back the -d and daemon
>
> copy this file to that dir and
> you can use this command to add back the -d args
>

> *patch main.c beanstalkd-daemon.patch*
> *
> *

>
>
>
>
>
>
>
>
>
> On Sun, Dec 18, 2011 at 8:26 PM, Ebot Tabi <ebot.t...@gmail.com> wrote:
> > Hi there
> > i am new to beanstalkd, looking very interesting and right tool for my
> > php application, will be grateful to know how to setup multiple php
> > worker running on daemon mode and how to manage them and their memory
> > usages. i am currently trying to setup with the php client class:
> > pheanstalk,
>
> > Regards
>
> > --
> > You received this message because you are subscribed to the Google Groups
> > "beanstalk-talk" group.
> > To post to this group, send email to beansta...@googlegroups.com.
> > To unsubscribe from this group, send email to
> > beanstalk-tal...@googlegroups.com.
> > For more options, visit this group at
> >http://groups.google.com/group/beanstalk-talk?hl=en.
>
> --
> --Sempr
>

>  beanstalkd-daemon.patch
> 2KViewDownload

[Chad Kouse]

Sempr check out supervisord - I use it to manage many php consumer processes.

Supervisord.org

--chad

[galo]

Hi,

I have drupal with beanstalkd configured and using the runqueue.sh that comes with the beanstalkd drupal module.

I tested the script and also concluded that the process memory keeps getting bigger and bigger. So I need a way to manage it.

I installed supervisord but unsure as to how it works and how I should configure it to supervise the runqueue.sh script.

Would appreciate it if someone can help me with this.

Thanks

[galo]

So in combination with supervisor, the plugin superlance is needed to auto-restart when you reach a certain amount of memory.