Resque Workers Stuck

59 views
Skip to first unread message

Avishai Weiss

unread,
May 11, 2012, 3:09:30 AM5/11/12
to isra...@googlegroups.com
Hi, has anyone had any experience using Resque? I'm using it to download and process thousands of images in the background, and then stick them into S3. But, after a while, the jobs seem to get stuck and them just kind of die. How do you make them stay alive or restart if something happens that kills off the worker or gets it stuck?

Thanks

Avishai

Avi Tzurel

unread,
May 11, 2012, 5:33:51 AM5/11/12
to isra...@googlegroups.com
We run about 150 resque workers in production.

We use GOD to monitor the process and alert us on anything from a worker taking too much memory or anything else we may want.

GOD monitors the process and can wake it up if it dies.

I gisted a configuration for you.


We restart resque on every deployment with signaling god to quit and then god -c {god_file_location}




--
You received this message because you are subscribed to the Google Groups "Israel.rb - the Israel Ruby & Israel Rails Developers group" group.
To post to this group, send email to isra...@googlegroups.com.
To unsubscribe from this group, send email to israelrb+u...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/israelrb?hl=en.

Avishai Weiss

unread,
May 11, 2012, 5:52:56 AM5/11/12
to isra...@googlegroups.com
Awesome, I'll set that up, thanks!
Reply all
Reply to author
Forward
0 new messages