"celery worker" process consuming 100% of CPU

1,059 views
Skip to first unread message

Nicholas Tripp

unread,
Feb 16, 2016, 7:04:48 PM2/16/16
to Modern Honey Network
It looks like the "celery worker" process is maxing out both CPUs on our MHN server. I haven't the first clue as to why and would appreciate assistance in figuring it out. I'd like to stay in the good graces of my virtualization team.

Gracias!

Jason Trost

unread,
Feb 16, 2016, 7:28:39 PM2/16/16
to Nicholas Tripp, Modern Honey Network
The celery worker does 2 things

1. Handles password resets
2. Downloads signature files from emerging threats and stores them in MHNs DB

If you don't care about these you can disable it by calling

sudo supervisorctl stop mhn-celery-worker 


On Tuesday, February 16, 2016, Nicholas Tripp <nichola...@duke.edu> wrote:
It looks like the "celery worker" process is maxing out both CPUs on our MHN server. I haven't the first clue as to why and would appreciate assistance in figuring it out. I'd like to stay in the good graces of my virtualization team.

Gracias!

--
You received this message because you are subscribed to the Google Groups "Modern Honey Network" group.
To unsubscribe from this group and stop receiving emails from it, send an email to modern-honey-net...@googlegroups.com.
To post to this group, send email to modern-hon...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/modern-honey-network/fd997f0c-3edd-4065-996d-bfd4d15985aa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


--
Jason Trost | VP of Threat Research | www.threatstream.com
2317 Broadway, 3rd Floor| Redwood City, CA 94063
Phone:  386.235.0078 | Twitter:  @jason_trost


Nicholas Tripp

unread,
Feb 17, 2016, 11:02:59 AM2/17/16
to Modern Honey Network, nichola...@duke.edu
Thanks, Jason!

Unfortunately even with mhn-celery-worker stopped, I'm still seeing 100% CPU usage.

USER      PRI  NI  VIRT   RES   SHR S CPU% MEM%   TIME+  Command
www
-data   20   0  348M  249M  3148 R 99.7  6.3     942h /opt/mhn/env/bin/python /opt/mhn/env/bin/celery worker -A mhn.tasks --loglevel=INFO



On Tuesday, February 16, 2016 at 7:28:39 PM UTC-5, Jason Trost wrote:
The celery worker does 2 things

1. Handles password resets
2. Downloads signature files from emerging threats and stores them in MHNs DB

If you don't care about these you can disable it by calling

sudo supervisorctl stop mhn-celery-worker 

On Tuesday, February 16, 2016, Nicholas Tripp <nichola...@duke.edu> wrote:
It looks like the "celery worker" process is maxing out both CPUs on our MHN server. I haven't the first clue as to why and would appreciate assistance in figuring it out. I'd like to stay in the good graces of my virtualization team.

Gracias!




--

Nick Tripp

unread,
Feb 17, 2016, 11:19:38 AM2/17/16
to Modern Honey Network
You can ignore my previous message. Apparently I just wasn't patient enough in waiting for the existing process to die. Looks good now.

Thanks!

xec...@gmail.com

unread,
Apr 16, 2016, 11:26:40 AM4/16/16
to Modern Honey Network
I am having this same issue but would like to keep this process online for the signature updates. Is there anything I can provide to assist with troubleshooting this further?

Nicholas Tripp

unread,
Apr 11, 2017, 8:09:22 PM4/11/17
to Modern Honey Network
Sorry to dig out this old post, but this is still an issue for us. We're now at a point where downloading sigs from ET is something we're going to want to do.

What can I do to further troubleshoot why mhn-celery-worker constantly sits at 100% CPU usage?
Reply all
Reply to author
Forward
0 new messages