Memory usages keep increasing even when the delayed_job is idling

88 views
Skip to first unread message

kevin hq

unread,
May 10, 2020, 11:32:15 AM5/10/20
to delayed_job
Ruby 2.7.1
Rails 5.2.4.2
DJ 4.1.8

So, it's increasing in few hours or days - even when the worker is not processing any jobs.
We only run 6 workers.
Those workers always killed by OS automatically when its memory usage keeps increasing.

Is there anyone here who's already fix it?

Because I also see many people reports this issue but it looks like there's no final conclusion yet.

https://github.com/sharetribe/sharetribe/issues/2797 => the guy moved to sidekiq. We planned this too but our codes already coupled with delayed_job heavily. Moving to sidekiq will be really a huge job for us.
https://github.com/collectiveidea/delayed_job/issues/823 => tried some solutions there but doesn't work for our case.

Alexandre Roger

unread,
Nov 26, 2020, 4:05:44 PM11/26/20
to delayed_job
we have the same problem here we are updating ruby version 
app was on  ruby-2.1.6   with  * rails (4.2.6) and  * delayed_job (4.1.2)  after a long time (~1 year uptime) 168Mb of ram is used
desired target is  ruby-2.7.1    * rails (5.2.0) and  * delayed_job (4.1.8)  after 3 hours 1.4 Gb of ram is used...

if you find the answer let us know...  will start looking at sidekiq...

kev...@pm.me

unread,
Nov 26, 2020, 7:39:54 PM11/26/20
to delayed_job
Hi,

In our case, there are many failed jobs that's always repeated. This causes memory usages hikes up. After we take care of those repeated failed jobs, we're good now.
Reply all
Reply to author
Forward
0 new messages