Memory usages keep increasing even when the delayed_job is idling

[kevin hq]

Ruby 2.7.1
Rails 5.2.4.2
DJ 4.1.8

So, it's increasing in few hours or days - even when the worker is not processing any jobs.
We only run 6 workers.
Those workers always killed by OS automatically when its memory usage keeps increasing.

Is there anyone here who's already fix it?

Because I also see many people reports this issue but it looks like there's no final conclusion yet.

- https://github.com/sharetribe/sharetribe/issues/2797 => the guy moved to sidekiq. We planned this too but our codes already coupled with delayed_job heavily. Moving to sidekiq will be really a huge job for us.
- https://github.com/collectiveidea/delayed_job/issues/823 => tried some solutions there but doesn't work for our case.

[Alexandre Roger]

we have the same problem here we are updating ruby version 

app was on  ruby-2.1.6   with  * rails (4.2.6) and  * delayed_job (4.1.2)  after a long time (~1 year uptime) 168Mb of ram is used

desired target is  ruby-2.7.1    * rails (5.2.0) and  * delayed_job (4.1.8)  after 3 hours 1.4 Gb of ram is used...

if you find the answer let us know...  will start looking at sidekiq...

[kev...@pm.me]

Hi,

In our case, there are many failed jobs that's always repeated. This causes memory usages hikes up. After we take care of those repeated failed jobs, we're good now.