Celery is rerunning completed tasks over and over

[abhishek pareek]

I've a python celery-redis queue processing uploads and downloads worth gigs and gigs of data at a time.

Few of the uploads takes upto few hours. However once such a task finishes, I'm witnessing this bizarre celery behavior that the celery scheduler is rerunning the just concluded task again by sending it again to the worker (I'm running a single worker) And it just happened upto 4 times on the same task! (My CELERYD_PREFETCH_MULTIPLIER is set to 1)

Can someone help me debug why is this happening and how can I prevent it?

The tasks are definitely finishing cleanly with no errors reported just that these are extremely long running tasks.

[Loic Duros]

Just curious: Do you use CELERY_ACKS_LATE?

I've seen this similar behavior when CELERY_ACKS_LATE was on and that the task would exceed the limit before being fully completed.

--
You received this message because you are subscribed to the Google Groups "celery-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to celery-users...@googlegroups.com.
To post to this group, send email to celery...@googlegroups.com.
Visit this group at http://groups.google.com/group/celery-users.
For more options, visit https://groups.google.com/d/optout.

--

Loic J. Duros - http://lduros.net

[Ask Solem]

Did you read about the Redis caveats?  More specifically the visibility_timeout setting here:

http://docs.celeryproject.org/en/latest/getting-started/brokers/redis.html#visibility-timeout

-- 
Ask Solem
twitter.com/asksol | +44 07454281208

[abhishek pareek]

Thanks Sol! I'll try this right now... 

[abhishek pareek]

no I'm not using CELERY_ACKS_LATE here. I think Sols' answer should help though.