very light weight django task queues

[TinyJaguar]

I've been using both django-huey and celery as task queues with varying success in other projects.
see (https://www.djangopackages.com/grids/g/workers-queues-tasks/)

Most of the task queues are redis based. They seem to be overkill for our current situation and add another layer of system maintenance (i.e a redis instance) and we want/need to have a minimum of packages on our micro instances (currently just django, postgres, nginx and a few tiny packages)

Our typical background tasks occur once or twice a week! and may take about 30 minutes to a few hours to process.
What I'm looking for is a very very simple task queue that does not use redis or any other 'external' database. Just a bunch of tables in the current app's database would be fine.

what would you suggest?

 

[esatte...@wi.rr.com]

Django ztask is a pretty good solution for what you are describing

https://github.com/dmgctrl/django-ztask

[Derek]

Maybe have a look at these ideas:

http://themattreid.com/wordpress/2011/01/20/simple-python-a-job-queue-with-threading/

https://www.jeffknupp.com/blog/2014/02/11/a-celerylike-python-task-queue-in-55-lines-of-code/

[Arnold Krille]

django-extensions allows to define scripts for
cron.[hourly|daily|weekly], you just have to make cron call them.

But that assumes that your tasks don't have to run asap after being
scheduled.

- Arnold

[Russell Keith-Magee]

Hi,

Another option to throw onto the pile:

https://github.com/bretth/django-pq

This was recommended to me by Jannis Leidel (jezdez), who used it on caniusepython3.com.

Yours,

Russ Magee %-)

--
You received this message because you are subscribed to the Google Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to django-users...@googlegroups.com.
To post to this group, send email to django...@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.
To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/22067995-cdb5-42ed-bb9e-4d8a80b2fc4d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[VidJa Hunter]

thanks guys,

i'm going to try a few, but django-pq looks very promising.

cheers,

Vid

--
You received this message because you are subscribed to a topic in the Google Groups "Django users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/django-users/TZw6meNxujc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to django-users...@googlegroups.com.

To post to this group, send email to django...@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users.

To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/CAJxq84_QqCSgyFShDec2%3Dx_NE1YXAPaz0Dx36RTkzx7QCzaM%2Bw%40mail.gmail.com.