[New project] aiotasks: Celery like task manager for new AsyncIO Python module

[cr0hn]

Hi everybody!

I just released the project aiotasks. The idea of the project is to try to does like celery-task manager things, but for asyncio tasks. 

Concepts around the project: distributed tasks (coroutines), event-driven tasks, published-subscriber wrapping, easy of use.

The project is still in alpha, but it works. Currently only support Redis (pub-sub) and memory backends.

If anyone want to collaborate are welcome :)

https://github.com/cr0hn/aiotasks

Best regards!

---

Daniel García (cr0hn)

Security researcher and ethical hacker

Personal site: http://cr0hn.com

Linkedin: https://www.linkedin.com/in/garciagarciadaniel 

Company: http://abirtone.com 

Twitter: @ggdaniel 

[Samuel Colvin]

Interesting. Why did you choose to use redis pub-sub? I've found it problematic as if the worker misses the job it's gone forever. Do you have a way round this?

I built arq for a similar purpose but (like rq and other redis queueing/task/rpc libraries) it uses redis arrays not pub-sub so jobs can build up and still get processed by the worker rather than lost.