Hi guys,
For my MARL research, I'm writing a DAG framework for Python, i.e. a framework that lets you submit a directed acyclic graph of tasks and have them executed concurrently.
While I'm having a great time designing my own solution, I'm wondering if there's a good package in Python that does that. I know that Apache Airflow exists, but I'm suspicious of it. They used it at a company I worked at, and I remember it took way too much CPU and was a pain to deal with. Looking at the tutorial, it doesn't look very Pythonic to me.
Does anyone have a DAG framework in Python that they can recommend? Any other insights will also be appreciated.
Thanks,
Ram.