Skip to first unread message
m t
Apr 18, 2016, 10:52:33 AM4/18/16
to Airflow
Hi,
I' have a DAG that should be executed every hour and I need it to be scheduled precisely every hour.
Right now the DAG start times I can see in the Web UI are sliding a few minutes for each run.
Start time for a schedule "15 * * * *" are 00:16:34, 01:20:34, 02:25:34 etc. This ends up by producing an error in my DAG.
The only strange thing I can see is that the DAGs stay in running mode for a long time with all the tasks marked as finished.
The maximum time of execution of my longest task is 15 minutes and I'm running all tasks in parallel without any dependency.
Another problem I see is that the DAG end_times are always undefined in the WebUI (and always NULL in the database).
Any help with this would be appreciated.
I'm running airflow 1.7.0 with LocalExecutor and all tasks being remote bash scripts executed with the SSHExecuteOperator.
Michal
I' have a DAG that should be executed every hour and I need it to be scheduled precisely every hour.
Right now the DAG start times I can see in the Web UI are sliding a few minutes for each run.
Start time for a schedule "15 * * * *" are 00:16:34, 01:20:34, 02:25:34 etc. This ends up by producing an error in my DAG.
The only strange thing I can see is that the DAGs stay in running mode for a long time with all the tasks marked as finished.
The maximum time of execution of my longest task is 15 minutes and I'm running all tasks in parallel without any dependency.
Another problem I see is that the DAG end_times are always undefined in the WebUI (and always NULL in the database).
Any help with this would be appreciated.
I'm running airflow 1.7.0 with LocalExecutor and all tasks being remote bash scripts executed with the SSHExecuteOperator.
Michal
Reply all
Reply to author
Forward
0 new messages