Restarting airflow on server restart

Jack Golding

unread,

Oct 14, 2015, 4:56:29 AM10/14/15

to Airflow

Hi All,

I'm using airflow as a cron replacement and wondering how everyone starts airflow scheduler and the web-server running after the server it is running on restarts?

Do you use Apache for the web server or put it in your .bashrc?

Cheers,

Jack

Stan Seibert

unread,

Oct 14, 2015, 9:41:02 AM10/14/15

to Airflow

We use supervisor:

http://supervisord.org/

Since ours is a small installation for internal use, we don’t bother with putting Apache in front of the airflow webapp.

Maxime Beauchemin

unread,

Oct 14, 2015, 11:41:47 AM10/14/15

to Airflow

We use chef and runit, which is a wrapper on top of sv:

https://github.com/hw-cookbooks/runit

Max

Jack Golding

unread,

Oct 15, 2015, 1:15:03 AM10/15/15

to Airflow

Thanks! supervisord was very easy to set up - do you just add a "airflow scheduler" command to this with a DAG with dynamic start time set within your scripts to emulate cron scripts?

Reply all

Reply to author

Forward