Airflow fails at startup
938 views
Skip to first unread message
r0ger
Apr 28, 2016, 2:32:43 AM4/28/16
to Airflow
initdb works.
Then I do `airflow scheduler`... I see a lot of logs (is there a way to not make these logs so verbose?).
And finally it spits out these logs:
We are using sql_alchemy_conn_cmd to run a script which returns the mysql connection url (we are using aurora).
I hope someone has seen this before.
Why would this be happening?
2016-04-28 06:28:29,400] {connectionpool.py:207} INFO - Starting new HTTP connection (1): 10.41.30.136
[2016-04-28 06:28:29 +0000] [173] [ERROR] Exception in worker process:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/gunicorn/arbiter.py", line 507, in spawn_worker
worker.init_process()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/workers/base.py", line 118, in init_process
self.wsgi = self.app.wsgi()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 65, in load
return self.load_wsgiapp()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 52, in load_wsgiapp
return util.import_app(self.app_uri)
File "/usr/local/lib/python2.7/dist-packages/gunicorn/util.py", line 355, in import_app
__import__(module)
File "/usr/local/lib/python2.7/dist-packages/airflow/__init__.py", line 14, in <module>
from airflow import configuration as conf
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 516, in <module>
conf.read(AIRFLOW_CONFIG)
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 449, in read
self._validate()
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 391, in _validate
and "sqlite" in self.get('core', 'sql_alchemy_conn'):
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 416, in get
return run_command(command)
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 54, in run_command
raise AirflowException(
NameError: global name 'AirflowException' is not defined
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/gunicorn/arbiter.py", line 507, in spawn_worker
worker.init_process()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/workers/base.py", line 118, in init_process
self.wsgi = self.app.wsgi()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/base.py", line 67, in wsgi
self.callable = self.load()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 65, in load
return self.load_wsgiapp()
File "/usr/local/lib/python2.7/dist-packages/gunicorn/app/wsgiapp.py", line 52, in load_wsgiapp
return util.import_app(self.app_uri)
File "/usr/local/lib/python2.7/dist-packages/gunicorn/util.py", line 355, in import_app
__import__(module)
File "/usr/local/lib/python2.7/dist-packages/airflow/__init__.py", line 14, in <module>
from airflow import configuration as conf
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 516, in <module>
conf.read(AIRFLOW_CONFIG)
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 449, in read
self._validate()
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 391, in _validate
and "sqlite" in self.get('core', 'sql_alchemy_conn'):
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 416, in get
return run_command(command)
File "/usr/local/lib/python2.7/dist-packages/airflow/configuration.py", line 54, in run_command
raise AirflowException(
NameError: global name 'AirflowException' is not defined
[2016-04-28 06:28:29 +0000] [173] [INFO] Worker exiting (pid: 173)
r0ger
Apr 28, 2016, 2:41:19 AM4/28/16
to Airflow
Also, I see a lot of scheduler processes starting up:
WHY??
UID PID PPID C STIME TTY TIME CMD
airflow 99 1 5 06:39 ? 00:00:01 /usr/bin/python /usr/local/bin/airflow webserver -p 8080
airflow 100 1 16 06:39 ? 00:00:04 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 168 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 169 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 170 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 171 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 172 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 173 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 174 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 175 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 176 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 177 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 178 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 179 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 180 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 181 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 182 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 183 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 184 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 185 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 186 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 187 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 188 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 189 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 190 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 191 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 192 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 193 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 194 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 195 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 196 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 197 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 198 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 199 100 0 06:39 ? 00:00:00 /usr/bin/python /usr/local/bin/airflow scheduler
airflow 201 99 0 06:39 ? 00:00:00 gunicorn: master [airflow.www.app:cached_app()]
airflow 206 201 6 06:39 ? 00:00:01 gunicorn: worker [airflow.www.app:cached_app()]
airflow 208 201 5 06:39 ? 00:00:01 gunicorn: worker [airflow.www.app:cached_app()]
airflow 209 201 6 06:39 ? 00:00:01 gunicorn: worker [airflow.www.app:cached_app()]
airflow 211 201 5 06:39 ? 00:00:01 gunicorn: worker [airflow.www.app:cached_app()]
r0ger
Apr 28, 2016, 2:43:26 AM4/28/16
to Airflow
sql_alchemy_conn_cmd = ./setup/configure.py
I see a lot of processes started : Something weird going on!!!
airflow 2271 2176 20 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2274 2178 32 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2275 2180 26 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2285 2182 19 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2288 2192 0 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2294 2188 0 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2295 2187 0 06:42 ? 00:00:00 python ./setup/configure.py
airflow 2307 2189 0 06:42 ? 00:00:00 python ./setup/configure.py
Reply all
Reply to author
Forward
0 new messages