airflow-workers are constantly restarting

[rbr...@stubhub.com]

My cluster is just incredibly unstable.  It's now in a CrashLoopBackOff state for most of the workers.  They are constantly restarting.  This is in addition to my webserver returning 502s.  

The DAGs are fine. There haven't been any issues with them but the cluster is having serious trouble.  I keep having to migrate clusters which is a huge pain.  

[Haotian Wu]

Hi,

Sorry to hear your issues with Cloud Composer. Are you able to see error from airflow worker logs? If webserver is in 502 state, there must be something wrong beyond resources issue for airflow workers.

On Mon, Jan 28, 2019 at 5:06 PM <rbr...@stubhub.com> wrote:

My cluster is just incredibly unstable.  It's now in a CrashLoopBackOff state for most of the workers.  They are constantly restarting.  This is in addition to my webserver returning 502s.  

The DAGs are fine. There haven't been any issues with them but the cluster is having serious trouble.  I keep having to migrate clusters which is a huge pain.  

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To post to this group, send email to cloud-compo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/4a16cf5d-fa2f-4c31-8fb9-703e836e00c1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.