Unknown problem with connection to Airflow Database, server closed connection unexpectedly

[Digiw Chanan Chanachon]

I have daily ingest pipeline as production runs on Cloud Composer, the code is unchanged for a while. One day there is one error that raised from database_health.py which is shown in attached

after that, in Log Explorer their are following errors from "airflow-scheduler" and "airflow-worker" that have the same errors text as above like "server closed connection unexpectedly"

I want to know how to deal with this issue, it maybe happen occasionally but the customer are really concern with this problem.

Sincerely

Chanan

 

[Rafal Biegacz]

Hi,

Digiw - I would take a look at this section in the documentation: https://cloud.google.com/composer/docs/troubleshooting-scheduling#database-overload-symptoms and I would apply the recommendations that are mentioned in the section.

If you are using a 6 months or older version of Composer I would recommend upgrading to the newer version (in newer versions there were changes improving connectivity to Airflow DB).

Regards, Rafal.

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/3f7944db-e461-4f37-8385-6755c29784c3n%40googlegroups.com.