KubernetesPodOperator Job failing intermittently with missing composer_kube_config

[John Sek Jia Sheng]

As per title,

        Some of our kubernetespodoperator job are failing intermittently with error [Errno 2] No such file or directory:No such file or directory: '/home/airflow/composer_kube_config'. Other jobs that run on default node pool are not affected. Any suggestion?

Regards,

John

[Cedrik Neumann]

It's likely that the corresponding worker pod for some reason doesn't have the kube config deployed. You can check by attaching to your worker pods. Usually killing will spawn new ones with the config deployed. This happened to me as well. Still a good question what happened with the config.

---

From: cloud-compo...@googlegroups.com <cloud-compo...@googlegroups.com> on behalf of John Sek Jia Sheng <john...@iproperty.com>
Sent: Friday, July 12, 2019 5:50:55 AM
To: cloud-composer-discuss
Subject: KubernetesPodOperator Job failing intermittently with missing composer_kube_config

 

--
You received this message because you are subscribed to the Google Groups "cloud-composer-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-composer-di...@googlegroups.com.
To post to this group, send email to cloud-compo...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-composer-discuss/709935d4-d554-4b19-abf8-a1614a142571%40googlegroups.com [groups.google.com].
For more options, visit https://groups.google.com/d/optout [groups.google.com].