Error creating pod: container failed to start, ImagePullBackOff

2,600 views
Skip to first unread message

hosyhama

unread,
Jul 19, 2022, 9:15:32 AM7/19/22
to AWX Project
I am using AWX20.0.0

It worked fine for up to 2 months

"Error creating pod: container failed to start, ImagePullBackOff" is displayed in Job Output View when the playbook is executed.

I want to know the cause. Does anyone have similar symptoms?

AWX Project

unread,
Jul 20, 2022, 3:34:49 PM7/20/22
to AWX Project
Are you using the default awx-ee image to run these jobs?

AWX Project

unread,
Jul 20, 2022, 4:22:58 PM7/20/22
to AWX Project
If you are not using a default execution environment image, you may need to configure an image pull secret if the registry is private/protected.  Please note that the "image_pull_secrets" field on the spec is plural and takes an array, not a string.  https://github.com/ansible/awx-operator#deploying-a-specific-version-of-awx

Thanks,
AWX Team

hosyhama

unread,
Jul 25, 2022, 8:20:33 AM7/25/22
to AWX Project
> Are you using the default awx-ee image to run these jobs?
Yes. However, it seems that the environment changed while I was away from the team.
Originally, when it was built, it communicated with the Internet.
The company policy has become stricter and we are currently removing the proxy setting.
Now the environment cannot connect to the internet. '
When I executed the command "minikube logs", the following message was output.
------------------------------------------------------------
Jul 25 11:53:29 minikube kubelet[821]: E0725 11:53:29.741250     821 pod_workers.go:918] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"worker\" withErrImagePull: \"rpc 
error: code = Unknown desc = Error response from daemon: Get \\\"https://quay.io/v2/\\\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)\"" pod="awxope1/automation-job-622-vnrhs" podUID=f81f1de7-d1e6-4977-b765-fb00e57a30a7

Jul 25 11:54:37 minikube kubelet[821]: E0725 11:54:37.741473     821 remote_image.go:216] "PullImage from image service failed" err="rpc error: code = Unknown desc = Error response from daemon: Get \"https://quay.io/v2/\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" image="quay.io/ansible/awx-ee:latest"

------------------------------------------------------------

Let me ask you an additional question.
Can this be resolved by placing the default execution environment image locally? Where do you place it and what settings do I need?

Thanks


2022年7月21日木曜日 5:22:58 UTC+9 AWX Project:

AWX Project

unread,
Jul 27, 2022, 3:45:51 PM7/27/22
to AWX Project
Hi, it's possible to deploy without internet, see this discussion https://groups.google.com/g/awx-project/c/e_amqVXwROE

You will need to set up a private registry to host all of the images that will be referenced by AWX

Let us know if that is helpful

AWX Team

Reply all
Reply to author
Forward
0 new messages