AWX errors after Deploying K8s single Node Cluster.

286 views
Skip to first unread message

brookman amissah ocran

unread,
Aug 3, 2022, 8:56:07 AM8/3/22
to awx-p...@googlegroups.com, ahilan.sw...@cgi.com, Amissah Ocran, Brookman
Team,
Any help will be appreciated.
  1. We successfully deployed AWX in K8s single node cluster, but when we run any task from the AWX web console that task fails, we checked the logs and found the below error. 

 

********************************************************************************************************************************************************************************************

Warning  Evicted              18m   kubelet            The node was low on resource: ephemeral-storage. Container awx-task was using 3427520Ki, which exceeds its request of 0. Container awx-ee was using 4425468Ki, which exceeds its request of 0. Container redis was using 32Ki, which exceeds its request of 0. Container awx-web was using 152Ki, which exceeds its request of 0.

 

Events:

  Type     Reason            Age    From               Message

  ----     ------            ----   ----               -------

  Warning  FailedScheduling  8m45s  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/disk-pressure: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

*********************************************************************************************************************************************************************************************

And our AWX server file system details as below...

[root@xl8phxc360awxtst ~]# df -Th / /var /var/log /var/lib/containerd /var/lib/kubelet/

Filesystem     Type  Size  Used Avail Use% Mounted on

/dev/xvda8     ext4  9.3G  6.2G  2.7G  70% /

/dev/xvdb5     ext4   30G  1.2G   27G   5% /var

/dev/xvdb6     ext4   15G  146M   14G   2% /var/log

/dev/xvdb2     ext4   25G  8.5G   15G  37% /var/lib/containerd

/dev/xvdb5     ext4   30G  1.2G   27G   5% /var

[root@xl8phxc360awxtst ~]#

 Does anyone know the meaning of the error and any solutions to fixing it?

Secondly,

what are the minimum size requirements for the /root file system(/) for installing AWX in a single node K8s Cluster?

 

Brookman Amissah-Ocran Jr
  Sr.Linux/DevOps System Engineer.


AWX Project

unread,
Aug 3, 2022, 10:44:12 AM8/3/22
to AWX Project
HI!

Are you setting resource requests in the awx spec? Also what version of awx-operator, awx, and k8s are you on? Thanks

AWX Team

Ahilan Swaminathan

unread,
Aug 4, 2022, 1:04:27 AM8/4/22
to awx-p...@googlegroups.com
Are you setting resource requests in the awx spec?
No. We are not setting any requests in awx spec

what version of awx-operator, awx, and k8s are you on?
K8s: v1.24.2
AWX Vesion: 20.1.0
AWX Operator: 0.20.0


Thanks and Regards
S.Ahilan
Lead Analyst
CGI Software Solutions and consultant Pvt Ltd
DLF IT Park
Chennai 600089
+91-9486332230





--
You received this message because you are subscribed to the Google Groups "AWX Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email to awx-project...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/awx-project/7e454aa2-199b-469c-bedd-6dec72e8d5can%40googlegroups.com.

Alex Shishko

unread,
Aug 4, 2022, 8:29:45 AM8/4/22
to awx-p...@googlegroups.com
Hi, compare with this content
https://youtu.be/73EH4crtF_Q

чт, 4 авг. 2022 г. в 08:04, Ahilan Swaminathan <ahil...@gmail.com>:

Ahilan Swaminathan

unread,
Aug 11, 2022, 12:46:18 PM8/11/22
to awx-p...@googlegroups.com, bar...@gmail.com, brookman.a...@cgi.com, brok...@gmail.com, ahilan.swaminathan
Hi Alex

We don't have any issues in deploying the awx, awx operator and postgres. We have successfully deployed it and when we run template from awx dashboard, it fails and then we checked the logs and got below errors. 

Here the question is how much space we need for / root, and why we got below error while run the template task. That’s question but we haven’t get answer any one from the awx project team.

“Warning  FailedScheduling  2m22s  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/di
sk-pressure: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

Message:      The node was low on resource: ephemeral-storage. Container awx-ee was using 4425836Ki, which exceeds its request of 0. C
ontainer redis was using 64Ki, which exceeds its request of 0. Container awx-task was using 3428720Ki, which exceeds its request of 0.
 Container awx-web was using 312Ki, which exceeds its request of 0.”
Reply all
Reply to author
Forward
0 new messages