AWX installation failed at TASK [Create secret key secret

[Mancoba sanele]

Good day, kindly assist AWX 0.28.0 installation is failing with attach error;

TASK [installer : Check for presence of Deployment] ****************************
task path: /opt/ansible/roles/installer/tasks/main.yml:2

-------------------------------------------------------------------------------
I1017 08:52:07.533414       7 request.go:601] Waited for 1.046113665s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
{"level":"error","ts":1665996728.2397642,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"apps/v1, Kind=Deployment","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
{"level":"info","ts":1665996728.4596345,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Start installation"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Start installation] ******************************************
task path: /opt/ansible/roles/installer/tasks/main.yml:11

-------------------------------------------------------------------------------
{"level":"info","ts":1665996728.7466245,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Patching labels to AWX kind"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Patching labels to AWX kind] *********************************
task path: /opt/ansible/roles/installer/tasks/install.yml:2

-------------------------------------------------------------------------------
{"level":"error","ts":1665996733.1365607,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"awx.ansible.com/v1beta1, Kind=AWX","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
{"level":"info","ts":1665996733.365663,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Include secret key configuration tasks"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Include secret key configuration tasks] **********************
task path: /opt/ansible/roles/installer/tasks/install.yml:21

-------------------------------------------------------------------------------
{"level":"info","ts":1665996733.7242162,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Check for specified secret key configuration"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Check for specified secret key configuration] ****************
task path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:2

-------------------------------------------------------------------------------
{"level":"info","ts":1665996734.162586,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Check for default secret key configuration"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Check for default secret key configuration] ******************
task path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:11

-------------------------------------------------------------------------------
I1017 08:52:17.639706       7 request.go:601] Waited for 1.026746935s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
{"level":"error","ts":1665996738.3633811,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"/v1, Kind=Secret","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
{"level":"info","ts":1665996739.6953268,"logger":"logging_event_handler","msg":"[playbook task start]","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"playbook_on_task_start","job":"5457683338017497464","EventData.Name":"installer : Create secret key secret"}

--------------------------- Ansible Task StdOut -------------------------------

TASK [installer : Create secret key secret] ************************************
task path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:25

-------------------------------------------------------------------------------
{"level":"error","ts":1665996746.7209532,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"/v1, Kind=Secret","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
I1017 08:52:27.868543       7 request.go:601] Waited for 1.04811377s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
{"level":"error","ts":1665996750.4188564,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"/v1, Kind=Secret","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
{"level":"error","ts":1665996754.118693,"logger":"proxy","msg":"Unable to determine if virtual resource","gvk":"/v1, Kind=Secret","error":"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*injectOwnerReferenceHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/inject_owner.go:89\ngithub.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:148\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}
{"level":"error","ts":1665996754.2563937,"logger":"logging_event_handler","msg":"","name":"awx5","namespace":"awx5","gvk":"awx.ansible.com/v1beta1, Kind=AWX","event_type":"runner_on_failed","job":"5457683338017497464","EventData.Task":"Create secret key secret","EventData.TaskArgs":"","EventData.FailedTaskPath":"/opt/ansible/roles/installer/tasks/secret_key_configuration.yml:25","error":"[playbook task failed]"}

--------------------------- Ansible Task StdOut -------------------------------

 TASK [Create secret key secret] ********************************
fatal: [localhost]: FAILED! => {"changed": false, "error": 500, "msg": "Secret awx5-secret-key: Failed to apply object: b'Unable to determine if virtual resource\\n'", "reason": "Internal Server Error", "status": 500}

-------------------------------------------------------------------------------
{"level":"error","ts":1665996754.5696049,"logger":"runner","msg":"ansible-playbook 2.9.27\r\n  config file = /etc/ansible/ansible.cfg\r\n  configured module search path = ['/usr/share/ansible/openshift']\r\n  ansible python module location = /usr/local/lib/python3.8/site-packages/ansible\r\n  executable location = /usr/local/bin/ansible-playbook\r\n  python version = 3.8.12 (default, Sep 16 2021, 10:46:05) [GCC 8.5.0 20210514 (Red Hat 8.5.0-3)]\r\nUsing /etc/ansible/ansible.cfg as config file\r\nSkipping callback 'actionable', as we already have a stdout callback.\nSkipping callback 'awx_display', as we already have a stdout callback.\nSkipping callback 'counter_enabled', as we already have a stdout callback.\nSkipping callback 'debug', as we already have a stdout callback.\nSkipping callback 'dense', as we already have a stdout callback.\nSkipping callback 'dense', as we already have a stdout callback.\nSkipping callback 'full_skip', as we already have a stdout callback.\nSkipping callback 'json', as we already have a stdout callback.\nSkipping callback 'minimal', as we already have a stdout callback.\nSkipping callback 'null', as we already have a stdout callback.\nSkipping callback 'oneline', as we already have a stdout callback.\nSkipping callback 'selective', as we already have a stdout callback.\nSkipping callback 'skippy', as we already have a stdout callback.\nSkipping callback 'stderr', as we already have a stdout callback.\nSkipping callback 'unixy', as we already have a stdout callback.\nSkipping callback 'yaml', as we already have a stdout callback.\n\r\nPLAYBOOK: 8696b94050ee45a89661eb7480d4ae58 *************************************\n1 plays in /tmp/ansible-operator/runner/awx.ansible.com/v1beta1/AWX/awx5/awx5/project/8696b94050ee45a89661eb7480d4ae58\n[WARNING]: Found variable using reserved name: no_log\n\r\nPLAY [localhost] ***************************************************************\nMETA: ran handlers\n\r\nTASK [installer : Check for presence of Deployment] ****************************\r\ntask path: /opt/ansible/roles/installer/tasks/main.yml:2\nok: [localhost] => {\"api_found\": true, \"changed\": false, \"resources\": []}\n\r\nTASK [installer : Start installation] ******************************************\r\ntask path: /opt/ansible/roles/installer/tasks/main.yml:11\nincluded: /opt/ansible/roles/installer/tasks/install.yml for localhost\n\r\nTASK [installer : Patching labels to AWX kind] *********************************\r\ntask path: /opt/ansible/roles/installer/tasks/install.yml:2\nok: [localhost] => {\"changed\": false, \"method\": \"patch\", \"result\": {\"apiVersion\": \"awx.ansible.com/v1beta1\", \"kind\": \"AWX\", \"metadata\": {\"annotations\": {\"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"awx.ansible.com/v1beta1\\\",\\\"kind\\\":\\\"AWX\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"awx5\\\",\\\"namespace\\\":\\\"awx5\\\"},\\\"spec\\\":{\\\"no_log\\\":\\\"false\\\",\\\"nodeport_port\\\":30080,\\\"service_type\\\":\\\"nodeport\\\"}}\\n\"}, \"creationTimestamp\": \"2022-10-05T16:44:27Z\", \"generation\": 2, \"labels\": {\"app.kubernetes.io/component\": \"awx\", \"app.kubernetes.io/managed-by\": \"awx-operator\", \"app.kubernetes.io/name\": \"awx5\", \"app.kubernetes.io/operator-version\": \"0.28.0\", \"app.kubernetes.io/part-of\": \"awx5\"}, \"managedFields\": [{\"apiVersion\": \"awx.ansible.com/v1beta1\", \"fieldsType\": \"FieldsV1\", \"fieldsV1\": {\"f:status\": {\".\": {}, \"f:conditions\": {}}}, \"manager\": \"ansible-operator\", \"operation\": \"Update\", \"subresource\": \"status\", \"time\": \"2022-10-05T16:44:27Z\"}, {\"apiVersion\": \"awx.ansible.com/v1beta1\", \"fieldsType\": \"FieldsV1\", \"fieldsV1\": {\"f:metadata\": {\"f:labels\": {\".\": {}, \"f:app.kubernetes.io/component\": {}, \"f:app.kubernetes.io/managed-by\": {}, \"f:app.kubernetes.io/name\": {}, \"f:app.kubernetes.io/operator-version\": {}, \"f:app.kubernetes.io/part-of\": {}}}}, \"manager\": \"OpenAPI-Generator\", \"operation\": \"Update\", \"time\": \"2022-10-05T16:44:43Z\"}, {\"apiVersion\": \"awx.ansible.com/v1beta1\", \"fieldsType\": \"FieldsV1\", \"fieldsV1\": {\"f:metadata\": {\"f:annotations\": {\".\": {}, \"f:kubectl.kubernetes.io/last-applied-configuration\": {}}}, \"f:spec\": {\".\": {}, \"f:admin_user\": {}, \"f:auto_upgrade\": {}, \"f:create_preload_data\": {}, \"f:garbage_collect_secrets\": {}, \"f:image_pull_policy\": {}, \"f:loadbalancer_port\": {}, \"f:loadbalancer_protocol\": {}, \"f:no_log\": {}, \"f:nodeport_port\": {}, \"f:projects_persistence\": {}, \"f:projects_storage_access_mode\": {}, \"f:projects_storage_size\": {}, \"f:replicas\": {}, \"f:route_tls_termination_mechanism\": {}, \"f:service_type\": {}, \"f:set_self_labels\": {}, \"f:task_privileged\": {}}}, \"manager\": \"kubectl-client-side-apply\", \"operation\": \"Update\", \"time\": \"2022-10-05T18:28:43Z\"}], \"name\": \"awx5\", \"namespace\": \"awx5\", \"resourceVersion\": \"314665\", \"uid\": \"ba49d29a-c495-4cfb-b2aa-11cc7ba144ee\"}, \"spec\": {\"admin_user\": \"admin\", \"auto_upgrade\": true, \"create_preload_data\": true, \"garbage_collect_secrets\": false, \"image_pull_policy\": \"IfNotPresent\", \"loadbalancer_port\": 80, \"loadbalancer_protocol\": \"http\", \"no_log\": \"false\", \"nodeport_port\": 30080, \"projects_persistence\": false, \"projects_storage_access_mode\": \"ReadWriteMany\", \"projects_storage_size\": \"8Gi\", \"replicas\": 1, \"route_tls_termination_mechanism\": \"Edge\", \"service_type\": \"nodeport\", \"set_self_labels\": true, \"task_privileged\": false}, \"status\": {\"conditions\": [{\"lastTransitionTime\": \"2022-10-05T16:44:59Z\", \"reason\": \"\", \"status\": \"False\", \"type\": \"Successful\"}, {\"lastTransitionTime\": \"2022-10-17T08:51:12Z\", \"reason\": \"Failed\", \"status\": \"False\", \"type\": \"Failure\"}, {\"lastTransitionTime\": \"2022-10-17T08:51:59Z\", \"reason\": \"Running\", \"status\": \"True\", \"type\": \"Running\"}]}}}\n\r\nTASK [installer : Include secret key configuration tasks] **********************\r\ntask path: /opt/ansible/roles/installer/tasks/install.yml:21\nincluded: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml for localhost\n\r\nTASK [installer : Check for specified secret key configuration] ****************\r\ntask path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:2\nskipping: [localhost] => {\"changed\": false, \"skip_reason\": \"Conditional result was False\"}\n\r\nTASK [installer : Check for default secret key configuration] ******************\r\ntask path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:11\nok: [localhost] => {\"api_found\": true, \"changed\": false, \"resources\": []}\n\r\nTASK [installer : Set secret key secret] ***************************************\r\ntask path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:19\nok: [localhost] => {\"ansible_facts\": {\"_secret_key_secret\": {\"api_found\": true, \"changed\": false, \"failed\": false, \"resources\": []}}, \"changed\": false}\n\r\nTASK [installer : Create secret key secret] ************************************\r\ntask path: /opt/ansible/roles/installer/tasks/secret_key_configuration.yml:25\nfatal: [localhost]: FAILED! => {\"changed\": false, \"error\": 500, \"msg\": \"Secret awx5-secret-key: Failed to apply object: b'Unable to determine if virtual resource\\\\n'\", \"reason\": \"Internal Server Error\", \"status\": 500}\n\r\nPLAY RECAP *********************************************************************\r\nlocalhost                  : ok=6    changed=0    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0   \r\n\n","job":"5457683338017497464","name":"awx5","namespace":"awx5","error":"exit status 2"}

----- Ansible Task Status Event StdOut (awx.ansible.com/v1beta1, Kind=AWX, awx5/awx5) -----


PLAY RECAP *********************************************************************
localhost                  : ok=6    changed=0    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0  

[Mancoba sanele]

Any ideas on the below or better installation guide 

--
You received this message because you are subscribed to the Google Groups "AWX Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email to awx-project...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/awx-project/348e98cd-86be-4e3b-8700-4978118d186an%40googlegroups.com.

[V!]

You need to share the other configurationfiles you used to set it up to be able to see what you have configured wrong

[V!]

You also have error with retrieving something:

"unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request","stacktrace":"github.com/operator-framework/operator-sdk/internal/ansible/proxy.(*cacheResponseHandler).ServeHTTP\n\t/workspace/internal/ansible/proxy/cache_response.go:97\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2916\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1966"}

check that you actually have internett access

[Mancoba sanele]

Yes internet confirmed working, although i get a lot of the timeouts; below are my configs :

kustomization.yaml

---

apiVersion: kustomize.config.k8s.io/v1beta1

kind: Kustomization

resources:

  # Find the latest tag here: https://github.com/ansible/awx-operator/releases

  - github.com/ansible/awx-operator/config/default?ref=0.28.0

  - awx.yaml

# Set the image tags to match the git version from above

images:

  - name: quay.io/ansible/awx-operator

    newTag: 0.28.0

# Specify a custom namespace in which to install AWX

namespace: awx1

awx.yaml

---

apiVersion: awx.ansible.com/v1beta1

kind: AWX

metadata:

  name: awx

spec:

  service_type: nodeport

  nodeport_port: 30080

  no_log: 'false'

To view this discussion on the web visit https://groups.google.com/d/msgid/awx-project/c18a0d10-7f6d-4aec-bcba-219e2b608433n%40googlegroups.com.

[AWX Project]

"although i get a lot of the timeouts;"

where do you see these timeouts? in the kube logs? can you copy and paste those?