Error-in-virt-handler

17 views
Skip to first unread message

Alejandro Jesus Nuñez Madrazo

unread,
Jun 3, 2020, 9:59:37 AM6/3/20
to kubevirt-dev
I have two nodes, everything is working fine, but the virt-handler component gives error in one of the nodes, here I leave the logs

kubevirt version 0.29.0
kubernetes version v1.18

root@host-238:/home/alejandrojnm# kubectl get pods -n kubevirt -o wide
NAME                             READY   STATUS       RESTARTS   AGE   IP            NODE                   NOMINATED NODE   READINESS GATES
virt
-api-77b4b4d44d-b8ps7        1/1     Running      0          15h   10.244.1.5    host-240.ocp-testing   <none>           <none>
virt
-api-77b4b4d44d-ccl8s        1/1     Running      0          15h   10.244.1.6    host-240.ocp-testing   <none>           <none>
virt
-controller-cd8bdff9-2ztpd   1/1     Running      0          15h   10.244.1.9    host-240.ocp-testing   <none>           <none>
virt
-controller-cd8bdff9-qgl2d   1/1     Running      0          15h   10.244.1.8    host-240.ocp-testing   <none>           <none>
virt
-handler-hmjdb               1/1     Running      0          14h   10.244.0.4    host-238.ocp-testing   <none>           <none>
virt
-handler-vdmpz               0/1     Init:Error   3          50s   10.244.1.10   host-240.ocp-testing   <none>           <none>
virt
-operator-57c84c94-smds7     1/1     Running      0          15h   10.244.1.3    host-240.ocp-testing   <none>           <none>
virt
-operator-57c84c94-wl7xt     1/1     Running      0          15h   10.244.1.2    host-240.ocp-testing   <none>           <none>

root@host-238:/home/alejandrojnm# kubectl logs virt-handler-vdmpz -n kubevirt
Error from server (BadRequest): container "virt-handler" in pod "virt-handler-vdmpz" is waiting to start: PodInitializing

root@host-238:/home/alejandrojnm# kubectl describe pod virt-handler-vdmpz -n kubevirt
Name:                 virt-handler-vdmpz
Namespace:            kubevirt
Priority:             1000000000
Priority Class Name:  kubevirt-cluster-critical
Node:                 host-240.ocp-testing/10.227.61.96
Start Time:           Wed, 03 Jun 2020 13:44:13 +0000
Labels:               app.kubernetes.io/managed-by=kubevirt-operator
                      controller
-revision-hash=754856b84b
                      kubevirt
.io=virt-handler
                      pod
-template-generation=1
                      prometheus
.kubevirt.io=
Annotations:          k8s.v1.cni.cncf.io/network-status:
                       
[{
                           
"name": "cbr0",
                           
"interface": "eth0",
                           
"ips": [
                               
"10.244.1.10"
                           
],
                           
"mac": "42:94:75:b7:f9:22",
                           
"default": true,
                           
"dns": {}
                       
}]
                      k8s
.v1.cni.cncf.io/networks-status:
                       
[{
                           
"name": "cbr0",
                           
"interface": "eth0",
                           
"ips": [
                               
"10.244.1.10"
                           
],
                           
"mac": "42:94:75:b7:f9:22",
                           
"default": true,
                           
"dns": {}
                       
}]
                      kubevirt
.io/install-strategy-identifier: 08ec013ffd5a66b5a340a752cd9180b21e5cfcf8
                      kubevirt
.io/install-strategy-registry: index.docker.io/kubevirt
                      kubevirt
.io/install-strategy-version: v0.29.0
                      scheduler
.alpha.kubernetes.io/critical-pod:
Status:               Pending
IP
:                   10.244.1.10
IPs:
  IP
:           10.244.1.10
Controlled By:  DaemonSet/virt-handler
Init Containers:
  virt
-launcher:
   
Container ID:  docker://62e14c791fa296ece50a2f848d098786b4051d855fd8c930139c0721185d3741
   
Image:         index.docker.io/kubevirt/virt-launcher@sha256:ee6cad8e8d425689d610b73d6f25d8cea3b1af71a776b82513ed96ec8581d198
   
Image ID:      docker-pullable://kubevirt/virt-launcher@sha256:ee6cad8e8d425689d610b73d6f25d8cea3b1af71a776b82513ed96ec8581d198
   
Port:          <none>
   
Host Port:     <none>
   
Command:
     
/bin/sh
     
-c
   
Args:
     
/bin/node-labeller.sh
   
State:          Waiting
     
Reason:       CrashLoopBackOff
   
Last State:     Terminated
     
Reason:       Error
     
Exit Code:    1
     
Started:      Wed, 03 Jun 2020 13:45:01 +0000
     
Finished:     Wed, 03 Jun 2020 13:45:01 +0000
   
Ready:          False
   
Restart Count:  3
   
Environment:    <none>
   
Mounts:
     
/var/lib/kubevirt-node-labeller from node-labeller (rw)
     
/var/run/secrets/kubernetes.io/serviceaccount from kubevirt-handler-token-fsjdw (ro)
Containers:
  virt
-handler:
   
Container ID:
   
Image:         index.docker.io/kubevirt/virt-handler@sha256:62b026488b6084211fd993a1f76e7fd93fa20f201c20b89bda85808bc7460848
   
Image ID:
   
Port:          8443/TCP
   
Host Port:     0/TCP
   
Command:
      virt
-handler
     
--port
     
8443
     
--hostname-override
      $
(NODE_NAME)
     
--pod-ip-address
      $
(MY_POD_IP)
     
--max-metric-requests
     
3
     
--console-server-port
     
8186
     
-v
     
2
   
State:          Waiting
     
Reason:       PodInitializing
   
Ready:          False
   
Restart Count:  0
   
Environment:
      NODE_NAME
:   (v1:spec.nodeName)
      MY_POD_IP
:   (v1:status.podIP)
   
Mounts:
     
/etc/virt-handler/clientcertificates from kubevirt-virt-handler-certs (ro)
     
/etc/virt-handler/servercertificates from kubevirt-virt-handler-server-certs (ro)
     
/pods from kubelet-pods-shortened (rw)
     
/var/lib/kubelet/device-plugins from device-plugin (rw)
     
/var/lib/kubelet/pods from kubelet-pods (rw)
     
/var/lib/kubevirt from virt-lib-dir (rw)
     
/var/lib/kubevirt-node-labeller from node-labeller (rw)
     
/var/run/kubevirt from virt-share-dir (rw)
     
/var/run/kubevirt-libvirt-runtimes from libvirt-runtimes (rw)
     
/var/run/kubevirt-private from virt-private-dir (rw)
     
/var/run/secrets/kubernetes.io/serviceaccount from kubevirt-handler-token-fsjdw (ro)
Conditions:
 
Type              Status
 
Initialized       False
 
Ready             False
 
ContainersReady   False
 
PodScheduled      True
Volumes:
  kubevirt
-virt-handler-certs:
   
Type:        Secret (a volume populated by a Secret)
   
SecretName:  kubevirt-virt-handler-certs
   
Optional:    true
  kubevirt
-virt-handler-server-certs:
   
Type:        Secret (a volume populated by a Secret)
   
SecretName:  kubevirt-virt-handler-server-certs
   
Optional:    true
  libvirt
-runtimes:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/run/kubevirt-libvirt-runtimes
   
HostPathType:
  virt
-share-dir:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/run/kubevirt
   
HostPathType:
  virt
-lib-dir:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/lib/kubevirt
   
HostPathType:
  virt
-private-dir:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/run/kubevirt-private
   
HostPathType:
  device
-plugin:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/lib/kubelet/device-plugins
   
HostPathType:
  kubelet
-pods-shortened:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/lib/kubelet/pods
   
HostPathType:
  kubelet
-pods:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/lib/kubelet/pods
   
HostPathType:
  node
-labeller:
   
Type:          HostPath (bare host directory volume)
   
Path:          /var/lib/kubevirt-node-labeller
   
HostPathType:
  kubevirt
-handler-token-fsjdw:
   
Type:        Secret (a volume populated by a Secret)
   
SecretName:  kubevirt-handler-token-fsjdw
   
Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     CriticalAddonsOnly
                 node
.kubernetes.io/disk-pressure:NoSchedule
                 node
.kubernetes.io/memory-pressure:NoSchedule
                 node
.kubernetes.io/not-ready:NoExecute
                 node
.kubernetes.io/pid-pressure:NoSchedule
                 node
.kubernetes.io/unreachable:NoExecute
                 node
.kubernetes.io/unschedulable:NoSchedule
Events:
 
Type     Reason     Age                From                           Message
 
----     ------     ----               ----                           -------
 
Normal   Scheduled  70s                default-scheduler              Successfully assigned kubevirt/virt-handler-vdmpz to host-240.ocp-testing
 
Normal   Pulled     22s (x4 over 69s)  kubelet, host-240.ocp-testing  Container image "index.docker.io/kubevirt/virt-launcher@sha256:ee6cad8e8d425689d610b73d6f25d8cea3b1af71a776b82513ed96ec8581d198" already present on machine
 
Normal   Created    22s (x4 over 69s)  kubelet, host-240.ocp-testing  Created container virt-launcher
 
Normal   Started    22s (x4 over 69s)  kubelet, host-240.ocp-testing  Started container virt-launcher
 
Warning  BackOff    6s (x7 over 67s)   kubelet, host-240.ocp-testing  Back-off restarting failed container


Alejandro Jesus Nuñez Madrazo

unread,
Jun 3, 2020, 12:47:33 PM6/3/20
to kubevirt-dev
The error is fix in the last version of kubevirt

Thanks  anyway
Reply all
Reply to author
Forward
0 new messages