“Start Upgrade” button in Tectonic Console is not working

[Stephan Kristyn]

Clicking  Tectonic Upgrade Button not doing anything.

Any ideas how to debug?

-stephan

[Rob Szumski]

Stephan,

Do you see the update triggered and related logging in the tectonic-channel-operator pod in the tectonic-system namespace?

 - Rob

--
You received this message because you are subscribed to the Google Groups "CoreOS User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to coreos-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Stephan Kristyn]

I see this:

I0110 21:31:22.705129 1 leaderelection.go:174] attempting to acquire leader lease... E0110 21:33:09.506841 1 event.go:260] Could not construct reference to: '&v1.ConfigMap{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"tectonic-channel-operator", GenerateName:"", Namespace:"tectonic-system", SelfLink:"/api/v1/namespaces/tectonic-system/configmaps/tectonic-channel-operator", UID:"3a50df8c-9756-11e7-8c39-06c35bf26544", ResourceVersion:"34275698", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{sec:63640775025, nsec:0, loc:(*time.Location)(0x1f5d860)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{"control-plane.alpha.kubernetes.io/leader":"{\"holderIdentity\":\"tectonic-channel-operator-33a3a13a\",\"leaseDurationSeconds\":90,\"acquireTime\":\"2018-01-10T21:33:09Z\",\"renewTime\":\"2018-01-10T21:33:09Z\",\"leaderTransitions\":14}"}, OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Data:map[string]string(nil)}' due to: 'no kind is registered for the type v1.ConfigMap'. Will not report event: 'Normal' 'LeaderElection' 'tectonic-channel-operator-33a3a13a became leader' I0110 21:33:09.508093 1 leaderelection.go:184] successfully acquired lease tectonic-system/tectonic-channel-operator I0110 21:33:14.876468 1 types.go:133] No handler for version "1.7.3-tectonic.4", skip I0110 21:33:18.118023 1 main.go:508] Tectonic Channel Operator starts watching updates from core update I0110 21:33:34.804320 1 main.go:406] Updating to target TectonicVersion "1.7.5-tectonic.1" I0110 21:33:45.510770 1 updater.go:159] Updating deployment "tectonic-channel-operator" I0110 21:33:46.930097 1 updater.go:175] Deployment "tectonic-channel-operator" successfully updated I0110 21:33:53.114582 1 updater.go:159] Updating deployment "kube-version-operator" I0110 21:33:54.423376 1 updater.go:175] Deployment "kube-version-operator" successfully updated I0110 21:34:00.603229 1 updater.go:159] Updating deployment "tectonic-cluo-operator" E0110 21:39:01.227726 1 updater.go:83] Failed to update deployment "tectonic-cluo-operator": failed to update the deployment "tectonic-cluo-operator": timed out waiting for the condition, retry in "5s" I0110 21:39:05.616130 1 updater.go:159] Updating deployment "tectonic-cluo-operator" I0110 21:39:58.902372 1 updater.go:177] New deployment "tectonic-cluo-operator" successfully created I0110 21:40:04.938146 1 updater.go:159] Updating deployment "tectonic-prometheus-operator" I0110 21:40:06.410664 1 updater.go:175] Deployment "tectonic-prometheus-operator" successfully updated I0110 21:40:12.601897 1 updater.go:198] Updating the desired version CRD, name: "kubernetes", version: "1.7.5+tectonic.1" I0110 21:40:12.726157 1 updater.go:620] Updating AppVersion: "kubernetes", desired version: "1.7.5+tectonic.1" I0110 21:40:14.802230 1 updater.go:226] "kubernetes" is successfully updated to desired version "1.7.5+tectonic.1" I0110 21:40:21.002186 1 updater.go:198] Updating the desired version CRD, name: "tectonic-cluo-operator", version: "0.2.1" I0110 21:40:21.117214 1 updater.go:620] Updating AppVersion: "tectonic-cluo-operator", desired version: "0.2.1" I0110 22:18:18.302271 1 main.go:97] Update check started I0110 22:18:22.342085 1 main.go:144] Received TectonicVersion: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name: GenerateName: Namespace: SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[] Initializers:nil Finalizers:[] ClusterName:} Version:1.7.9-tectonic.4 Deployments:[{TypeMeta:{Kind:Deployment APIVersion:extensions/v1beta1} ObjectMeta:{Name:tectonic-channel-operator GenerateName: Namespace:tectonic-system SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:tectonic-channel-operator managed-by-channel-operator:true] Annotations:map[] OwnerReferences:[] Initializers:nil Finalizers:[] ClusterName:} Spec:{Replicas:0xc4206410d4 Selector:&LabelSelector{MatchLabels:map[string]string{k8s-app: tectonic-channel-operator,},MatchExpressions:[],} Template:{ObjectMeta:{Name: GenerateName: Namespace: SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[k8s-app:tectonic-channel-operator tectonic-app-version-name:tectonic-cluster] Annotations:map[] OwnerReferences:[] Initializers:nil Finalizers:[] ClusterName:} Spec:{Volumes:[{Name:certs VolumeSource:{HostPath:&HostPathVolumeSource{Path:/usr/share/ca-certificates,} EmptyDir:nil GCEPersistentDisk:nil AWSElasticBlockStore:nil GitRepo:nil Secret:nil NFS:nil ISCSI:nil Glusterfs:nil PersistentVolumeClaim:nil RBD:nil FlexVolume:nil Cinder:nil CephFS:nil Flocker:nil DownwardAPI:nil FC:nil AzureFile:nil ConfigMap:nil VsphereVolume:nil Quobyte:nil AzureDisk:nil PhotonPersistentDisk:nil Projected:nil Ps:[] Initializers:nil Finalizers:[] ClusterName:} Version:0.2.3} {ObjectMeta:{Name:tectonic-etcd GenerateName: Namespace:tectonic-system SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[managed-by-channel-operator:true] Annotations:map[] OwnerReferences:[] Initializers:nil Finalizers:[] ClusterName:} Version:0.0.1} {ObjectMeta:{Name:tectonic-monitoring GenerateName: Namespace:tectonic-system SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[managed-by-channel-operator:true] Annotations:map[] OwnerReferences:[] Initializers:nil Finalizers:[] ClusterName:} Version:1.7.1}]}

I0113 17:34:09.620815 1 main.go:97] Update check started

Also CluoOperator ist crashlooping

Cheers,

Stephan

[Rob Szumski]

Looks like there was trouble updating the CLUO (Container Linux Update Operator), which is the part the coordinates reboots across the nodes in the cluster.

Can you share the log from that? Any hint why its crashing? Have you changed anything about it’s configuration manually?