Grafana upgrade issue 8.0.5 with helm chart

[James S]

Hi,

we have installed  Prometheus, node-exporter, alertmanager, kube-state-metrics & Grafana with this helm chart

 https://github.com/helm/charts/tree/master/stable/prometheus-operator

we installed extracting the yamls from the Helm template as we do not have HELM on our clusters.

now I have update the grafana version to 8.0.5, just changes the image from previous yaml to new image

it is giving an error like 

Events:
  Type    Reason             Age    From                   Message
  ----    ------             ----   ----                   -------
  Normal  ScalingReplicaSet  2m12s  deployment-controller  Scaled up replica set prom2-grafana-5c4685487c to 1

The pod is not created 

[James S]

The grafana pod is in CrashLoopBackOff state.

Event: Back-off restarting failed container

[James S]

Actually,

 the readiness probe is failing . GET "http://xxxxx:3000/api/health":dail tcp xxxxx:3000:connect connection refused

[Brian Candler]

This group is for prometheus, not grafana or kubernetes or third-party helm charts.

However, I'll just point out one thing: if a kubernetes deployment goes into a CrashLoopBackOff state, then it's a good idea to look at logs from the container ("kubectl logs ...")

Good luck!