Gauge metric negative

[Cht G]

I am monitoring argo workflow with Prometheus. 

argo_workflows_count{status="Error"}  -82

argo_workflows_count{status="Failed"}  -63

argo_workflows_count{status="Running"}  74

argo_workflows_count{status="Pending"} 484

argo_workflows_count{status="Succeeded"}  -402

the value is negative, How could the error count, succeeded will be negative...?

[Ian Billett]

Hello Cht G,

These metrics values do indeed look very suspicious!

By convention, counters can only increase and should never be negative (like the total number of requests). Gauges however, can take on any value (like temperature).

What you outline above sounds like a bug in the upstream Argo project, and you should raise it with them directly.

Best,

Ian

--
You received this message because you are subscribed to the Google Groups "Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/eb0217b3-ae5b-4acd-982f-0b9cbcd297e1n%40googlegroups.com.