API error: points were written more frequently

[Fedor Korotkov]

Hey there,

I'm using Stackdriver to monitor micro services via submitting different custom metrics. Each micro service locally aggregates metrics and submits a single point for each time series every minute to Stackdriver. But I still do see frequent errors like this for common metrics:

One or more TimeSeries could not be written: One or more points were written more frequently than the maximum sampling period configured for the metric.

For example, there is custom.googleapis.com/grpc/response/time_ms common metric that each micro service is submitting. Each micro service is submitting each metric with some common labels for this particular container/service like pod name and service name. It makes each metric unique across all containers that submit metrics.

So my question is, does Stackdriver actually take into consideration labels when writing time series? It seems Stackdriver only respects a type of a submitted time series but not labels coming with it. In this case a more general question will be, from Stackdriver perspective, how one should submit time series with the same type but different labels (for example when there are many containers for the same service and each container submits metrics to Stackdriver)?

Best,

Fedor

[Mary Koes]

+Joy, JJ and Eric recently wrote a blog post on best practices for working with metrics.  I believe that labels are included when writing time series but hopefully they can confirm for you...

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To post to this group, send email to google-stackdr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/174643c8-b9cf-4a58-accb-0e1585f7b888%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.