Opencensus with stackdriver - causing 'One or more TimeSeries could not be written...'

4,953 views
Skip to first unread message

venkatesha

unread,
Aug 17, 2018, 1:53:25 AM8/17/18
to Google Stackdriver Discussion Forum
Hi all,

I am using GKE to deploy a golang app.

Using opencensus with stackdriver for tracing and metrics 

Getting the below error in logs
rpc error: code = InvalidArgument desc = One or more TimeSeries could not be written: One or more points were written more frequently than the maximum sampling period configured for the metric.: timeSeries[0-5]

any idea why this is occurring?

thanks

Igor Peshansky

unread,
Aug 17, 2018, 8:34:15 AM8/17/18
to venkatesha, Google Stackdriver Discussion Forum
Are you writing points for the same timeseries that are less than 1 minute apart? See https://cloud.google.com/monitoring/custom-metrics/creating-metrics#writing-ts.
        Igor
-- sent from a mobile device, please excuse tyops and omissns

--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To post to this group, send email to google-stackdr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/721d5486-9d32-4634-bb9b-13914fd1a9df%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

venkatesha

unread,
Aug 17, 2018, 8:51:29 AM8/17/18
to Google Stackdriver Discussion Forum
Hi Igor,

I'm not writing any custom metrics, Just integrated opencensus with my code.

I have two GCP Projects, same code is working fine(without the above error) in one but not in another.

thanks.

venkatesha

unread,
Aug 17, 2018, 8:54:10 AM8/17/18
to Google Stackdriver Discussion Forum
Opencensus and stackdriver versions


version = "0.15.0"

Gonzalo Serrano

unread,
May 6, 2020, 2:07:45 PM5/6/20
to Google Stackdriver Discussion Forum
I'm facing the same thing, and its 2020.

Since we are also running in GKE, and GKE sends metrics to Stackdriver by itself, could be that having a service running in GKE with custom metrics have any kind of collision with GKE sending its own metrics?

Igor Peshansky

unread,
May 6, 2020, 2:18:47 PM5/6/20
to Gonzalo Serrano, Google Stackdriver Discussion Forum
Each timeseries stream is checked separately, so if you are writing a different metric type, or against a different target, or with different labels, its points will be completely independent from any other stream.

You should be able to use the OpenCensus agent [1][2] to dump the requests sent to Cloud Monitoring and find out which timeseries are written in each request. There aren't enough details here for us to help you further. We would need to know what metrics are being written, and maybe see a sample request that produces the RPC error.
        Igor



--
© 2016 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages