Eliminate Stack driver Label Limitations

[Chavya Khanna]

Hello All,

Is there a way we can bypass the Limitation of 20k Characters at the time of metric creation?

Right now we have a use case where Payload information can have upto 50k Characters - and display it on Grafana Dashboard, is there a workaround to achieve this?

As after 20k Characters we get '...' 

Regards

[Igor Peshansky]

Can you please clarify which part of the metric has the 20k limitation? The limits on various parts of the metric are documented at https://cloud.google.com/monitoring/quotas. In particular, the metric can have up to 30 labels, each of which can be up to 1k, making the total size of the metric point about 30k.

For larger data, you can send it to the logging API, though I'm not sure how you would hook it into Grafana. Log entries can be up to 256k in size, as per https://cloud.google.com/logging/quotas. For even larger data, it's recommended that you upload it to another storage medium (e.g., GCS) and log a pointer.

It would help us to see an example of what you're trying to do…

        Igor

--
© 2021 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Stackdriver Discussion Google Group (google-stackdr...@googlegroups.com) to participate in discussions with other members of the GoogleStackdriver community.
---
You received this message because you are subscribed to the Google Groups "Google Stackdriver Discussion Forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-stackdriver-d...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-stackdriver-discussion/73c6a588-36c1-4d14-94e0-3396e943d43dn%40googlegroups.com.

[Chavya Khanna]

Hi Igor,

thanks for the response, The link i am referring to is of Log Based Metrics

https://cloud.google.com/logging/docs/logs-based-metrics/distribution-metrics

Capture from the document

on GKE, I am using Stackdriver - capturing this log information from Log Based metrics - that's where the size of the message get's reduced to 20k while replacing the rest of the message with "..."

Then on Grafana i am using Google Cloud Monitoring a.k.a Stackdriver Plugin to fetch data stored in individual metrics.

Let me know if that helped clarifying my ask?

Regards