GAE request URI traffic stats

97 views
Skip to first unread message

Amogh Asgekar

unread,
Apr 25, 2021, 9:09:11 AM4/25/21
to Google App Engine
Is there a page that shows the per URI stats for services hosted in GAE? I can find a bunch of monitoring and reporting that shows overall latency, qps etc, but not one that can help me drill down across specific URI's that might be requested for the GAE application.

If not in cloud monitoring, is it possible to have an off the shelf solution like prometheus / grafana to be easily configured to do so with GAE traffic?

Amogh

yananc

unread,
Apr 26, 2021, 4:28:58 PM4/26/21
to Google App Engine

Hi, 

By the ‘URI’, are you referring to instances, a service or other resources in App Engine? And also, it might help to refer to the Cloud Monitoring metric list for App Engine for the complete information available. Hope it helps!

Amogh Asgekar

unread,
Apr 27, 2021, 9:09:09 AM4/27/21
to google-a...@googlegroups.com
Thanks for you response Yanan!

Here's what I'm looking for. Say my appengine instance is hosted on website.com and exposes the following routes
that my clients will hit with traffic. I'd like to know what is the qps and latency across each of those routes separately.
Looking at stackdriver logs, I see that protoPayload.latency already logs the latency for each request separately. I'm just looking for a way to show all of them aggregated per route.

Amogh

Sent via Superhuman


--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/47c027f8-4922-4ec9-a387-4de4483c1a75n%40googlegroups.com.

yananc

unread,
May 2, 2021, 6:52:21 PM5/2/21
to Google App Engine

Hi, 

So my understanding is that you would like to have the stat metrics by URL paths in App Engine. It will be helpful to explore ‘logs-based metrics’ to set up and group the metrics you desired. Hope it helps!

To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.

Amogh Asgekar

unread,
May 4, 2021, 5:56:21 PM5/4/21
to google-a...@googlegroups.com
This is very helpful, thanks Yanan. We were trying to do something similar with the Trace reports, but those seem to be static only and don't update in realtime. Can we expect the logs based metrics to have realtime reporting? Is there any delay expected from the time a log entry gets written to the time it gets accounted for in the metrics computed and shown?

Regards,

Amogh

Sent via Superhuman


On Sun, May 02, 2021 at 3:52 PM, yananc <yan...@google.com> wrote:

Hi, 

So my understanding is that you would like to have the stat metrics by URL paths in App Engine. It will be helpful to explore ‘logs-based metrics’ to set up and group the metrics you desired. Hope it helps!

On Tuesday, April 27, 2021 at 9:09:09 AM UTC-4 amo...@pncl.tech wrote:
Thanks for you response Yanan!

Here's what I'm looking for. Say my appengine instance is hosted on website.com and exposes the following routes
that my clients will hit with traffic. I'd like to know what is the qps and latency across each of those routes separately.
Looking at stackdriver logs, I see that protoPayload.latency already logs the latency for each request separately. I'm just looking for a way to show all of them aggregated per route.

Amogh

Sent via Superhuman


On Mon, Apr 26, 2021 at 1:28 PM, yananc <yan...@google.com> wrote:

Hi, 

By the ‘URI’, are you referring to instances, a service or other resources in App Engine? And also, it might help to refer to the Cloud Monitoring metric list for App Engine for the complete information available. Hope it helps!

On Sunday, April 25, 2021 at 9:09:11 AM UTC-4 amo...@pncl.tech wrote:
Is there a page that shows the per URI stats for services hosted in GAE? I can find a bunch of monitoring and reporting that shows overall latency, qps etc, but not one that can help me drill down across specific URI's that might be requested for the GAE application.

If not in cloud monitoring, is it possible to have an off the shelf solution like prometheus / grafana to be easily configured to do so with GAE traffic?

Amogh

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/72e630c3-51a5-4ed5-9fb5-332ef2bdc6b4n%40googlegroups.com.

George (Cloud Platform Support)

unread,
May 5, 2021, 3:46:49 PM5/5/21
to Google App Engine
Hello Amogh, 

You are perfectly right, log-based metrics do enjoy real-time behavior: "Combine the power of Cloud Logging with BigQuery for advanced analysis and use log-based metrics to build real-time Cloud Monitoring dashboards", as indicated on the "Cloud Logging" documentation page. 

To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.

Amogh Asgekar

unread,
May 6, 2021, 10:07:54 AM5/6/21
to google-a...@googlegroups.com
Great, thanks! We'll try it out and let you know how it goes. Thanks for all the help!

Sent via Superhuman


On Wed, May 05, 2021 at 12:46 PM, George <gsuce...@google.com> wrote:
Hello Amogh, 

You are perfectly right, log-based metrics do enjoy real-time behavior: "Combine the power of Cloud Logging with BigQuery for advanced analysis and use log-based metrics to build real-time Cloud Monitoring dashboards", as indicated on the "Cloud Logging" documentation page. 

On Tuesday, 04 May 2021 at 17:56:21 UTC-4 amo...@pncl.tech wrote:
This is very helpful, thanks Yanan. We were trying to do something similar with the Trace reports, but those seem to be static only and don't update in realtime. Can we expect the logs based metrics to have realtime reporting? Is there any delay expected from the time a log entry gets written to the time it gets accounted for in the metrics computed and shown?

Regards,

Amogh

Sent via Superhuman


On Sun, May 02, 2021 at 3:52 PM, yananc <yan...@google.com> wrote:

Hi, 

So my understanding is that you would like to have the stat metrics by URL paths in App Engine. It will be helpful to explore ‘logs-based metrics’ to set up and group the metrics you desired. Hope it helps!

On Tuesday, April 27, 2021 at 9:09:09 AM UTC-4 amo...@pncl.tech wrote:
Thanks for you response Yanan!

Here's what I'm looking for. Say my appengine instance is hosted on website.com and exposes the following routes
that my clients will hit with traffic. I'd like to know what is the qps and latency across each of those routes separately.
Looking at stackdriver logs, I see that protoPayload.latency already logs the latency for each request separately. I'm just looking for a way to show all of them aggregated per route.

Amogh

Sent via Superhuman


On Mon, Apr 26, 2021 at 1:28 PM, yananc <yan...@google.com> wrote:

Hi, 

By the ‘URI’, are you referring to instances, a service or other resources in App Engine? And also, it might help to refer to the Cloud Monitoring metric list for App Engine for the complete information available. Hope it helps!

On Sunday, April 25, 2021 at 9:09:11 AM UTC-4 amo...@pncl.tech wrote:
Is there a page that shows the per URI stats for services hosted in GAE? I can find a bunch of monitoring and reporting that shows overall latency, qps etc, but not one that can help me drill down across specific URI's that might be requested for the GAE application.

If not in cloud monitoring, is it possible to have an off the shelf solution like prometheus / grafana to be easily configured to do so with GAE traffic?

Amogh

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/B21GoY1NnzQ/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/d34323b0-0608-468a-8cef-4195e656fbe0n%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages