High latencies in google app engine in the same timeframe everyday

87 views
Skip to first unread message

Luciano César Natale

unread,
Aug 19, 2019, 7:39:08 PM8/19/19
to Google App Engine
Hi! I'm realtive new to this world of cloud computing, and I've managed to set up a project that runs wordpress on GAE with the DB stored in CloudSQL.

Thing is that now that the project has gone live, it's experiencing high latencies in specific timeframe on a daily basis.
Here is a screenshot of what trace shows:
As you can see, between 2PM and 2AM everyday (I'm preety sure that it's my local time GMT-3 ART). I've alreayd tried having more resources allocated for the App Engine Instances and the CloudSQL instance, and that did not solve the problem, things were exactly the same.
How can this be handled?
Thanks!

Screenshot from 2019-08-19 19-50-34.png


Maximiliano Contartesi

unread,
Aug 20, 2019, 2:42:07 AM8/20/19
to google-a...@googlegroups.com
Luciano

I'm in Argentina too. We have migrated all of our GCP services to another service provider for the same reason.



If your service destination is Argentina, GAE is not an option ;(

---

Maximiliano Contartesi
Founder + IT Projects
 
Logo
T: + 54 11 5680-3380
M: + 54 9 11 4039 1851
mcont...@tecnogo.com - www.tecnogo.com
Dr. Luis Belaustegui 2557, Capital Federal, Argentina.
LinkedIn icon  
 


--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/aa97b3eb-1f89-45b6-baaa-71f32ee270a9%40googlegroups.com.

Maximiliano Contartesi

unread,
Aug 20, 2019, 2:43:38 AM8/20/19
to google-a...@googlegroups.com
 
---

Maximiliano Contartesi
Founder + IT Projects
 
Logo
T: + 54 11 5680-3380
M: + 54 9 11 4039 1851
mcont...@tecnogo.com - www.tecnogo.com
Dr. Luis Belaustegui 2557, Capital Federal, Argentina.
LinkedIn icon  
 

Luciano César Natale

unread,
Aug 20, 2019, 10:23:32 AM8/20/19
to google-a...@googlegroups.com
Thanks Maxi for your answer. I don't think it's the same issue, the high latency is not only found when using custom domains, also when using appspot domain too. The bug you refer and linked is only about custom domains I think, and the latency difference is of about one second, we're experiencing 20 to 30 seconds latencies!!!



--
Luciano César Natale

Luciano César Natale

unread,
Aug 20, 2019, 10:24:09 AM8/20/19
to google-a...@googlegroups.com
But yes, I'm in Argentina and the service is hosted in Sao Paulo.
--
Luciano César Natale

Nicolas (Google Cloud Platform Support)

unread,
Aug 20, 2019, 2:17:06 PM8/20/19
to Google App Engine

Hi Luciano,

Thanks for opening this discussion thread, I ran some connection tests on both your appspot and custom domain. What interested me was the time before the request hit Google’s infrastructure. 

Both results were below or similar to a baseline established by a test application of mine deployed in the Us-East region. My conclusion here would be that there is no issue with the region itself but might be a non-optimal configuration of scaling.

My recommendation would be to make sure you follow the App Engine scablability best pratices and maybe to bring this performance issue to StackOverflow where experienced programmers are within reach and ready to help.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.


--
Luciano César Natale


--
Luciano César Natale

Luciano César Natale

unread,
Aug 20, 2019, 2:26:27 PM8/20/19
to google-a...@googlegroups.com
Thanks for your recommendations Nicolás. But what seems strange to me is that the problem is always between 3pm and 3am (ART GMT-3), and there is no particular change in the amount of requests that can cause trouble with scaling afaik.
I've been changing scaling parameters and instances resources before writing in this group but no luck... Let's see how it behaves today (it'shalf past three now!!!)


To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.


--
Luciano César Natale


--
Luciano César Natale

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/721842d6-8f44-4022-a514-9efd52dfe337%40googlegroups.com.

Mauricio Lumbreras

unread,
Aug 20, 2019, 3:00:31 PM8/20/19
to Google App Engine
Hello
are you using 1st generation or 2nd generation cloud sql databases?
Regards
mauricio


Luciano César Natale

unread,
Aug 20, 2019, 5:43:27 PM8/20/19
to google-a...@googlegroups.com
2 nd generation!

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.

Mauricio Lumbreras

unread,
Aug 20, 2019, 9:36:48 PM8/20/19
to Google App Engine
Hello Luciano
what we found is in some cases, no known reason, the database seems like pulsating or the like, with a predictable streak of delays, we saw it in 30 minutes period in our case. I was trying to get some answer from support, no luck yet. But this behavior is not related with scaling mode or the like. We understand app engine is a complex machinery and there is tons of layers behind the scenes, moreover usually there are changes in infrastructure that impacts you without any warning
Regards
Mauricio

Cristian Bullokles

unread,
Aug 20, 2019, 10:00:21 PM8/20/19
to google-a...@googlegroups.com
I've exactly the same problem,the app engine is really slow. I only have one "client" device, and the responses are around 300ms.. So I think it is not an scalability issue.
Any thoughts? I think we are all in the same boat, I'm from argentina too.


Cristian

Luciano César Natale

unread,
Aug 20, 2019, 10:22:53 PM8/20/19
to google-a...@googlegroups.com
Today, no strange latencies happened at all! Now I'm almost sure it's a platform problem...



--
Luciano César Natale

Mauricio Lumbreras

unread,
Aug 20, 2019, 10:50:46 PM8/20/19
to Google App Engine
Right now one of our projects is suffering a spike in latency every 5 minutes , very noticeable  no reason why it is happening, traffic is steady. This is the way GAE works...

Cristian Bullokles

unread,
Aug 20, 2019, 10:52:01 PM8/20/19
to google-a...@googlegroups.com
Do you have a NodeJS Service running in Standard env connected thru socket to a MySQL database?

My environment is exaclty like that, any advice to improve performance?

Cristian


Luciano César Natale

unread,
Aug 20, 2019, 11:04:10 PM8/20/19
to google-a...@googlegroups.com

Luciano César Natale

unread,
Aug 22, 2019, 5:38:08 PM8/22/19
to google-a...@googlegroups.com
Issues did not arise again!
--
Luciano César Natale
Reply all
Reply to author
Forward
0 new messages