GAE high request latency

62 views
Skip to first unread message

Daniel Sirota

unread,
Jul 19, 2017, 9:13:29 AM7/19/17
to Google App Engine
Hi,

I'm using GAE standard Python27, manual scaling with 5 instances, class B4 with bottle as my WSGI server.
Currently, only 2 of the instances receive requests, one of them at 40 QPS and one at 10 QPS.
90% of the requests are around 30-60 ms but the other 10% exceed 200 ms, it's critical for me to stay below 100ms.
I added logs to my handlers and even to bottle WSGI handler and in the traces, I see that sometimes it takes a request 100-300ms to get to the bottle handler.
Meaning, I lose 100-300ms even before bottle or my code is invoked.

How can I improve it so all my requests will be around 50ms?

Thanks!

Stefano Ciccarelli

unread,
Jul 19, 2017, 9:17:03 AM7/19/17
to Google App Engine
If you're using the Standard Environment I suggest you to switch to the Flexible Environment.



--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e0340cb4-16f8-4ba0-8ece-1f18a9354274%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--

Stefano Ciccarelli 
GAE Application Division 
/ Director 
stefano.c...@mmbsoftware.it 

M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 
www.mmbsoftware.it - in...@mmbsoftware.it

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

Daniel Sirota

unread,
Jul 19, 2017, 9:55:15 AM7/19/17
to Google App Engine
I tried, but each deploy takes around 8-10 minutes, which is a deal breaker for me (compared to the 20 seconds of the standard environment).
Reply all
Reply to author
Forward
0 new messages