Google APIs integrated authentication

94 views
Skip to first unread message

Miguel Vitorino

unread,
Dec 8, 2015, 2:53:18 PM12/8/15
to Google App Engine

Hi,

Google Cloud Platform mailing list has just posted this announcement:

"We’re investigating elevated error rates for some Google Cloud Platform users. We believe these errors are affecting between 2-5 percent of Google App Engine (GAE) applications. We are working directly with the customers who are affected to restore full operation in their application as quickly as possible, and apologize for any inconvenience."

Anyone know what exactly Google is doing directly with the affected customers. Our app is severely affected and we have received no contact or instructions regarding this.

Miguel 

bFlood

unread,
Dec 8, 2015, 2:58:36 PM12/8/15
to Google App Engine
same here, we have not been contacted but our app is affected as well

Miguel Vitorino

unread,
Dec 8, 2015, 3:12:54 PM12/8/15
to google-a...@googlegroups.com

We are not alone then, good to know. 
In case this helps, what we have done temporarily on some of our services was to perform OAuth2 authentication using a JWT token instead of using the "integrated" GAE API integration. This helped with BigQuery and GCS.
 

Miguel Vitorino

Director
Skype: miguel.vitorino
Support UK: +44 (20) 33 896 112
Support US: +1 (646) 350-0511



--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/4TgH5hCOF3o/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/dbc0fe86-abe3-40fe-a112-b3d73974e90a%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Stefano Ciccarelli

unread,
Dec 8, 2015, 4:02:57 PM12/8/15
to google-a...@googlegroups.com
Same here, our app is partially unusable (because it cannot reach GCS) but we have not been contacted.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 
stefano.c...@mmbsoftware.it 

M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 
www.mmbsoftware.it - in...@mmbsoftware.it

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

Nick (Cloud Platform Support)

unread,
Dec 9, 2015, 3:46:53 PM12/9/15
to Google App Engine
Were these errors manifesting as 401 responses? There's very little description in this thread of what issues are actually being seen. Is this possibly the issue you were affected by (linked to the Cloud Status Dashboard)? The appengine-downtime-notify mailing list also saw a posting about this.


On Tuesday, December 8, 2015 at 4:02:57 PM UTC-5, Stefano Ciccarelli wrote:
Same here, our app is partially unusable (because it cannot reach GCS) but we have not been contacted.

Il giorno mar 8 dic 2015 alle 20:58 bFlood <bfl...@spatialdatalogic.com> ha scritto:
same here, we have not been contacted but our app is affected as well


On Tuesday, December 8, 2015 at 2:53:18 PM UTC-5, Miguel Vitorino wrote:

Hi,

Google Cloud Platform mailing list has just posted this announcement:

"We’re investigating elevated error rates for some Google Cloud Platform users. We believe these errors are affecting between 2-5 percent of Google App Engine (GAE) applications. We are working directly with the customers who are affected to restore full operation in their application as quickly as possible, and apologize for any inconvenience."

Anyone know what exactly Google is doing directly with the affected customers. Our app is severely affected and we have received no contact or instructions regarding this.

Miguel 

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 


M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 

Miguel Vitorino

unread,
Dec 9, 2015, 5:58:11 PM12/9/15
to google-a...@googlegroups.com
Hi Nick,

Yes, that's right, the issues were manifested as 401s across all APIs and were solved once incident #15025 was fixed.

Miguel

Miguel Vitorino

Director
Skype: miguel.vitorino
Support UK: +44 (20) 33 896 112
Support US: +1 (646) 350-0511



On 9 December 2015 at 20:46, Nick (Cloud Platform Support) <pay...@google.com> wrote:
Were these errors manifesting as 401 responses? There's very little description in this thread of what issues are actually being seen. Is this possibly the issue you were affected by (linked to the Cloud Status Dashboard)? The appengine-downtime-notify mailing list also saw a posting about this.


On Tuesday, December 8, 2015 at 4:02:57 PM UTC-5, Stefano Ciccarelli wrote:
Same here, our app is partially unusable (because it cannot reach GCS) but we have not been contacted.

Il giorno mar 8 dic 2015 alle 20:58 bFlood <bfl...@spatialdatalogic.com> ha scritto:
same here, we have not been contacted but our app is affected as well


On Tuesday, December 8, 2015 at 2:53:18 PM UTC-5, Miguel Vitorino wrote:

Hi,

Google Cloud Platform mailing list has just posted this announcement:

"We’re investigating elevated error rates for some Google Cloud Platform users. We believe these errors are affecting between 2-5 percent of Google App Engine (GAE) applications. We are working directly with the customers who are affected to restore full operation in their application as quickly as possible, and apologize for any inconvenience."

Anyone know what exactly Google is doing directly with the affected customers. Our app is severely affected and we have received no contact or instructions regarding this.

Miguel 

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 


M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/4TgH5hCOF3o/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.

Nick (Cloud Platform Support)

unread,
Dec 10, 2015, 12:34:50 PM12/10/15
to Google App Engine
@Miguel, good to hear things are sorted out.

If any further issues are noticed by anybody, feel free to post them to the relevant Public Issue Tracker forum, such as google-appengine [1], googlecloudsql [2], google-cloud-sdk [3], or google-cloud-platform [4], depending what's affected, with the last one being a safe catch-all.

[1] https://code.google.com/p/google-appengine/issues/list

On Wednesday, December 9, 2015 at 5:58:11 PM UTC-5, Miguel Vitorino wrote:
Hi Nick,

Yes, that's right, the issues were manifested as 401s across all APIs and were solved once incident #15025 was fixed.

Miguel

Miguel Vitorino

Director
Skype: miguel.vitorino
Support UK: +44 (20) 33 896 112
Support US: +1 (646) 350-0511



On 9 December 2015 at 20:46, Nick (Cloud Platform Support) <pay...@google.com> wrote:
Were these errors manifesting as 401 responses? There's very little description in this thread of what issues are actually being seen. Is this possibly the issue you were affected by (linked to the Cloud Status Dashboard)? The appengine-downtime-notify mailing list also saw a posting about this.


On Tuesday, December 8, 2015 at 4:02:57 PM UTC-5, Stefano Ciccarelli wrote:
Same here, our app is partially unusable (because it cannot reach GCS) but we have not been contacted.

Il giorno mar 8 dic 2015 alle 20:58 bFlood <bfl...@spatialdatalogic.com> ha scritto:
same here, we have not been contacted but our app is affected as well


On Tuesday, December 8, 2015 at 2:53:18 PM UTC-5, Miguel Vitorino wrote:

Hi,

Google Cloud Platform mailing list has just posted this announcement:

"We’re investigating elevated error rates for some Google Cloud Platform users. We believe these errors are affecting between 2-5 percent of Google App Engine (GAE) applications. We are working directly with the customers who are affected to restore full operation in their application as quickly as possible, and apologize for any inconvenience."

Anyone know what exactly Google is doing directly with the affected customers. Our app is severely affected and we have received no contact or instructions regarding this.

Miguel 

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 


M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/4TgH5hCOF3o/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscribe@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.

bFlood

unread,
Dec 10, 2015, 12:39:33 PM12/10/15
to Google App Engine
well its sorted out now but it was down for 8+ hours, that's pretty bad. is there a post mortem on the issue yet?
To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.
--
Stefano Ciccarelli 
GAE Application Division 
/ Director 


M.M.B. s.r.l. 
via Granarolo, 177/7 - 48018 Faenza (RA) - Italy 
tel. +39.0546.637711 - fax +39.0546.46077 

Le informazioni contenute in questa comunicazione sono riservate e destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., sia ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per errore, Vi preghiamo di rispondere a questa e-mail e successivamente cancellarla dal Vostro sistema.

--
You received this message because you are subscribed to a topic in the Google Groups "Google App Engine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/4TgH5hCOF3o/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-appengi...@googlegroups.com.
To post to this group, send email to google-a...@googlegroups.com.

Nick (Cloud Platform Support)

unread,
Dec 10, 2015, 12:56:29 PM12/10/15
to Google App Engine
Hey bFlood,

The link to the Cloud Status Dashboard posted earlier indicates: 

The issue with App Engine applications accessing Google APIs should have been resolved for all affected customers as of 13:15 US/Pacific. We will conduct an internal investigation of this issue and make appropriate improvements to our systems to prevent or minimize future recurrence. We will provide a more detailed analysis of this incident once we have completed our internal investigation.

(emphasis added)

So, it seems that the analysis will be forthcoming, once the internal investigation on the issue has completed. 
Reply all
Reply to author
Forward
0 new messages