GCE Network Outage - Urgent!

61 views
Skip to first unread message

Anders Brown

unread,
Apr 18, 2018, 3:41:34 PM4/18/18
to gce-discussion
Since about 2 hours now, GCE VMs cannot reach themselves via their public IP anymore. 
This broke our httpd watchdogs. As a result httpd are restarted every 5 minutes or so. Sites are severly impeded.

The error condition appeared suddenly, w/o any action on our behalf, no VMs were touched in any way. No yum updates run.
Possibly a routing update gone awry?

Please check and fix asap. Thank you.

BTW, it is totally unacceptable that this forum seems to be the only way to report outages like this!


Mates Dolda

unread,
Apr 18, 2018, 3:49:04 PM4/18/18
to gce-discussion
in my project the same behavior

Anders Brown

unread,
Apr 18, 2018, 3:55:59 PM4/18/18
to gce-discussion
In case it helps:
Observed this in europe-west1-b

Anders Brown

unread,
Apr 18, 2018, 4:59:57 PM4/18/18
to gce-discussion
We temporarily mitigated this in that we added a virtual host to Apache, named after the internal host name (glad it works).
This will do the trick for the next 48 hours or so, but the actual bug is still there and should be looked at.

Digil (Google Cloud Platform Support)

unread,
Apr 18, 2018, 7:17:26 PM4/18/18
to gce-discussion

Hello All,


It seems like a valid defect report on the platform. Kindly open a issue-tracker request, so that this specific issue will get proper weight and attention

Paul Nash

unread,
Apr 19, 2018, 1:31:56 AM4/19/18
to Digil Kottiyattil Anand, gce-discussion
Hello all, I apologize that I don't have the full details on this issue at this time, however I have shared your report with our oncall team and am informed that we believe this issue should have been resolved for all customers by around 16:50 Pacific Time. Please let us know if you are still seeing problems.

Thx,
-P

On Wed, Apr 18, 2018, 4:17 PM 'Digil (Google Cloud Platform Support)' via gce-discussion <gce-dis...@googlegroups.com> wrote:

Hello All,


It seems like a valid defect report on the platform. Kindly open a issue-tracker request, so that this specific issue will get proper weight and attention

--
© 2018 Google Inc. 1600 Amphitheatre Parkway, Mountain View, CA 94043
 
Email preferences: You received this email because you signed up for the Google Compute Engine Discussion Google Group (gce-dis...@googlegroups.com) to participate in discussions with other members of the Google Compute Engine community and the Google Compute Engine Team.
---
You received this message because you are subscribed to the Google Groups "gce-discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gce-discussio...@googlegroups.com.
To post to this group, send email to gce-dis...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gce-discussion/911a9698-ea3a-43ae-9f15-f6e9f49664e0%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Anders Brown

unread,
Apr 20, 2018, 3:22:30 PM4/20/18
to gce-discussion
Thank you Paul, the issue seems to be fixed. It's working again as intended.
Reply all
Reply to author
Forward
0 new messages