Issue creating and deleting Compute Engine instances

499 views
Skip to first unread message

Google Cloud Platform Status

unread,
Jul 15, 2020, 9:59:46 AM7/15/20
to gce-ope...@googlegroups.com
Description: We are experiencing an issue creating and deleting Google Compute Engine instances, starting at Wednesday, 2020-07-15 05:07 US/Pacific.

This is also affecting other products which rely on Compute Engine including Cloud Build, which is in turn used by services including App Engine and Cloud Functions.

Our engineering team continues to investigate the issue.

We will provide an update by Wednesday, 2020-07-15 08:00 US/Pacific with current details.

Diagnosis: Attempts to create a new instance or to delete an instance fail with an error.

Workaround: None at this time.

Google Cloud Platform Status

unread,
Jul 15, 2020, 10:48:18 AM7/15/20
to gce-ope...@googlegroups.com
Description: We are experiencing an issue creating and deleting Google Compute Engine instances, starting at Wednesday, 2020-07-15 05:07 US/Pacific.

This is also affecting other products which rely on Compute Engine including Cloud Build, which is in turn used by services including App Engine and Cloud Functions.

Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide an update by Wednesday, 2020-07-15 08:20 US/Pacific with current details.

Diagnosis: Attempts to create a new instance or to delete an instance fail with an error.

Workaround: Retrying the instance operation may succeed.

Google Cloud Platform Status

unread,
Jul 15, 2020, 11:11:36 AM7/15/20
to gce-ope...@googlegroups.com
Description: We are experiencing an issue creating and deleting Google Compute Engine instances, starting at Wednesday, 2020-07-15 05:07 US/Pacific.

This is also affecting other products which rely on Compute Engine including Cloud Build, which is in turn used by services including App Engine and Cloud Functions. Other products affected are Cloud Data Fusion, Cloud Dataproc, and Google Kubernetes Engine.

Mitigation work is still underway by our engineering team.

Current data indicates that approximately 2% of requests globally are affected by this issue.

We do not have an ETA for mitigation at this point.

We will provide an update by Wednesday, 2020-07-15 09:00 US/Pacific with current details.

Google Cloud Platform Status

unread,
Jul 15, 2020, 11:51:03 AM7/15/20
to gce-ope...@googlegroups.com
Description: We are experiencing an issue creating and deleting Google Compute Engine instances, starting at Wednesday, 2020-07-15 05:07 US/Pacific.

This is also affecting other products which rely on Compute Engine including Cloud Build, which is in turn used by services including App Engine and Cloud Functions. Other products affected are Cloud Data Fusion, Cloud Dataproc, Cloud Dataflow, and Google Kubernetes Engine.

Current data indicates that approximately 2% of requests globally are affected by this issue.

Mitigation work has been completed by our engineering team and we are monitoring recovery.

Full resolution is expected to complete by Wednesday, 2020-07-15 09:05 US/Pacific.

We will provide an update by Wednesday, 2020-07-15 09:15 US/Pacific with current details.

Google Cloud Platform Status

unread,
Jul 15, 2020, 12:11:02 PM7/15/20
to gce-ope...@googlegroups.com
Description: We are experiencing an issue creating and deleting Google Compute Engine instances, starting at Wednesday, 2020-07-15 05:07 US/Pacific.

This is also affecting other products which rely on Compute Engine including Cloud Build, which is in turn used by services including App Engine and Cloud Functions. Other products affected are Cloud Data Fusion, Cloud Dataproc, Cloud Dataflow, and Google Kubernetes Engine. As well, instances created may experience DNS propagation delays.

Current data indicates that approximately 2% of requests globally are affected by this issue.

Mitigation work has been completed by our engineering team and we are monitoring recovery.

Full resolution is expected to complete by Wednesday, 2020-07-15 09:05 US/Pacific.

We will provide an update by Wednesday, 2020-07-15 09:20 US/Pacific with current details.

Google Cloud Platform Status

unread,
Jul 15, 2020, 12:14:43 PM7/15/20
to gce-ope...@googlegroups.com
The issue with creating and deleting Google Compute Engine instances has been resolved for all affected projects as of Wednesday, 2020-07-15 08:56 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

Google Cloud Platform Status

unread,
Jul 15, 2020, 9:01:06 PM7/15/20
to gce-ope...@googlegroups.com
Initially, we believed that this incident affected all instance create and delete operations, which was inaccurate. Approximately 2% of requests globally were failing and the issue was transient, allowing retried operations to succeed.

All existing instances continued to operate as expected, with only create or delete operations being affected. Upon evaluation of Google’s incident scope and severity, this incident’s severity has been adjusted from Outage to Disruption.
Reply all
Reply to author
Forward
0 new messages