The issue with instance DELETE and STOP operations in Google Compute Engine has been mitigated.

434 views
Skip to first unread message

Google Cloud Platform Status

unread,
Jan 29, 2020, 1:52:41 PM1/29/20
to gce-ope...@googlegroups.com
Description: Between Wednesday, 2020-01-29 04:00 US/Pacific and 07:30 US/Pacific instance stop and delete operations may have failed or appeared stuck in us-central1-a. As of 07:30 US/Pacific stop and delete operations are succeeding and we are now focusing on ensuring that the issue does not recur and working through the backlog of operations.

Running instances were not impacted. Other zones in us-central1 were not impacted.

Products which depend on GCE may also have been unable to stop or delete jobs. Impacted products include GKE, Dataflow, Dataproc, CloudSQL, Memorystore.

We will provide an update by Wednesday, 2020-01-29 14:30 US/Pacific with current details.


Diagnosis: Instance STOP and DELETE requests may fail or complete with an error in us-central1-a. Errors may be in the form of “rate limit exceeded”.

Workaround: New requests should be successful. If there are stuck operations that need to be completed urgently, please try your request again.

Google Cloud Platform Status

unread,
Jan 29, 2020, 5:09:18 PM1/29/20
to gce-ope...@googlegroups.com
Description: Between Wednesday, 2020-01-29 04:00 US/Pacific and 07:30 US/Pacific instance stop and delete operations may have failed or appeared stuck in us-central1-a. As of 07:30 US/Pacific stop and delete operations are succeeding and we are now focusing on ensuring that the issue does not recur and working through the backlog of operations.

Running instances were not impacted. Other zones in us-central1 were not impacted. New requests should be successful. If there are stuck operations that need to be completed urgently, please try your request again. Mitigation efforts continue to accelerate the backlog processing.

Products which depend on GCE may also have been unable to stop or delete jobs. Impacted products include GKE, Dataflow, Dataproc, CloudSQL, Memorystore.

We will provide an update by Wednesday, 2020-01-29 16:30 US/Pacific with current details.

Google Cloud Platform Status

unread,
Jan 29, 2020, 7:26:32 PM1/29/20
to gce-ope...@googlegroups.com
The issue with Google Compute Engine operations in us-central1-a has been resolved for all affected projects as of Wednesday, 2020-01-29 16:16 US/Pacific.

We thank you for your patience while we’ve worked on resolving the issue.
Reply all
Reply to author
Forward
0 new messages