PSA: CIPD (and other LUCI services) down, causing "gclient sync" issues

[Ben Pastene]

Tracking bug is https://crbug.com/501135999.

An accounting mistake just occurred in the backends of many LUCI services. Locally, this will manifest as failed or indefinitely hanging gclient sync invocations. On the bots, this will also surface as pending or purple builds, eg:

https://ci.chromium.org/ui/p/chromium/builders/ci/chromeos-arm-generic-dbg/130138/infra

We're working on resolving this ASAP. We know it's been a very turbulent week. Your continued patience and understanding are appreciated.

Thanks

[Ben Pastene]

We've restored service, and things are starting to recover. Local gclient sync invocations and newly-triggered LUCI builds should now proceed as normal. However, any builds triggered during the outage are still having trouble getting picked up, but we're working to clean those up too.

We'll follow-up on the bug and put together a retrospective on this week's outages: https://crbug.com/501135999.

Thanks as always for your patience.