PSA: CQ presubmit builder outage

1 view
Skip to first unread message

Andrii Shyshkalov

unread,
Nov 24, 2016, 8:37:44 AM11/24/16
to infra-dev, infra-a...@chromium.org
HI Chromium devs,

If CQ on your CL is blocked on chromium_presubmit builder being gray, please know that we are working on it.

BUG: http://crbug.com/668243  (internal bug, sorry)
IC: tandrii@{chromium.org,google.com}

Expect next update by 2PM UTC.

Sorry for the inconvenience.


--
Andrii

Andrii Shyshkalov

unread,
Nov 24, 2016, 8:45:03 AM11/24/16
to infra-dev, infra-a...@chromium.org
Turns out it's not just presubmit. It's all builders on linux tryserver. 

Andrii Shyshkalov

unread,
Nov 24, 2016, 9:02:50 AM11/24/16
to infra-dev, infra-a...@chromium.org
The cause of outage is still not clear, trying some temporary workarounds.

Andrii Shyshkalov

unread,
Nov 24, 2016, 9:45:25 AM11/24/16
to infra-dev, infra-a...@chromium.org
i've tried to cancel all the pending tryjobs, and let CQ re-schedule them. This may have caused disruption for you in that you may have to re-trigger CQ. Sorry for this :(
The outage isn't not over, nor is it clear what caused it. 

Andrii Shyshkalov

unread,
Nov 24, 2016, 10:24:04 AM11/24/16
to infra-dev, infra-a...@chromium.org
The outage has been mitigated, but the root cause isn't clear and it quite possible that it'll repeat itself soon.
So, if you see it happening on your CL, please let us know. Due to holiday in USA, chrome infra team might be slow in response.

Have a productive day OR happy holidays,
Andrii
Reply all
Reply to author
Forward
0 new messages