PSA: CQ presubmit builder outage

16 views
Skip to first unread message

Andrii Shyshkalov

unread,
Nov 24, 2016, 8:39:06 AM11/24/16
to infra-dev, infra-a...@chromium.org
HI Chromium devs,

If CQ on your CL is blocked on chromium_presubmit builder being gray, please know that we are working on it.

BUG: http://crbug.com/668243  (internal bug, sorry)
IC: tandrii@{chromium.org,google.com}

Expect next update by 2PM UTC.

Sorry for the inconvenience.


--
Andrii

--
You received this message because you are subscribed to the Google Groups "infra-announce" group.
To unsubscribe from this group and stop receiving emails from it, send an email to infra-announc...@chromium.org.
To post to this group, send email to infra-a...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-announce/5686928c-a6b5-4806-843f-e1009ea99c30%40chromium.org.

Andrii Shyshkalov

unread,
Nov 24, 2016, 8:45:46 AM11/24/16
to infra-dev, infra-a...@chromium.org
Turns out it's not just presubmit. It's all builders on linux tryserver. 
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-announce/60f2f27e-82c3-4f6b-8902-02913605133f%40chromium.org.

Andrii Shyshkalov

unread,
Nov 24, 2016, 9:03:31 AM11/24/16
to infra-dev, infra-a...@chromium.org
The cause of outage is still not clear, trying some temporary workarounds.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-announce/7c3341d4-65d2-4351-899b-8e4f2bd0d952%40chromium.org.

Andrii Shyshkalov

unread,
Nov 24, 2016, 9:46:41 AM11/24/16
to infra-dev, infra-a...@chromium.org
i've tried to cancel all the pending tryjobs, and let CQ re-schedule them. This may have caused disruption for you in that you may have to re-trigger CQ. Sorry for this :(
The outage isn't not over, nor is it clear what caused it. 
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-announce/043e5a38-1243-4b3a-acb8-61312bb9f326%40chromium.org.

Andrii Shyshkalov

unread,
Nov 24, 2016, 10:25:04 AM11/24/16
to infra-dev, infra-a...@chromium.org
The outage has been mitigated, but the root cause isn't clear and it quite possible that it'll repeat itself soon.
So, if you see it happening on your CL, please let us know. Due to holiday in USA, chrome infra team might be slow in response.

Have a productive day OR happy holidays,
Andrii
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/infra-announce/5670bc51-f27c-4cfe-b4bd-9a53b1417376%40chromium.org.
Reply all
Reply to author
Forward
0 new messages