Widespread flakiness in layout tests

[Kenneth Russell]

Chromium developers:

Widespread flakiness was introduced into the layout tests recently -- probably over the past couple of days -- causing tests to time out randomly. One of the sheriffs reported this yesterday in http://crbug.com/649463 .

If any experts can help the sheriffs diagnose this, please do. It looks like deep breakage and that disabling tests is not going to help.

Thanks.

-Ken

[Mikhail Fomitchev]

FWIW, I don't think this is necessarily a very recent issue. When I look at WebKit Win7's build history I can see redness going pretty far back (at least until Sept 9), and it's mostly random tests failing in webkit_tests with no apparent fixes when the bot goes green in the next build cycle.

https://uberchromegw.corp.google.com/i/chromium.webkit/builders/WebKit%20Win7%20%28dbg%29?numbuilds=200

[Kenneth Russell]

The problem is/was affecting not just the WebKit Win7 bot [1] but the commit queue as well - I noticed webkit_tests failures on linux_chromium_rel_ng:

https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_rel_ng?numbuilds=200

It sounds from https://bugs.chromium.org/p/chromium/issues/detail?id=649463#c11 like a suspect CL might have been found.

[1] public link: https://build.chromium.org/p/chromium.webkit/builders/WebKit%20Win7%20%28dbg%29?numbuilds=200

-Ken

--
--
Chromium Developers mailing list: chromi...@chromium.org
View archives, change email options, or unsubscribe:
http://groups.google.com/a/chromium.org/group/chromium-dev