Blink Infra monthly meeting notes March 2017
Quinten Yearsley
The Blink Infra group is a group of people that work to improve Blink-related infrastructure; some of us work on Blink Infra as our primary project; others work on a particular aspect of Blink Infra part-time.
These notes are mailed monthly to blink-infra, bcc blink-dev and infra-dev.
Attendees: skobes, jeffcarp, qyearsley, tansell, mcgreevy
Discussion:
Layout tests sometimes fail on swarming but not locally or vice versa
Much of the time it's related to retries - tests often fail the first time then pass on retries. In general, retries can hide flakiness.
The number of flaky tests in TestExpectations continues to grow.
At some point, we still want to plan to start deleting flaky tests; there is some question about how "aggressive/proactive" to be about this ideally.
Status updates:
mcgreevy, tansell: For linux_chromium_rel_ng, getting close! Now working on looking at downstream things that look at the webkit_tests step name.
Will be renaming the step name.
qyearsley: Working on the filling in results for rebaseline-cl (crbug.com/673966), to make importer more reliable, and to make rebaselining from try jobs easier to use.
jeffcarp: Working on "WPT exporter 2.0": Support merging PRs even if previous PRs are stuck, and start making (but not merging) PRs for in-flight Gerrit CLs.
- skobes: Made CL for improving some error messages (see crrev.com/2781733003/)
Layout tests sometimes fail on swarming but not locally or vice versa
Much of the time it's related to retries - tests often fail the first time then pass on retries. In general, retries can hide flakiness.
The number of flaky tests in TestExpectations continues to grow.
At some point, we still want to plan to start deleting flaky tests; there is some question about how "aggressive/proactive" to be about this ideally.
mcgreevy, tansell: For linux_chromium_rel_ng, getting close! Now working on looking at downstream things that look at the webkit_tests step name.
Will be renaming the step name.
qyearsley: Working on the filling in results for rebaseline-cl (crbug.com/673966), to make importer more reliable, and to make rebaselining from try jobs easier to use.
jeffcarp: Working on "WPT exporter 2.0": Support merging PRs even if previous PRs are stuck, and start making (but not merging) PRs for in-flight Gerrit CLs.