Oct 18, 2022
Agenda
No meeting week, update only.
Add any future discussion topics here.
P1 Bugs Exceeding Web Platform SLO
Open, Closed and Fixed
Total Open
Â
Web Test Fail/Skipped Counts
The table below is derived from the actual test expectations for recent try bot runs: linux-blink-rel 80390, mac-11-blink-rel 7485, win10.20h2-blink-rel 3887. Counts include virtual test suites owned by the team or testing stable functionality.
wpt/editing was added to the counts.
All test failures:
Linux 3375 up 112
Mac 3564 up 102
Win 3287 up 82
Delta in the table below is the rounded average of the platforms.
Web Test Regressions and Status Changes
When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.
Test Status Changes, maybe incorrect due to Windows failed test shard:
77 new Web tests (including relevant virtual suites)
7 Internal
fast/forms/color-scheme/media/video-playback-speed-menu.html (+2 virtual)
printing/abspos-multicol-with-abspos.html (+ virtual)
printing/viewport-units-in-vertical.html (+ virtual)
1 Failing:
external/wpt/html/semantics/embedded-content/the-iframe-element/sandbox-top-navigation-child.tentative.sub.window.html
No Skipped
Existing tests
10 Newly passing
external/wpt/css/css-break/flexbox/flex-container-fragmentation-008.html
external/wpt/css/css-break/flexbox/single-line-column-flex-fragmentation-029.html
external/wpt/css/css-cascade/layer-stylesheet-sharing.html
external/wpt/css/css-contain/contain-layout-baseline-005.html
external/wpt/css/css-contain/contain-layout-suppress-baseline-001.html
external/wpt/css/css-grid/subgrid/line-names-001.html
external/wpt/css/css-grid/subgrid/line-names-002.html
external/wpt/css/css-grid/subgrid/line-names-003.html
external/wpt/css/css-grid/subgrid/line-names-004.html
images/image-load-reset-on-new-base.html
5 new failures
external/wpt/css/css-break/flexbox/multi-line-row-flex-fragmentation-058.html
external/wpt/css/css-break/flexbox/single-line-column-flex-fragmentation-043.html
external/wpt/css/css-grid/subgrid/parent-repeat-auto-fit-001.html
external/wpt/css/css-grid/subgrid/parent-repeat-auto-fit-002.html
virtual/controls-refresh-hc/fast/forms/color-scheme/media/video-overlay-menu.html
Launch Test Status
Regressions are how many fail in the virtual suite while passing in the default.
Passing compares the virtual / default passing test counts.
Failing/Timeout compares virtual / default failing or timeout results
Skipped compares skipped count for virtual / default
backface-visibility-interop: Need to update tracking for linux only
controls-refresh-hc: Regressions 0, Passing 55 / 56, Failing/Timeout 0 / 0, Skipped 0 / 0
css-highlight-inheritance: Regressions 1, Passing 278/ 255, Failing/Timeout 34 / 57, Skipped 11 / 11
Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev
Stable steady at 99.27%
Dev steady at 99.26%
Reminder to add any performance wins to go/wp-perfy.
Reduced alerting for the Paint/Compositing team
Interop 2023 is ready for comments!