Oct 25, 2022
Agenda
Meeting week with the usual update
Add any future discussion topics here.
P1 Bugs Exceeding Web Platform SLO
Open, Closed and Fixed
Total Open
Â
Web Test Fail/Skipped Counts
The table below is derived from the actual test expectations for recent try bot runs: linux-blink-rel 81206, mac-11-blink-rel 7591, win10.20h2-blink-rel 3959. Counts include virtual test suites owned by the team or testing stable functionality.
wpt/editing was added to the counts.
All test failures:
Linux 3440 up 65
Mac 3600 up 36
Win 3321 up 34
Delta in the table below is the rounded average of the platforms.
Web Test Regressions and Status Changes
When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.
Test Status Changes, maybe incorrect due to Windows failed test shard:
90 new Web tests (including relevant virtual suites)
5 Internal
wpt_internal/css/css-borders/subpixel-border-width-value-recomputed-when-zoom-changes.html
wpt_internal/css/css-borders/subpixel-border-width-when-zoom-changes.html
wpt_internal/css/css-borders/subpixel-border-width-when-zoomed.html
wpt_internal/dom/abort/abort-signal-memory-tests.any.html
wpt_internal/dom/abort/abort-signal-memory-tests.any.worker.html
23 Failing:
external/wpt/css/css-fonts/font-variant-emoji-1.html
external/wpt/css/css-fonts/rlh-in-monospace.html
external/wpt/css/selectors/media/media-playback-state.html
external/wpt/css/selectors/nth-... (19 tests)
external/wpt/editing/crashtests/inserthorizontalrule-in-textarea-in-editor-and-undo-on-error-events.html
1 Skipped
external/wpt/css/selectors/media/media-loading-state.html
Existing tests
5 Newly passing
external/wpt/css/css-grid/subgrid/line-names-005.html
external/wpt/css/css-grid/subgrid/line-names-006.html
external/wpt/css/css-images/image-orientation/image-orientation-border-image.html
fast/forms/week/week-picker-ax.html
fast/layers/clip-rects-transformed.html
36 new failures (but really only 4)
[Filter Tests] (32 tests due to a Skia roll)
external/wpt/css/css-color/parsing/color-computed-color-mix-function.html
external/wpt/scroll-animations/css/scroll-timeline-default-iframe-print.html (+ virtual)
http/tests/lazyload/attribute.html
Launch Test Status
Regressions are how many fail in the virtual suite while passing in the default.
Passing compares the virtual / default passing test counts.
Failing/Timeout compares virtual / default failing or timeout results
Skipped compares skipped count for virtual / default
backface-visibility-interop: Need to update tracking for linux only
controls-refresh-hc: Regressions 0, Passing 56 / 56, Failing/Timeout 0 / 0, Skipped 0 / 0
css-highlight-inheritance: Regressions 1, Passing 278/ 255, Failing/Timeout 34 / 57, Skipped 11 / 11
Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev
Stable steady at 99.27%
Dev steady at 99.26%
Reminder to add any performance wins to go/wp-perfy.
Nothing to report.
Interop 2023 is ready for comments!
Continued work on the Bug Metrics Dashboard. Will seek feedback shortly.