Dec 6, 2022
Agenda
No meeting this week
Add any future discussion topics here.
P1 Bugs Exceeding Web Platform SLO
Big jumps because P1 regressions and security issues are now reported. The links have also been updated to include P0 bugs.
Open, Closed and Fixed
Total Open
Web Test Fail/Skipped Counts
All test failures:
Linux-blink-rel build 83345: 5620 web test failures, -5
Mac-11-blink-rel build 7888: 4601 web test failures, -2
win10.20h2-blink-rel build 4187: 4705 web test failures, -7
Delta in the table below is the rounded average of the platforms.
Web Test Regressions and Status Changes
When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.
Test Status Changes, maybe incorrect due to Windows failed test shard:
122 new Web tests (including relevant virtual suites)
97 Internal
fast/forms/color-scheme/meter/meter-appearance-basic-vertical.html (+ 2 virtual)
fast/hidpi/image-set-* (7 tests)
1 Failing:
external/wpt/html/semantics/forms/the-input-element/range-tick-marks-02.html
48 Skipped
external/wpt/css/css-view-transitions/set-current-time.html
external/wpt/css/css-grid/masonry/tentative/… (47 tests)
Existing tests
18 Newly passing
external/wpt/css/css-backgrounds/background-size-04[3,4].html (2 tests + virtual)
external/wpt/css/css-images/tiled-gradients.html
external/wpt/css/css-pseudo/first-letter-with-quote.html (+ virtual)
external/wpt/css/css-pseudo/highlight-painting-004.html (+ virtual)
external/wpt/css/filter-effects/filter-invalid.html (+ virtual)
external/wpt/html/semantics/embedded-content/the-img-element/image-loading-lazy-move-into-script-disabled-iframe.html
external/wpt/html/semantics/popovers/popover-anchor-display.tentative.html
virtual/css-highlight-inheritance/external/wpt/css/css-pseudo/active-selection-025.html
virtual/css-highlight-inheritance/external/wpt/css/css-pseudo/active-selection-056.html
virtual/css-highlight-inheritance/external/wpt/css/css-pseudo/target-text-dynamic-001.html
virtual/css-highlight-inheritance/external/wpt/css/css-pseudo/target-text-dynamic-002.html
virtual/css-highlight-inheritance/external/wpt/css/css-pseudo/target-text-dynamic-003.html
5 new failures
external/wpt/css/filter-effects/effect-reference-on-transparent-element.html
external/wpt/dom/events/scrolling/scrollend-event-fired-to-element-with-overscroll-behavior.html
external/wpt/html/semantics/disabled-elements/event-propagate-disabled.tentative.html
external/wpt/html/semantics/forms/the-selectmenu-element/selectmenu-form-state-restore.tentative.html
virtual/scalefactor200/external/wpt/css/filter-effects/effect-reference-on-transparent-element.html
Launch Test Status
Regressions are how many fail in the virtual suite while passing in the default.
Passing compares the virtual / default passing test counts.
Failing/Timeout compares virtual / default failing or timeout results
Skipped compares skipped count for virtual / default
backface-visibility-interop: Need to update tracking for linux only
controls-refresh-hc: Regressions 0, Passing 58 / 58, Failing/Timeout 0 / 0, Skipped 0 / 0
css-highlight-inheritance: Regressions 1, Passing 286/ 262, Failing/Timeout 34 / 58, Skipped 11 / 11
Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev
Stable steady at 99.27%
Dev has overflowed 100%, suggesting a bug in computing the ratio
Reminder to add any performance wins to go/wp-perfy.
Nothing to report
No update this week (just for meeting weeks)
Dashboard for Chromium Bugs Referenced by Stack Overflow Posts (Google Internal Only, Sorry)
Confirmed a method to extract bug data from Bugzilla trackers