Nov 8, 2022
Agenda
Meeting week
(pdr): ThrottleIntersectionObserver performance results are in!
Add any future discussion topics here.
P1 Bugs Exceeding Web Platform SLO
An issue was raised last week about P1 issue counts. The links in the spreadsheet, the table below and the automated stats capture have been updated to capture all bug types, including regressions and security. The automated system was already catching P0 and P1, but the spreadsheet does not and given the rarity of P0 bugs we will not modify the spreadsheet queries. This week's charts do not include the changes. Next week’s will.
Open, Closed and Fixed
Total Open
Â
Web Test Fail/Skipped Counts
The table below is derived from the actual test expectations for recent try bot runs: linux-blink-rel 81995, mac-11-blink-rel 7693, win10.20h2-blink-rel 4019. Counts include virtual test suites owned by the team or testing stable functionality.
All test failures:
Linux 3442 down 23
Mac 3605 down 20
Win 3321 down 26
Delta in the table below is the rounded average of the platforms.
Web Test Regressions and Status Changes
When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.
Test Status Changes, maybe incorrect due to Windows failed test shard:
78 new Web tests (including relevant virtual suites)
3 Internal
fast/multicol/monolithic-table-section-crash.html
virtual/css-highlight-inheritance/wpt_internal/css/css-pseudo/spelling-error-005-crash.html
wpt_internal/css/css-pseudo/spelling-error-005-crash.html
1 Failing:
external/wpt/html/semantics/popovers/popover-anchor-display.tentative.html
None Skipped
Existing tests
10 Newly passing
external/wpt/css/css-images/gradient/ (9 tests related to color spaces feature)
external/wpt/css/css-ui/compute-kind-widget-no-fallback-props-001.html
3 new failures
external/wpt/css/css-color/color-mix-currentcolor-002.html
virtual/scalefactor200/fast/forms/file/file-appearance-no-default-width.html
virtual/threaded/external/wpt/scroll-animations/css/scroll-timeline-dynamic.tentative.html
Launch Test Status
Regressions are how many fail in the virtual suite while passing in the default.
Passing compares the virtual / default passing test counts.
Failing/Timeout compares virtual / default failing or timeout results
Skipped compares skipped count for virtual / default
backface-visibility-interop: Need to update tracking for linux only
controls-refresh-hc: Regressions 0, Passing 56 / 56, Failing/Timeout 0 / 0, Skipped 0 / 0
css-highlight-inheritance: Regressions 1, Passing 281/ 257, Failing/Timeout 34 / 58, Skipped 11 / 11
Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev
Stable steady at 99.27%
Dev climbed to 99.5%
Reminder to add any performance wins to go/wp-perfy.
Nothing to report.
Interop 2023 is ready for comments!
Bug Metrics Dashboard feedback requested (Google internal): https://docs.google.com/spreadsheets/d/1F2mhj7sgJSEsOZt3qBbmosPP_6Oh3Pcxca7MhOQ56aI/edit#gid=0
Stack Overflow analysis underway
Spec Issue tracking underway