Oct 11, 2022
Agenda
Quick Update at the meeting
OKR Grading, maybe?
Add any future discussion topics here.
P1 Bugs Exceeding Web Platform SLO
Open, Closed and Fixed
Total Open
Web Test Fail/Skipped Counts
The table below is derived from the actual test expectations for recent try bot runs: linux-blink-rel 80390, mac-11-blink-rel 7485, win10.20h2-blink-rel 3887. Counts include virtual test suites owned by the team or testing stable functionality.
wpt/editing was added to the counts.
All test failures:
Linux 3263 up 67
Mac 3462 up 55
Win 3205 up 50
Delta in the table below is the rounded average of the platforms.
Web Test Regressions and Status Changes
When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.
Test Status Changes, maybe incorrect due to Windows failed test shard:
78 new Web tests (including relevant virtual suites)
4 Internal
printing/fixedpos-with-inline-block.html (+ virtual/threaded)
printing/page-overflow-inside-overflow-hidden.html (+ virtual/threaded)
7 Failing:
external/wpt/css/css-flexbox/intrinsic-size/col-wrap-013.html
external/wpt/css/css-flexbox/intrinsic-size/col-wrap-014.html
external/wpt/css/css-flexbox/intrinsic-size/col-wrap-019.html
external/wpt/css/css-images/gradient/css-color-4-colors-default-to-oklab-gradient.html
external/wpt/css/css-images/gradient/oklab-gradient.html
external/wpt/css/css-images/gradient/srgb-linear-gradient.html
external/wpt/css/css-images/gradient/xyz-gradient.html
No Skipped
Existing tests
12 Newly passing
external/wpt/css/css-flexbox/flexbox-align-self-baseline-horiz-006.xhtml
external/wpt/css/css-grid/alignment/grid-container-baseline-001.html
external/wpt/css/css-grid/alignment/grid-row-axis-self-baseline-synthesized-004.html
external/wpt/css/css-grid/alignment/grid-self-baseline-not-applied-if-sizing-cyclic-dependency-003.html
external/wpt/css/css-grid/subgrid/baseline-001.html
external/wpt/dom/events/Event-dispatch-click.html
external/wpt/dom/events/non-cancelable-when-passive/… (3 tests)
printing/fixed-positioned-overflow-scroll.html (+ virtual/threaded)
printing/width-overflow.html
31 new failures
css3/filters/effect-reference-hidpi.html
external/wpt/css/css-text/text-transform/text-transform-capitalize-*.html (14 tests)
external/wpt/css/css-transforms/[backgrounds on root] (7 tests + virtual)
virtual/scalefactor200/css3/filters/effect-reference-hidpi.html
virtual/threaded/external/wpt/scroll-animations/css/view-timeline-inset-animation.html
Launch Test Status
Regressions are how many fail in the virtual suite while passing in the default.
Passing compares the virtual / default passing test counts.
Failing/Timeout compares virtual / default failing or timeout results
Skipped compares skipped count for virtual / default
backface-visibility-interop: Need to update tracking for linux only
controls-refresh-hc: Regressions 0, Passing 55 / 55, Failing/Timeout 0 / 0, Skipped 0 / 0
css-highlight-inheritance: Regressions 1, Passing 277/ 254, Failing/Timeout 34 / 57, Skipped 11 / 11
Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev
Stable steady at 99.27%
Dev steady at 99.26%
Reminder to add any performance wins to go/wp-perfy.
Much noise due to fix for FCP reporting
Style performance improved enough to trigger alerts
Q4 Planning
Star count metrics now exclude the stars on new bugs (a Blink>Scroll bug picked up several new stars last week)
Learned about the various data sources for Stack Overflow analysis (there are at least 4 of them)