Rendering Core Weekly Update for November 15, 2022

[Stephen Chenney]

Several interesting things this week:

- The remaining meetings of the year have been moved to adjust for US Thanksgiving and Christmas/New Year.

- A lot of tests were un-skipped this week or otherwise changed status. We seem to be running a lot more tests than we were and there are many more failures across all web-tests, suggesting this is not just a rendering thing.

- The various P1 charts have been adjusted as discussed last week.

Nov 15, 2022

Agenda

• No meeting week

• Next meeting moved to the week after US Thanksgiving, and the meeting after that moved to the week before Christmas break. Then back to the regular schedule January 3, 2023.

Upcoming Meetings

• Add any future discussion topics here.

Triage

Team	Untriaged	SLA Misses	Missing Owners
Layout	6	1	0
Style	3	0	0
Editing	10	1	0
Paint	18	0	0
Canvas	2	0	2
DOM	5	2	0

P1 Bugs Exceeding Web Platform SLO

Big jumps because P1 regressions and security issues are now reported. The links have also been updated to include P0 bugs.

Team	Priority 1 Bugs	Num Unassigned	Priority 1 Bugs older than 20 days
Layout	8	9	10
Style	4	1	0
Editing	5	3	1
Paint	6	4	2
Canvas	13	0	12
DOM	16	0	7

Open, Closed and Fixed

Team	Opened	Closed	Fixed
Layout	23	26	19
Style	25	19	12
Editing	3	7	4
Paint	24	17	10
Canvas	5	7	2
DOM	23	22	9

Total Open

Team	Total Open	Delta	Total Assigned	Delta	New WPT	Run Rate
Layout	1250	-12	255	-8	0	#REF!
Style	956	9	263	4	3	0
Editing	1084	-2	75	1	0	3
Paint	1454	14	452	-4	1	-1
Canvas	374	-2	196	-1	0	1
DOM	1341	6	531	3	0	3

 

Regression Bugs

Team	Priority 1 Regressions	Num Unassigned	Priority 1 Regressions older than 15 days	External Assignee	Expected Slow Fix
Layout	15	5	9	4	0
Style	1	0	0	0	0
Editing	1	1	1	0	0
Paint	1	1	1	0	0
Canvas	3	0	3	3	0
DOM	7	0	2	5	0

Web Test Fail/Skipped Counts

Many tests un-skipped this week, and many flaky tests exonerated.

All test failures:

• Linux-blink-rel build 82387:  4421 web test failures, up 979

• Mac-11-blink-rel build 7750: 4599 web test failures, up 994

• win10.20h2-blink-rel build 4068: 4683 web test failures, up 1362

Delta in the table below is the rounded average of the platforms.

	Failing				Skipped
Team	Linux	Mac	Win	Delta	Linux	Mac	Win	Delta
Canvas	10	12	11	0	2	2	2	0
DOM	188	203	188	9	65	144	67	-41
Editing	3	3	3	0	6	6	6	0
Layout	31	36	33	-1	2	6	2	-7
Paint	160	158	149	-2	10	11	11	-16
Style/All	1433	1474	1356	42	932	932	932	-159

Web Test Regressions and Status Changes

When triaging newly added tests, be sure to add necessary information to crbug.com and update the metadata at wpt.fyi.

Test Status Changes, maybe incorrect due to Windows failed test shard:

• 122 new Web tests (including relevant virtual suites)

• 6 Internal

• fast/forms/color-scheme/progress/progress-appearance-none.html

• fast/forms/text/input-appearance-autofill-ignoring-font-feature-settings.html

• virtual/controls-refresh-hc/fast/forms/color-scheme/progress/progress-appearance-none.html

• virtual/css-highlight-inheritance/wpt_internal/css/css-pseudo/spelling-error-006.html

• virtual/dark-color-scheme/fast/forms/color-scheme/progress/progress-appearance-none.html

• wpt_internal/css/css-pseudo/spelling-error-006.html

• 1 Failing:

• external/wpt/css/mediaqueries/mq-calc-008.html

• 84 Skipped

• Renamed external/wpt/css/css-view-transitions/ tests

• Existing tests

• 203 Newly passing

• Too many to list. Many tests now un-skipped, plus flaky tests exonerated.

• No new failures

• 
  

Launch Test Status

Regressions are how many fail in the virtual suite while passing in the default.

Passing compares the virtual / default passing test counts.

Failing/Timeout compares virtual / default failing or timeout results

Skipped compares skipped count for virtual / default

• backface-visibility-interop: Need to update tracking for linux only

• controls-refresh-hc: Regressions 0, Passing 57 / 57, Failing/Timeout 0 / 0, Skipped 0 / 0

• css-highlight-inheritance: Regressions 1, Passing 283/ 259, Failing/Timeout 34 / 58, Skipped 11 / 11

• Percentage of NG Blocks over time, Windows 50th percentile, Stable and Dev

• Stable steady at 99.27%

• Dev climbed to 99.9%

Metrics

Reminder to add any performance wins to go/wp-perfy.

• Nothing new

EngProd (vivianz,weizhong,jonathanjlee,jiesheng,nihardamar)

Web Developer Metrics (dgrogan, schenney, foolip)

• Interop 2023 is ready for comments!

• Bug Metrics Dashboard feedback requested (Google internal): https://docs.google.com/spreadsheets/d/1F2mhj7sgJSEsOZt3qBbmosPP_6Oh3Pcxca7MhOQ56aI/edit#gid=0

• Stack Overflow analysis underway

• Spec Issue tracking underway