PSA: chrome_wpt_tests has been added to CI/CQ

299 views
Skip to first unread message

Weizhong Xia

unread,
Dec 5, 2023, 2:29:59 PM12/5/23
to blink-dev

Hello Fellow Developers!


This email is a PSA for running Web platform tests against Chrome on CI/CQ.


What?


  • A new test suite “chrome_wpt_tests” has been added to the CI/CQ, which will run web platform tests against Chrome.


Why?


  • Data has shown about 2% of WPTs have different test results when running against Chrome v.s. content_shell.

  • Running WPTs against Chrome to prevent Chrome-specific regressions.


When?


  • Dec 05, 2023


Need help?


  • See our documentation for run_wpt_tests.py

  • File a bug against blink>infra


Thanks,
Weizhong on behalf of Blink Engprod

Weizhong Xia

unread,
Jan 26, 2024, 9:17:50 PMJan 26
to blink-dev

Dear Fellow developers,


Some of you have reported that the new chrome_wpt_tests suite is causing problems for you as it is testing against the old headless mode Chrome. Due to that we have decided to change the test suite to experimental mode for now(CL). We will evaluate what would be the best next step to re-enable the test suite and update here once we have the plan locked down.


Sorry for the inconvenience.


- Weizhong


Reply all
Reply to author
Forward
0 new messages