PSA: Demoting "content_browsertests" on "linux-rel" to CI-only

42 views

Skip to first unread message

Jeffrey Yu

unread,

Mar 9, 2026, 6:36:50 PM (4 days ago) Mar 9

to chromi...@chromium.org, chrome-browser-infra-team

Hi Chrome devs,

We'll be demoting "content_browsertests" running on the "linux-rel" builder from CQ to run on CI only.

As previously announced, the Chrome Dev Infrastructure team is currently addressing a capacity issue on the CQ builders that's resulting in high pending times and slow CQ runs across the board.

The team has tools that analyzed each test suite across the previous year of CL history, and determined whether those test suites provide additional value in detecting failures or bugs. The Regression Test Selection (RTS) Suite Analysis Tool analyzes CQ test runs and calculates the Recall rate for every test suite, the Recall rate being the percentage of failed CLs in the given time period that would still have failed if the test suite was not run on the builder (successful CLs do not factor into this number).

FAQ and more detailed explanation here: Demoting High-Recall Tests From CQ

To free up CQ capacity, the team will be doing a phased demotion of certain resource-expensive test suites to be run on CI only. "content_browsertests" was analyzed through the RTS Suite Analysis Tool and through SQL analysis; even if demoted from CQ, no additional CLs would have made it through CQ. The team has previously made similar changes with good results and no regression in test coverage.

"content_browsertests" will continue to run on CI, as well as on other CQ builders, including:

android-x86-rel
linux-chromeos-rel
mac-rel
win-rel

The CI will be monitored to verify no instances of it failing in isolation, but after this change, if you suspect a CL was reverted because of this demotion, please file a bug (using this template) and contact us.

If you have any questions or concerns, please let us know!

Pratyush Mohanty

unread,

Mar 9, 2026, 6:38:21 PM (4 days ago) Mar 9

to 'Jeffrey Yu' via Chromium-dev

Hello Jeffrey Yu and Chrome Dev Infrastructure team,

Thank you for the notice regarding demoting content_browsertests on the linux-rel builder from CQ to CI-only. I acknowledge the change and will inform relevant stakeholders on my side to rely on CI signal for this suite on linux-rel, while continuing to use the remaining CQ builders where it still runs (android-x86-rel, linux-chromeos-rel, mac-rel, win-rel).

If we observe any suspected regressions attributable to this demotion, we will file a bug using the provided template and follow up via the recommended channel.

Sincerely,
Pratyush Mohanty