New test runner for devtools - legacy runner deprecation timeline

[Philip Pfaffe]

Tl;dr: the "old" test runners and corresponding npm scripts are deprecated and will be removed by EoQ.

Hey all,

Recently, a new uniform test runner landed in DevTools. The new runner now supports all tests and the most-used features from the old runners. It is also now used on CQ and CI. The feature set has intentionally been slightly reduced, so if you notice some workflows you relied on aren't working anymore, please let us know!

Please give it a try! For example:

npm run test front_end/panels/sources/SourcesView.test.ts

npm run test -- -t Release test/e2e/sources --debug

Please consider the "old" runners and the corresponding npm scripts as deprecated. When using the npm scripts, expect to see deprecation warnings and hints on how to achieve the same thing with the new runner.

The old scripts and runners will continue to be available for a short while, I plan to remove them by the end of this quarter, Jun 30th.

Cheers,

Philip

[Robert Paveza]

(Apologies if this ends up being a duplicate; I was reasonably certain that I replied, but I don't see it here).

Hey Philip! Thanks for the heads-up. 

Quick question -- with this happening, what will happen to the legacy tests in the Blink web_tests folder? My recollection is that there would be a nontrivial set of work to port them to our newer frameworks (but still, happy to see it happening).

Thanks!

Rob

[Philip Pfaffe]

Hey Rob,

this does not directly affect the web_tests, other than that we've renamed the corresponding npm script in DevTools. That's now `npm run webtest`.

Cheers,

Philip

--
You received this message because you are subscribed to the Google Groups "devtools-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to devtools-dev...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/devtools-dev/1d3caa8c-fe91-49ab-817b-ae1194fc7dfcn%40chromium.org.

[Rob Paveza]

Ah, so what you're describing is the test-running scripts in the frontend repo, not the legacy test_runner components that enable the web_tests to run? Sounds good!

---

From: Philip Pfaffe <pfa...@chromium.org>
Sent: Friday, May 24, 2024 1:01 AM
To: Rob Paveza <Rob.P...@microsoft.com>
Cc: devtools-dev <devtoo...@chromium.org>
Subject: [EXTERNAL] Re: [devtools-dev] Re: New test runner for devtools - legacy runner deprecation timeline

 

You don't often get email from pfa...@chromium.org. Learn why this is important

[Philip Pfaffe]

Hey folks,

The quarter is over and we are ready to remove the legacy runners and scripts.

The CL is here https://crrev.com/c/5563425. I will land it by EOD on Monday (Jul. 8th, PT) to give everyone who hasn't migrated yet a final grace period to switch their workflows over and discover issues.

Cheers,

Philip

[Philip Pfaffe]

Hey folks,

The migration is complete, and the old runners and scripts are gone! 🥳

Thanks all for the smooth transition. In case you notice any additional breakage, please don't hesitate to reach out (or just send us a bug)!

Cheers,

Philip