PSA: New baseline format for test-harness tests

[Weizhong Xia]

Hi Blink Developers

We want to let you know that we are in the process of converting baselines for test-harness tests into a new format. The reason is that we want to make baselines machine-parsable so that we can regenerate Wpt Metadata from Test Expectations and Baselines.

We are doing this directory by directory. Until now we have done this for all legacy web tests, wpt_internal and external/wpt/html, and we are expecting to complete this work by the end of this week.

This should mostly have no impact on your work, but a rebaseline might be needed if we happened to work on the same directory at the same time.

thanks, Weizhong

[Christian Biesinger]

Interesting! When you say "machine parsable", I assume you mean you want to detect which subtests passed/failed? Could you share an example of the new format? Thanks!

--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/blink-dev/CADXrSiobktBNXd1WD%2BK9gnaqAgW-oAq5Fn_3xGG1H9fUZ8Ezig%40mail.gmail.com.

[Weizhong Xia]

Yes, here is the design document: https://docs.google.com/document/d/1FsbRm2gXwFnhyJYaE-wz2fagRABkuHCK4KCYb6JEhMQ/edit?resourcekey=0-47lxaiexsP8wfuzOtQhkXw#heading=h.103wg95souql

thanks, Weizhong

[Christian Biesinger]

Thanks, this looks great. I particularly like the omission of PASS lines.

Christian

[Weizhong Xia]

Folks, FYI we were finally able to make changes to remove the PASS lines in baselines, which many of you have desired. With that the work to transit to the new baseline format is all done.

https://chromium-review.googlesource.com/c/chromium/src/+/5046574

https://chromium-review.googlesource.com/c/chromium/src/+/5047251

thanks, Weizhong