info
Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
new test-verify check - changed preferences
15 views
Skip to first unread message
Joel Maher
Mar 23, 2023, 2:54:50 PM3/23/23
to
when you add or edit a testcase the CI will schedule test-verify to run. This historically has run the test in repeat mode and sometimes in MOZ_CHAOS mode.
As of https://bugzilla.mozilla.org/show_bug.cgi?id=1783248 mochitest will compare the preferences at startup with the preferences at the end of the test. If there are any new preferences or changed values it will results in a TEST-UNEXPECTED-FAIL message.
While this is awesome, there is one more cool feature and one caveat:
* caveat: there are many prefs that are related to background tasks or time and might show up as a failure even if you don't touch it. Add prefs to https://searchfox.org/mozilla-central/source/testing/mochitest/ignorePrefs.json if you need to
* extra feature: for mochitests, when each testcase finishes it resets the prefs back to the original values.
As of https://bugzilla.mozilla.org/show_bug.cgi?id=1783248 mochitest will compare the preferences at startup with the preferences at the end of the test. If there are any new preferences or changed values it will results in a TEST-UNEXPECTED-FAIL message.
While this is awesome, there is one more cool feature and one caveat:
* caveat: there are many prefs that are related to background tasks or time and might show up as a failure even if you don't touch it. Add prefs to https://searchfox.org/mozilla-central/source/testing/mochitest/ignorePrefs.json if you need to
* extra feature: for mochitests, when each testcase finishes it resets the prefs back to the original values.
Dinh Manh
Apr 1, 2023, 2:39:11 PM4/1/23
to
0 new messages