Mach Try Perf Release

[Gregory Mierzwinski]

Hello everyone,

The Performance Tools team is excited to announce a new tool, or try selector, to make it simpler for everyone to run performance tests in CI! You can try it out by running: ./mach try perf

The new tool will allow you to select categories of performance tests that are most relevant to you instead of needing to select single tasks directly from the fuzzy selector. For instance, one category called "Pageload" will run all the pageload tests that we have available on a particular platform or all platforms. Furthermore, this try selector produces two try runs (one with, and one without your changes) so that you can get a valid comparison of the performance changes. The tool also provides you with a direct link to those Perfherder comparison results as soon as you finish pushing to try.

This blog post contains more information about it along with an animated GIF example, and the documentation for it can be found here.

If you have any questions about this tool, hit any issues, or have any suggestions for improvements, feel free to reach out to us in #perftest on Matrix!

Cheers,

Greg