PerfCompare: Default statistical method is now Mann-Whitney-U

3 views
Skip to first unread message

Kala Severe

unread,
Mar 17, 2026, 2:02:31 PMMar 17
to firef...@mozilla.org, dev-pl...@mozilla.org, Performance Team

Hello everyone,


PerfCompare has switched the default statistical method from Student-T to Mann-Whitney-U as part of the PerfCompare Statistic Project to deliver reliable and easily interpretable performance comparisons. You can find more information about the new statistical method in the updated documentation. Student-T is still accessible from the Test Version dropdown on the Results Page.


image.png

However, Student-T will be removed from the platform within the coming year. 


If you encounter any issues, have questions, or wish to provide feedback, please report bugs on the Perfcompare Bugzilla component, or reach out to us in the #perfcompare Matrix channel.

--
Kala Severe
Senior Software Engineer
Firefox Performance
Reply all
Reply to author
Forward
0 new messages