I had this working a long time ago and realize now that I never documented or automated it. Here's what I had previously:
2) git checkout engine-test
3) Edit engines.js to indicate what engines you want to test with, and their file locations (what's in there will certainly not work for you)
3) Remove "engine-results.json" if you want to start all over again and not use old test runs
4) Run "node engine.js <engine name>" to run the tests
5) See the results in "engines.html"
6) Repeat step 4 as long as you'd like with different "engine" parameters.
Every time you run it, it edits the existing compat table in place and generates a bunch of HTML.
This could certainly be automated by someone, perhaps to run in a Docker container.
It'd be cool if someone could take on the automation and update of this (as you can see, my fork of "compat-table" is just a little bit old...)