Parallel e2e tests

[Peter Marshall]

Hi all,

To speed up local development you can now run e2e tests in parallel mode:

$ npm run e2etest -- --jobs=8

There were a bunch of other useful additions to the e2e test runner as well that you might have missed, such as it.repeat(N, ...) and --test-file=. Check out the docs to learn more about them.

I suggest you only try parallel mode on beefy workstations. On Macbooks, tests start timing out even with jobs=2. We are going to look into that further, but hopefully this gets you started if you need to run e2e tests as part of your local development cycle.

We saw wall time for e2e tests go from 7m 51s to 1m 25s with jobs=12. For the # of jobs, 8-12 seems like the point of diminishing returns, as individual slow tests start to have a big impact.

Try it out and let me know if you have any issues. If you have a lot of load on your machine then tests might start timing out or failing in weird ways - in that case I suggest lowering the # of jobs and trying again.

The bots are still running in serial mode (jobs=1), so this should not affect CQ.

Tracking bug: http://crbug.com/1101784.

Cheers and happy testing,

Peter

[Paul Lewis]

Awesome! Thanks so much, Peter! :)

--
You received this message because you are subscribed to the Google Groups "devtools-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to devtools-dev...@chromium.org.
To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/devtools-dev/CAL3Ccsz9LoroviNa-A4BJOkV0k%2BPQQK5tnfcJvEuMztbF5RuCg%40mail.gmail.com.

[Mathias Bynens]

Nice!

[Benedikt Meurer]

Very cool, thanks Peter!

To view this discussion on the web visit https://groups.google.com/a/chromium.org/d/msgid/devtools-dev/CADizRgZxHZ-eszAosHHqK63rq8%3DXHEnxoA%2BbhBQyhKnb%3DePGOQ%40mail.gmail.com.

--

Benedikt Meurer

Chromium DevTools TL

bme...@chromium.org

Google Germany GmbH

Erika-Mann-Straße 33

80636 München

Geschäftsführer: Paul Manicle, Halimah DeLaine Prado

Registergericht und -nummer: Hamburg, HRB 86891

Sitz der Gesellschaft: Hamburg

Diese E-Mail ist vertraulich. Falls sie diese fälschlicherweise erhalten haben sollten, leiten Sie diese bitte nicht an jemand anderes weiter, löschen Sie alle Kopien und Anhänge davon und lassen Sie mich bitte wissen, dass die E-Mail an die falsche Person gesendet wurde.

    

This e-mail is confidential. If you received this communication by mistake, please don't forward it to anyone else, please erase all copies and attachments, and please let me know that it has gone to the wrong person.