Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
Using perfherder to track power-related data
40 views
Skip to first unread message
William Lachance
Sep 10, 2015, 5:35:54 PM9/10/15
to mozilla-...@lists.mozilla.org
Hey, this seems like a cool project.
I noticed on the wiki a link to Roberto Vitallo's energia dashboard,
which I believe used to use Datazilla to store dynamic power-related
data. It should be noted that Datazilla is no longer operational, but we
have replaced it with a new system called Perfherder
(https://wiki.mozilla.org/Auto-tools/Projects/Perfherder).
My initial focus has been on making Perfherder work well with Talos, but
it has been designed to allow submission of data from other test
harnesses (we'll be accepting mobile results from the autophone
framework very soon, for example). So I'd like to encourage you to
consider using it for your storage/dashboard needs for this project.
What you get with perfherder:
1. A graphs view, useful for highlighting performance regressions in a
series. e.g.:
https://treeherder.mozilla.org/perf.html#/graphs?timerange=5184000&series=[mozilla-inbound,c233ba1133abbd544002dfbc29d9e63ced42a20e,1]&highlightedRevisions=16c530a7412e
2. An easy-to-use API to get data to create your own custom
dashboards/visualizations.
3. A fancy comparison view that highlights differences between commits:
https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=try&originalRevision=027bf5a1e5eb&newProject=try&newRevision=b015adea7c85&originalSignature=bb48078b6137f88afc52591b0e2aaa540435392c&newSignature=bb48078b6137f88afc52591b0e2aaa540435392c
4. (coming soon) An easy-to-use UI for detecting and sheriffing
performance regressions as they come in:
https://docs.google.com/document/d/1bPJyyvepbkz3suPdEg_ikOi1nQiCcaygjb4iw6OUGjI/
Because of (4), I don't have tons and tons of time to help out with
customizations, but I suspect that even the system as it currently
exists could save you a lot of time up front, while providing lots of
potential to automate tedious tasks in the future.
Anyway, let me know either here or on irc (I'm :wlach) if you have any
questions.
Will
I noticed on the wiki a link to Roberto Vitallo's energia dashboard,
which I believe used to use Datazilla to store dynamic power-related
data. It should be noted that Datazilla is no longer operational, but we
have replaced it with a new system called Perfherder
(https://wiki.mozilla.org/Auto-tools/Projects/Perfherder).
My initial focus has been on making Perfherder work well with Talos, but
it has been designed to allow submission of data from other test
harnesses (we'll be accepting mobile results from the autophone
framework very soon, for example). So I'd like to encourage you to
consider using it for your storage/dashboard needs for this project.
What you get with perfherder:
1. A graphs view, useful for highlighting performance regressions in a
series. e.g.:
https://treeherder.mozilla.org/perf.html#/graphs?timerange=5184000&series=[mozilla-inbound,c233ba1133abbd544002dfbc29d9e63ced42a20e,1]&highlightedRevisions=16c530a7412e
2. An easy-to-use API to get data to create your own custom
dashboards/visualizations.
3. A fancy comparison view that highlights differences between commits:
https://treeherder.mozilla.org/perf.html#/comparesubtest?originalProject=try&originalRevision=027bf5a1e5eb&newProject=try&newRevision=b015adea7c85&originalSignature=bb48078b6137f88afc52591b0e2aaa540435392c&newSignature=bb48078b6137f88afc52591b0e2aaa540435392c
4. (coming soon) An easy-to-use UI for detecting and sheriffing
performance regressions as they come in:
https://docs.google.com/document/d/1bPJyyvepbkz3suPdEg_ikOi1nQiCcaygjb4iw6OUGjI/
Because of (4), I don't have tons and tons of time to help out with
customizations, but I suspect that even the system as it currently
exists could save you a lot of time up front, while providing lots of
potential to automate tedious tasks in the future.
Anyway, let me know either here or on irc (I'm :wlach) if you have any
questions.
Will
Nicholas Nethercote
Sep 10, 2015, 8:27:07 PM9/10/15
to William Lachance, mozilla-...@lists.mozilla.org
Thank you for the information. Some kind of automated tracking system
will definitely be necessary, so this is useful to know.
Nick
> _______________________________________________
> dev-power mailing list
> dev-...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-power
will definitely be necessary, so this is useful to know.
Nick
> dev-power mailing list
> dev-...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-power
0 new messages