Alert for DEVTOOLS_ENTRY_POINT (Histogram Regression Detector) on 2017-08-11

[telemetr...@mozilla.com]

Alert details: http://alerts.telemetry.mozilla.org/index.html#/detectors/1/metrics/2463/alerts/?from=2017-08-11&to=2017-08-11

Changeset for 20170811100330: https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=4d54ac07b8c97f0e6713dab2ba694023b5b2f3b5&tochange=64f5e3f40f0e7accb12cd90080e58eff0be46383

[Jim Blandy]

I looked through this for obviously devtools-related changes, and found:

dc8e54688912 <https://hg.mozilla.org/mozilla-central/rev/dc8e54688912>*Nicolas
Chevobbe — Bug 1307931
<https://bugzilla.mozilla.org/show_bug.cgi?id=1307931> - Make urls in
output clickable; r=bgrins.*
87afcda8a0ff <https://hg.mozilla.org/mozilla-central/rev/87afcda8a0ff>*Nicolas
Chevobbe — Bug 1307931
<https://bugzilla.mozilla.org/show_bug.cgi?id=1307931> - devtools reps:
update bundle to v0.12.1. r=bgrins*

387b09897512 <https://hg.mozilla.org/mozilla-central/rev/387b09897512>*Julian
Descottes — Bug 1388738
<https://bugzilla.mozilla.org/show_bug.cgi?id=1388738> - add comment for
devtools-startup developerToggleCreated flag;r=ochameau*
b6f95025c1ee <https://hg.mozilla.org/mozilla-central/rev/b6f95025c1ee>*Julian
Descottes — Bug 1388738
<https://bugzilla.mozilla.org/show_bug.cgi?id=1388738> - reuse
devtools-startup initDevTools in DevToolsShim;r=ochameau*

ab16c50f1c29 <https://hg.mozilla.org/mozilla-central/rev/ab16c50f1c29>*Alexandre
Poirot — Bug 1382968 <https://bugzilla.mozilla.org/show_bug.cgi?id=1382968>
- Make WebExtension debugging test better test console behavior. r=rpl*
5380b3782099 <https://hg.mozilla.org/mozilla-central/rev/5380b3782099>*Alexandre
Poirot — Bug 1382968 <https://bugzilla.mozilla.org/show_bug.cgi?id=1382968>
- Only try to forward console messages from content processes to parent
when browser console/toolbox are opened. r=jryans,tromey*
d0b89a730143 <https://hg.mozilla.org/mozilla-central/rev/d0b89a730143>*Alexandre
Poirot — Bug 1382968 <https://bugzilla.mozilla.org/show_bug.cgi?id=1382968>
- Flag Browser Console target as being chrome and related to a TabActor.
r=jryans*
cfc57926a26a <https://hg.mozilla.org/mozilla-central/rev/cfc57926a26a>*Alexandre
Poirot — Bug 1382968 <https://bugzilla.mozilla.org/show_bug.cgi?id=1382968>
- Move console actor helper modules to a dedicated folder. r=jryans*


On Mon, Aug 14, 2017 at 11:02 PM, <telemetr...@mozilla.com> wrote:

> Alert details: http://alerts.telemetry.mozilla.org/index.html#/
> detectors/1/metrics/2463/alerts/?from=2017-08-11&to=2017-08-11
>
> Changeset for 20170811100330: https://hg.mozilla.org/
> mozilla-central/pushloghtml?fromchange=4d54ac07b8c97f0e6713dab2ba6940
> 23b5b2f3b5&tochange=64f5e3f40f0e7accb12cd90080e58eff0be46383
> _______________________________________________
> dev-developer-tools mailing list
> dev-devel...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-developer-tools
>

[Julian Descottes]

Thanks for checking!

tldr: That's https://bugzilla.mozilla.org/show_bug.cgi?id=1388738 but it's
not a regression.

The difference we see here is the outcome of Bug 1388738, where we started
registering the Context Menu entry point (ie users that start interacting
with devtools using the "Inspect element" context menu entry). The category
existed before, but wasn't used.

We can see that the Context Menu category grew from 0 to 28% while the Key
Shortcut category fell from 65% to 38%.

This probe only registers the _first_ entry point used for a given session.
Before Bug 1388738, if a user did "Inspect element" and then switched to
another panel or closed devtools via a shortcut, a Key Shortcut
entry-point would have been registered. After Bug 1388738, we register a
Context Menu entry-point for this flow. So we just used to miscount 28% of
users as coming from a Keyboard Shortcut.

[Chris Hutten-Czapski]

Thanks to https://bugzilla.mozilla.org/show_bug.cgi?id=1388738 we are now
recording the devtools entry point much more accurately than before.
Expected and good.

:chutten

On Tue, Aug 15, 2017 at 2:02 AM, <telemetr...@mozilla.com> wrote:

> Alert details: http://alerts.telemetry.mozilla.org/index.html#/
> detectors/1/metrics/2463/alerts/?from=2017-08-11&to=2017-08-11
>
> Changeset for 20170811100330: https://hg.mozilla.org/
> mozilla-central/pushloghtml?fromchange=4d54ac07b8c97f0e6713dab2ba6940
> 23b5b2f3b5&tochange=64f5e3f40f0e7accb12cd90080e58eff0be46383
> _______________________________________________

> dev-telemetry-alerts mailing list
> dev-teleme...@lists.mozilla.org
> https://lists.mozilla.org/listinfo/dev-telemetry-alerts
>