Talos Regression: Tp4 increase 6.99% on Linux Firefox

1 view
Skip to first unread message

Nobody

unread,
Nov 16, 2009, 4:36:34 PM11/16/09
to dev-tree-...@lists.mozilla.org

Regression: Tp4 increase 6.99% on Linux Firefox

Previous results: 511.495 from build 20091116061047 of revision f360de4b8b08 at 2009-11-16 06:51:00 on talos-rev2-linux07 run # 0

New results: 547.273 from build 20091116083213 of revision ebc28a0d4b96 at 2009-11-16 09:11:00 on talos-rev2-linux07 run # 0

Suspected checkin range: from revision f360de4b8b08 to revision ebc28a0d4b96

Ehsan Akhgari

unread,
Nov 16, 2009, 4:41:27 PM11/16/09
to Nobody, dev-tree-...@lists.mozilla.org
This is bug 515051, and looks real.  Commented in the bug.

--
Ehsan
<http://ehsanakhgari.org/>

 

Ehsan Akhgari

unread,
Nov 16, 2009, 5:02:32 PM11/16/09
to dev-tree-...@lists.mozilla.org
I asked Honza to backout his patch from mozilla-central, to see if the Tp4 number goes down again.  The graph on 1.9.2 also seems to show a regression, and I'll back it out from 1.9.2 as well in case it really proves to be a regression.

--
Ehsan
<http://ehsanakhgari.org/>

sayrer

unread,
Nov 17, 2009, 10:04:24 AM11/17/09
to
I saw this on the TM tree too, and we don't have the same checkins
going on.

Boris Zbarsky

unread,
Nov 17, 2009, 10:18:25 AM11/17/09
to
On 11/17/09 10:04 AM, sayrer wrote:
> I saw this on the TM tree too, and we don't have the same checkins
> going on.

Intereting. See, Honza's patch should NOT have had any Tp effect. I
was a bit surprised that it correlated with one on both m-c and 1.9.2,
but did those just land at the same time?

What were the timeframes for the three regressions (m-c, t-m, 1.9.2)?

-Boris

Nobody

unread,
Nov 17, 2009, 12:09:05 PM11/17/09
to dev-tree-...@lists.mozilla.org

Regression: Tp4 increase 7.04% on Linux Firefox

Previous results: 511.495 from build 20091116061047 of revision f360de4b8b08 at 2009-11-16 06:51:00 on talos-rev2-linux07 run # 0

New results: 547.495 from build 20091116061047 of revision f360de4b8b08 at 2009-11-17 08:46:00 on talos-rev2-linux07 run # 1

Suspected checkin range: from revision f360de4b8b08 to revision f360de4b8b08

Boris Zbarsky

unread,
Nov 17, 2009, 12:49:06 PM11/17/09
to
And On 11/17/09 12:09 PM, Nobody wrote:
> Suspected checkin range: from revision f360de4b8b08 to revision
> f360de4b8b08 <
> http://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=f360de4b8b08&tochange=f360de4b8b08>

That's an empty range.

-Boris

Boris Zbarsky

unread,
Nov 17, 2009, 12:53:02 PM11/17/09
to

Looking at the graph, there was a big drop in Tp4 on Linux around Nov 1
and that now it's gone back to the level we had before Nov 1.

I don't see any reports in this newsgroup of the 6% Tp4 drop around Nov 1.

I also don't know why there was a drop, nor the rise now...

-Boris

Ehsan Akhgari

unread,
Nov 17, 2009, 1:17:39 PM11/17/09
to Ehsan Akhgari, dev-tree-...@lists.mozilla.org
So, the backout on trunk didn't cause any improvements.  I inspected the graph server data with Johnathan's help, and the range reported on the list was actually accurate.  I asked Ben to run a few talos runs on the parent changeset of the suspected culprit on both trunk and 1.9.2, and the trunk results are out now, and as Murphy's Law dictates, the numbers were in the same range as the post-regression talos runs.

At this stage, I can only blame an unknown change in the talos run machines, and I guess Honza can re-land his patch on trunk.  Unless others have a better explanation for what's happening here.

--
Ehsan
<http://ehsanakhgari.org/>


On Mon, Nov 16, 2009 at 5:02 PM, Ehsan Akhgari <ehsan....@gmail.com> wrote:
I asked Honza to backout his patch from mozilla-central, to see if the Tp4 number goes down again.  The graph on 1.9.2 also seems to show a regression, and I'll back it out from 1.9.2 as well in case it really proves to be a regression.

--
Ehsan
<http://ehsanakhgari.org/>
On Mon, Nov 16, 2009 at 4:41 PM, Ehsan Akhgari <ehsan....@gmail.com> wrote:
On Mon, Nov 16, 2009 at 4:36 PM, Nobody <nob...@cruncher.build.mozilla.org> wrote:

Regression: Tp4 increase 6.99% on Linux Firefox

Previous results: 511.495 from build 20091116061047 of revision f360de4b8b08 at 2009-11-16 06:51:00 on talos-rev2-linux07 run # 0

New results: 547.273 from build 20091116083213 of revision ebc28a0d4b96 at 2009-11-16 09:11:00 on talos-rev2-linux07 run # 0

Reply all
Reply to author
Forward
0 new messages