How has TraceMonkey's performance changed in 2009?
Nicholas Nethercote
performance work that's been happening, the SunSpider times I'm seeing haven't
really changed much. So I did an experiment today and am happy to report that
my feeling was wrong, and TraceMonkey is 1.29x faster than it was at the start
of the year.
I started with r32221, and compared it against each 1000th revision back to the
start of the year (r32000, r31000, etc). The one exception was that I did
r23700 instead of r23000, because I had build problems with r23000, and r23700
was the earliest one after r23000 I could find that built ok.
I ran the tests on my MacBook Pro, using --runs=100. Here are the summary
results:
r23700: ** TOTAL **: 1.29x as fast 1152.3ms +/- 0.1% 890.2ms +/- 0.1%
r24000: ** TOTAL **: 1.23x as fast 1094.6ms +/- 0.1% 890.6ms +/- 0.1%
r25000: ** TOTAL **: 1.196x as fast 1063.8ms +/- 0.1% 889.8ms +/- 0.1%
r26000: ** TOTAL **: 1.20x as fast 1070.0ms +/- 0.5% 891.5ms +/- 0.1%
r27000: ** TOTAL **: 1.21x as fast 1079.5ms +/- 0.1% 889.4ms +/- 0.1%
r28000: ** TOTAL **: 1.181x as fast 1051.2ms +/- 0.1% 890.3ms +/- 0.1%
r29000: ** TOTAL **: 1.089x as fast 970.4ms +/- 0.1% 891.1ms +/- 0.1%
r30000: ** TOTAL **: 1.100x as fast 979.3ms +/- 0.1% 890.0ms +/- 0.1%
r31000: ** TOTAL **: 1.039x as fast 924.0ms +/- 0.1% 889.7ms +/- 0.1%
r32000: ** TOTAL **: 1.033x as fast 919.5ms +/- 0.1% 890.0ms +/- 0.1%
r32221: ** TOTAL **: - 889.4ms +/- 0.1% 889.1ms +/- 0.1%
It looks like we actually backslid a few times (eg. r25000 to r26000, r26000 to
r27000, r29000 to r30000), despite the "no SunSpider performance regressions
allowed" policy. This doesn't really surprise me, SunSpider is somewhat noisy,
so it's probably not hard for slight regressions to be committed. But the
general trend is very encouraging.
I've posted the full results below, grouped by test. I'll post the full
results grouped by revision in a follow-up email -- if I try to do it all in
one I exceed the size limit for this email list. revision. Looking through
all the results them, a couple of things leap out.
First, the improvements are quite evenly distributed. The single biggest
improvement between r23700-r32221 was for math-cordic:
cordic: 1.96x as fast 19.9ms +/- 0.2% 10.2ms +/-
0.8% significant
I wouldn't have been surprised if one or two tests had improved by a lot
more than that.
I can't decide if this even distribution is a good thing or a bad thing. It
shows that the overall 1.29x improvement isn't just due to fixing some amazing
stupidity in one or two tests, which is good, as it means Firefox's JavaScript
upcoming performance improvements will be felt broadly. But it also shows
that no new killer features have been added that really improve particular
tests. Maybe there are some such features out there waiting to be found
(bug 459301, on tracing recursive calls, is a good candidate).
Second, crypto-sha1 has gone backwards since r23700:
sha1: *1.26x as slow* 6.8ms +/- 1.3% 8.5ms +/-
1.2% significant
It looks like it slowed down a bit some time between r25000-r26000, and then a
lot more between r27000-r28000, and then sped up a bit between r28000-r29000
and has held steady since.
Third, bits-in-byte has gone backwards since r32000:
bits-in-byte: *1.20x as slow* 8.2ms +/- 1.0% 9.9ms +/-
0.7% significant
Fourth, fannkuch's number are a little better than the start of the year, but
they've jumped around a lot. Maybe it's just a noisy benchmark.
The sha1 and bits-in-byte regressions are worth investigating, I will file
bugs on these and do some bisecting and try to work out what happened with
them. There are also lots of regressions of a few percent throughout the
results, but they don't seem worth investigating when the general trend is
downward.
-----------------------------------------------------------------------------
FULL RESULTS GROUPED BY TEST
-----------------------------------------------------------------------------
Older revisions are shown first, so we expect the times in column 3 to
decrease as we move down the page. Note that r32221 does not have its own
line, its time is in column 4.
r23700 cube: 1.21x as fast 46.5ms +/- 0.5%
38.5ms +/- 0.3% significant
r24000 cube: 1.045x as fast 40.2ms +/- 0.5%
38.5ms +/- 0.3% significant
r25000 cube: 1.029x as fast 39.6ms +/- 0.3%
38.4ms +/- 0.3% significant
r26000 cube: 1.109x as fast 42.8ms +/- 0.2%
38.6ms +/- 0.6% significant
r27000 cube: 1.150x as fast 44.2ms +/- 0.5%
38.4ms +/- 0.3% significant
r28000 cube: 1.181x as fast 45.4ms +/- 0.2%
38.5ms +/- 0.3% significant
r29000 cube: 1.015x as fast 39.2ms +/- 0.2%
38.6ms +/- 0.5% significant
r30000 cube: 1.015x as fast 39.0ms +/- 0.1%
38.4ms +/- 0.3% significant
r31000 cube: - 38.5ms +/- 0.4%
38.4ms +/- 0.3%
r32000 cude: 1.022x as fast 39.2ms +/- 0.3%
38.4ms +/- 0.3% significant
r23700 morph: 1.094x as fast 31.8ms +/- 0.3%
29.1ms +/- 0.2% significant
r24000 morph: 1.073x as fast 31.2ms +/- 0.5%
29.1ms +/- 0.2% significant
r25000 morph: 1.061x as fast 30.8ms +/- 0.5%
29.1ms +/- 0.2% significant
r26000 morph: 1.075x as fast 31.4ms +/- 0.3%
29.2ms +/- 0.5% significant
r27000 morph: 1.089x as fast 31.7ms +/- 0.3%
29.1ms +/- 0.2% significant
r28000 morph: 1.087x as fast 31.6ms +/- 0.3%
29.0ms +/- 0.2% significant
r29000 morph: ?? 29.2ms +/- 0.3%
29.3ms +/- 0.4% not conclusive: might be *1.002x as slow*
r30000 morph: *1.006x as slow* 29.0ms +/- 0.2%
29.1ms +/- 0.2% significant
r31000 morph: *1.005x as slow* 28.9ms +/- 0.4%
29.1ms +/- 0.2% significant
r32000 morph: - 29.1ms +/- 0.2%
29.1ms +/- 0.2%
r23700 raytrace: 1.22x as fast 86.0ms +/- 0.1%
70.4ms +/- 0.1% significant
r24000 raytrace: 1.188x as fast 83.6ms +/- 0.3%
70.4ms +/- 0.1% significant
r25000 raytrace: 1.23x as fast 86.7ms +/- 0.1%
70.4ms +/- 0.1% significant
r26000 raytrace: 1.192x as fast 84.2ms +/- 0.4%
70.6ms +/- 0.3% significant
r27000 raytrace: 1.191x as fast 83.8ms +/- 0.1%
70.4ms +/- 0.1% significant
r28000 raytrace: 1.22x as fast 85.6ms +/- 0.1%
70.4ms +/- 0.1% significant
r29000 raytrace: 1.066x as fast 75.1ms +/- 0.1%
70.5ms +/- 0.2% significant
r30000 raytrace: 1.059x as fast 74.7ms +/- 0.1%
70.5ms +/- 0.4% significant
r31000 raytrace: 1.028x as fast 72.2ms +/- 0.1%
70.2ms +/- 0.1% significant
r32000 raytrace: 1.039x as fast 73.1ms +/- 0.1%
70.4ms +/- 0.1% significant
r23700 binary-trees: ?? 39.2ms +/- 0.2%
39.4ms +/- 0.3% not conclusive: might be *1.003x as slow*
r24000 binary-trees: 1.023x as fast 40.3ms +/- 0.3%
39.4ms +/- 0.2% significant
r25000 binary-trees: 1.016x as fast 39.9ms +/- 0.1%
39.3ms +/- 0.2% significant
r26000 binary-trees: 1.013x as fast 39.9ms +/- 0.2%
39.4ms +/- 0.4% significant
r27000 binary-trees: 1.068x as fast 41.9ms +/- 0.1%
39.3ms +/- 0.2% significant
r28000 binary-trees: 1.013x as fast 39.8ms +/- 0.2%
39.3ms +/- 0.2% significant
r29000 binary-trees: ?? 39.3ms +/- 0.3%
39.4ms +/- 0.7% not conclusive: might be *1.003x as slow*
r30000 binary-trees: 1.017x as fast 40.0ms +/- 0.1%
39.3ms +/- 0.2% significant
r31000 binary-trees: *1.052x as slow* 37.4ms +/- 0.3%
39.3ms +/- 0.3% significant
r32000 binary-trees: 1.033x as fast 40.7ms +/- 0.2%
39.4ms +/- 0.6% significant
r23700 fannkuch: 1.103x as fast 64.4ms +/- 0.2%
58.4ms +/- 0.2% significant
r24000 fannkuch: *1.031x as slow* 56.7ms +/- 0.2%
58.5ms +/- 0.2% significant
r25000 fannkuch: *1.028x as slow* 56.9ms +/- 0.2%
58.5ms +/- 0.2% significant
r26000 fannkuch: 1.087x as fast 63.7ms +/- 7.6%
58.6ms +/- 0.2% significant
r27000 fannkuch: 1.026x as fast 59.9ms +/- 0.1%
58.3ms +/- 0.2% significant
r28000 fannkuch: 1.020x as fast 59.7ms +/- 0.2%
58.5ms +/- 0.2% significant
r29000 fannkuch: *1.033x as slow* 56.6ms +/- 0.2%
58.5ms +/- 0.3% significant
r30000 fannkuch: 1.006x as fast 58.8ms +/- 0.1%
58.4ms +/- 0.2% significant
r31000 fannkuch: *1.039x as slow* 56.3ms +/- 0.2%
58.4ms +/- 0.3% significant
r32000 fannkuch: 1.044x as fast 61.0ms +/- 0.1%
58.4ms +/- 0.2% significant
r23700 nbody: 1.20x as fast 30.6ms +/- 0.3%
25.5ms +/- 0.4% significant
r24000 nbody: *1.022x as slow* 24.8ms +/- 0.3%
25.3ms +/- 0.4% significant
r25000 nbody: *1.024x as slow* 24.7ms +/- 0.4%
25.3ms +/- 0.3% significant
r26000 nbody: 1.100x as fast 27.9ms +/- 0.2%
25.3ms +/- 0.4% significant
r27000 nbody: 1.075x as fast 27.4ms +/- 0.3%
25.4ms +/- 0.4% significant
r28000 nbody: 1.107x as fast 28.0ms +/- 0.2%
25.3ms +/- 0.4% significant
r29000 nbody: 1.007x as fast 25.6ms +/- 0.4%
25.4ms +/- 0.6% significant
r30000 nbody: 1.026x as fast 26.0ms +/- 0.1%
25.4ms +/- 0.8% significant
r31000 nbody: 1.047x as fast 26.5ms +/- 0.4%
25.3ms +/- 0.4% significant
r32000 nbody: 1.040x as fast 26.3ms +/- 0.4%
25.3ms +/- 0.5% significant
r23700 nsieve: ?? 13.2ms +/- 0.6%
13.3ms +/- 0.7% not conclusive: might be *1.008x as slow*
r24000 nsieve: *1.047x as slow* 12.7ms +/- 0.7%
13.3ms +/- 0.7% significant
r25000 nsieve: *1.032x as slow* 13.0ms +/- 0.3%
13.4ms +/- 0.7% significant
r26000 nsieve: 1.050x as fast 14.1ms +/- 0.4%
13.4ms +/- 0.8% significant
r27000 nsieve: 1.068x as fast 14.1ms +/- 0.4%
13.2ms +/- 0.6% significant
r28000 nsieve: 1.081x as fast 14.3ms +/- 0.7%
13.3ms +/- 0.7% significant
r29000 nsieve: 1.019x as fast 13.6ms +/- 0.7%
13.3ms +/- 0.7% significant
r30000 nsieve: - 13.4ms +/- 0.7%
13.3ms +/- 0.8%
r31000 nsieve: 1.042x as fast 13.9ms +/- 0.8%
13.3ms +/- 0.7% significant
r32000 nsieve: 1.024x as fast 13.6ms +/- 0.7%
13.3ms +/- 0.7% significant
r23700 3bit-bits-in-byte: - 1.6ms +/- 6.1%
1.6ms +/- 6.6%
r24000 3bit-bits-in-byte: ?? 1.6ms +/- 6.0%
1.6ms +/- 5.8% not conclusive: might be *1.019x as slow*
r25000 3bit-bits-in-byte: ?? 1.6ms +/- 5.9%
1.6ms +/- 5.8% not conclusive: might be *1.006x as slow*
r26000 3bit-bits-in-byte: - 1.8ms +/- 4.8%
1.7ms +/- 5.7%
r27000 3bit-bits-in-byte: 1.180x as fast 1.8ms +/- 4.7%
1.5ms +/- 6.6% significant
r28000 3bit-bits-in-byte: 1.097x as fast 1.7ms +/- 5.4%
1.6ms +/- 6.4% significant
r29000 3bit-bits-in-byte: 1.116x as fast 1.7ms +/- 5.1%
1.6ms +/- 6.4% significant
r30000 3bit-bits-in-byte: 1.139x as fast 1.7ms +/- 5.2%
1.5ms +/- 6.6% significant
r31000 3bit-bits-in-byte: 1.092x as fast 1.7ms +/- 5.6%
1.5ms +/- 6.7% significant
r32000 3bit-bits-in-byte: - 1.6ms +/- 5.8%
1.6ms +/- 6.1%
r23700 bits-in-byte: - 9.9ms +/- 0.7%
9.8ms +/- 0.7%
r24000 bits-in-byte: 1.067x as fast 10.5ms +/- 0.9%
9.9ms +/- 0.7% significant
r25000 bits-in-byte: *1.147x as slow* 8.6ms +/- 1.1%
9.8ms +/- 0.7% significant
r26000 bits-in-byte: *1.192x as slow* 8.3ms +/- 1.1%
9.9ms +/- 0.7% significant
r27000 bits-in-byte: *1.190x as slow* 8.3ms +/- 1.1%
9.8ms +/- 0.7% significant
r28000 bits-in-byte: *1.185x as slow* 8.3ms +/- 1.1%
9.8ms +/- 0.7% significant
r29000 bits-in-byte: *1.21x as slow* 8.1ms +/- 0.8%
9.9ms +/- 0.7% significant
r30000 bits-in-byte: *1.198x as slow* 8.2ms +/- 1.0%
9.8ms +/- 0.8% significant
r31000 bits-in-byte: *1.199x as slow* 8.2ms +/- 1.3%
9.8ms +/- 1.0% significant
r32000 bits-in-byte: *1.20x as slow* 8.2ms +/- 1.0%
9.9ms +/- 0.7% significant
r23700 bitwise-and: ?? 2.5ms +/- 4.0%
2.5ms +/- 3.9% not conclusive: might be *1.033x as slow*
r24000 bitwise-and: - 2.5ms +/- 4.0%
2.5ms +/- 4.0%
r25000 bitwise-and: *1.088x as slow* 2.2ms +/- 3.7%
2.4ms +/- 4.0% significant
r26000 bitwise-and: 1.064x as fast 2.7ms +/- 3.5%
2.5ms +/- 4.0% significant
r27000 bitwise-and: *1.173x as slow* 2.3ms +/- 3.9%
2.6ms +/- 3.6% significant
r28000 bitwise-and: *1.093x as slow* 2.3ms +/- 3.9%
2.5ms +/- 4.0% significant
r29000 bitwise-and: 1.088x as fast 2.7ms +/- 3.3%
2.5ms +/- 4.0% significant
r30000 bitwise-and: - 2.6ms +/- 3.7%
2.5ms +/- 4.0%
r31000 bitwise-and: ?? 2.4ms +/- 4.1%
2.5ms +/- 4.0% not conclusive: might be *1.025x as slow*
r32000 bitwise-and: - 2.5ms +/- 4.2%
2.4ms +/- 4.1%
r23700 nsieve-bits: 1.173x as fast 27.7ms +/- 0.3%
23.6ms +/- 0.7% significant
r24000 nsieve-bits: 1.026x as fast 24.1ms +/- 0.3%
23.5ms +/- 0.4% significant
r25000 nsieve-bits: 1.010x as fast 23.8ms +/- 0.4%
23.5ms +/- 0.4% significant
r26000 nsieve-bits: 1.088x as fast 25.7ms +/- 0.4%
23.6ms +/- 0.4% significant
r27000 nsieve-bits: 1.080x as fast 25.3ms +/- 0.4%
23.5ms +/- 0.4% significant
r28000 nsieve-bits: 1.054x as fast 24.8ms +/- 0.3%
23.6ms +/- 0.4% significant
r29000 nsieve-bits: 1.069x as fast 25.2ms +/- 0.3%
23.6ms +/- 0.4% significant
r30000 nsieve-bits: 1.036x as fast 24.4ms +/- 0.4%
23.6ms +/- 0.4% significant
r31000 nsieve-bits: *1.020x as slow* 23.2ms +/- 0.4%
23.7ms +/- 0.5% significant
r32000 nsieve-bits: 1.030x as fast 24.3ms +/- 0.7%
23.6ms +/- 0.6% significant
r23700 recursive: 1.013x as fast 34.1ms +/- 0.2%
33.6ms +/- 0.3% significant
r24000 recursive: 1.015x as fast 34.1ms +/- 0.2%
33.6ms +/- 0.4% significant
r25000 recursive: 1.037x as fast 34.9ms +/- 0.2%
33.6ms +/- 0.3% significant
r26000 recursive: 1.039x as fast 35.0ms +/- 0.1%
33.6ms +/- 0.3% significant
r27000 recursive: 1.026x as fast 34.5ms +/- 0.3%
33.6ms +/- 0.3% significant
r28000 recursive: 1.020x as fast 34.3ms +/- 0.3%
33.6ms +/- 0.3% significant
r29000 recursive: *1.005x as slow* 33.4ms +/- 0.3%
33.6ms +/- 0.3% significant
r30000 recursive: *1.006x as slow* 33.5ms +/- 0.3%
33.7ms +/- 0.6% significant
r31000 recursive: ?? 33.6ms +/- 0.3%
33.7ms +/- 0.3% not conclusive: might be *1.002x as slow*
r32000 recursive: 1.007x as fast 33.9ms +/- 0.3%
33.7ms +/- 0.4% significant
r23700 aes: 1.21x as fast 37.8ms +/- 0.2%
31.4ms +/- 0.8% significant
r24000 aes: 1.167x as fast 36.6ms +/- 0.3%
31.4ms +/- 0.9% significant
r25000 aes: 1.161x as fast 36.4ms +/- 0.3%
31.4ms +/- 0.9% significant
r26000 aes: 1.20x as fast 37.9ms +/- 0.2%
31.5ms +/- 1.0% significant
r27000 aes: 1.21x as fast 38.0ms +/- 0.1%
31.3ms +/- 0.9% significant
r28000 aes: 1.27x as fast 40.0ms +/- 0.5%
31.5ms +/- 0.8% significant
r29000 aes: - 31.4ms +/- 0.8%
31.3ms +/- 0.9%
r30000 aes: ?? 31.4ms +/- 0.9%
31.6ms +/- 0.8% not conclusive: might be *1.004x as slow*
r31000 aes: - 31.3ms +/- 0.8%
31.3ms +/- 0.8%
r32000 aes: - 31.6ms +/- 1.0%
31.4ms +/- 0.8%
r23700 md5: 1.38x as fast 20.4ms +/- 0.5%
14.8ms +/- 0.6% significant
r24000 md5: 1.35x as fast 19.9ms +/- 0.3%
14.8ms +/- 0.6% significant
r25000 md5: 1.37x as fast 20.3ms +/- 0.4%
14.8ms +/- 0.6% significant
r26000 md5: 1.45x as fast 21.3ms +/- 0.4%
14.7ms +/- 0.6% significant
r27000 md5: 1.47x as fast 21.7ms +/- 0.4%
14.7ms +/- 0.6% significant
r28000 md5: 1.50x as fast 21.9ms +/- 0.3%
14.7ms +/- 0.6% significant
r29000 md5: 1.047x as fast 15.5ms +/- 1.0%
14.8ms +/- 0.5% significant
r30000 md5: 1.044x as fast 15.4ms +/- 0.6%
14.8ms +/- 0.6% significant
r31000 md5: 1.022x as fast 15.1ms +/- 0.4%
14.8ms +/- 0.6% significant
r32000 md5: 1.021x as fast 15.1ms +/- 0.4%
14.8ms +/- 0.7% significant
r23700 sha1: *1.26x as slow* 6.8ms +/- 1.3%
8.5ms +/- 1.2% significant
r24000 sha1: *1.26x as slow* 6.8ms +/- 1.2%
8.5ms +/- 1.2% significant
r25000 sha1: *1.28x as slow* 6.7ms +/- 1.4%
8.6ms +/- 1.2% significant
r26000 sha1: *1.142x as slow* 7.5ms +/- 1.3%
8.5ms +/- 1.2% significant
r27000 sha1: *1.101x as slow* 7.8ms +/- 1.1%
8.5ms +/- 1.2% significant
r28000 sha1: 1.175x as fast 10.0ms +/- 0.6%
8.5ms +/- 1.2% significant
r29000 sha1: - 8.6ms +/- 1.4%
8.6ms +/- 1.2%
r30000 sha1: ?? 8.4ms +/- 1.2%
8.5ms +/- 1.2% not conclusive: might be *1.011x as slow*
r31000 sha1: ?? 8.5ms +/- 1.2%
8.5ms +/- 1.2% not conclusive: might be *1.008x as slow*
r32000 sha1: - 8.6ms +/- 1.1%
8.6ms +/- 1.4%
r23700 format-tofte: 1.81x as fast 119.4ms +/- 0.1%
65.8ms +/- 0.1% significant
r24000 format-tofte: 1.52x as fast 100.2ms +/- 0.1%
65.8ms +/- 0.1% significant
r25000 format-tofte: 1.039x as fast 68.4ms +/- 0.1%
65.8ms +/- 0.3% significant
r26000 format-tofte: 1.019x as fast 67.2ms +/- 0.1%
65.9ms +/- 0.1% significant
r27000 format-tofte: 1.051x as fast 69.2ms +/- 0.3%
65.8ms +/- 0.1% significant
r28000 format-tofte: 1.041x as fast 68.5ms +/- 0.3%
65.8ms +/- 0.1% significant
r29000 format-tofte: *1.006x as slow* 65.5ms +/- 0.2%
65.9ms +/- 0.1% significant
r30000 format-tofte: - 65.9ms +/- 0.1%
65.9ms +/- 0.2%
r31000 format-tofte: *1.055x as slow* 62.4ms +/- 0.2%
65.9ms +/- 0.3% significant
r32000 format-tofte: *1.007x as slow* 65.5ms +/- 0.2%
65.9ms +/- 0.2% significant
r23700 format-xparb: 1.73x as fast 102.1ms +/- 0.1%
58.9ms +/- 0.1% significant
r24000 format-xparb: 1.70x as fast 100.4ms +/- 0.3%
59.0ms +/- 0.2% significant
r25000 format-xparb: 1.77x as fast 103.9ms +/- 0.1%
58.8ms +/- 0.1% significant
r26000 format-xparb: 1.70x as fast 100.1ms +/- 0.1%
58.9ms +/- 0.1% significant
r27000 format-xparb: 1.88x as fast 110.9ms +/- 0.1%
59.0ms +/- 0.5% significant
r28000 format-xparb: 1.26x as fast 74.4ms +/- 0.1%
58.9ms +/- 0.1% significant
r29000 format-xparb: 1.187x as fast 69.9ms +/- 0.1%
58.9ms +/- 0.1% significant
r30000 format-xparb: 1.176x as fast 69.3ms +/- 0.1%
58.9ms +/- 0.4% significant
r31000 format-xparb: 1.174x as fast 69.1ms +/- 0.3%
58.8ms +/- 0.1% significant
r32000 format-xparb: 1.168x as fast 68.7ms +/- 0.1%
58.8ms +/- 0.1% significant
r23700 cordic: 1.96x as fast 19.9ms +/- 0.2%
10.2ms +/- 0.8% significant
r24000 cordic: 1.97x as fast 20.1ms +/- 0.3%
10.2ms +/- 1.0% significant
r25000 cordic: 1.96x as fast 19.9ms +/- 0.3%
10.2ms +/- 0.8% significant
r26000 cordic: 1.97x as fast 19.9ms +/- 0.4%
10.1ms +/- 0.7% significant
r27000 cordic: 1.96x as fast 19.9ms +/- 0.3%
10.1ms +/- 0.7% significant
r28000 cordic: 1.96x as fast 19.9ms +/- 0.2%
10.2ms +/- 0.7% significant
r29000 cordic: 1.083x as fast 11.1ms +/- 0.5%
10.2ms +/- 0.8% significant
r30000 cordic: 1.084x as fast 11.1ms +/- 0.4%
10.2ms +/- 0.8% significant
r31000 cordic: 1.104x as fast 11.2ms +/- 0.6%
10.1ms +/- 0.7% significant
r32000 cordic: 1.078x as fast 10.9ms +/- 0.5%
10.2ms +/- 0.7% significant
r23700 partial-sums: 1.055x as fast 14.9ms +/- 0.4%
14.1ms +/- 0.4% significant
r24000 partial-sums: 1.022x as fast 14.5ms +/- 0.7%
14.2ms +/- 0.7% significant
r25000 partial-sums: - 14.2ms +/- 0.6%
14.2ms +/- 0.5%
r26000 partial-sums: - 14.2ms +/- 0.6%
14.2ms +/- 0.5%
r27000 partial-sums: 1.011x as fast 14.2ms +/- 0.6%
14.1ms +/- 0.4% significant
r28000 partial-sums: *1.027x as slow* 13.8ms +/- 0.6%
14.2ms +/- 0.7% significant
r29000 partial-sums: *1.018x as slow* 13.9ms +/- 0.4%
14.2ms +/- 0.5% significant
r30000 partial-sums: *1.017x as slow* 13.8ms +/- 0.6%
14.1ms +/- 0.4% significant
r31000 partial-sums: *1.044x as slow* 13.5ms +/- 0.7%
14.1ms +/- 0.4% significant
r32000 partial-sums: *1.036x as slow* 13.6ms +/- 0.7%
14.1ms +/- 0.5% significant
r23700 spectral-norm: 1.36x as fast 8.5ms +/- 1.2%
6.2ms +/- 1.3% significant
r24000 spectral-norm: 1.130x as fast 7.0ms +/- 0.4%
6.2ms +/- 1.3% significant
r25000 spectral-norm: ?? 6.2ms +/- 1.2%
6.2ms +/- 1.3% not conclusive: might be *1.005x as slow*
r26000 spectral-norm: 1.062x as fast 6.5ms +/- 1.5%
6.2ms +/- 1.2% significant
r27000 spectral-norm: 1.050x as fast 6.5ms +/- 1.6%
6.2ms +/- 1.2% significant
r28000 spectral-norm: - 6.3ms +/- 1.4%
6.2ms +/- 1.4%
r29000 spectral-norm: ?? 6.2ms +/- 1.2%
6.2ms +/- 1.2% not conclusive: might be *1.003x as slow*
r30000 spectral-norm: ?? 6.2ms +/- 1.2%
6.2ms +/- 1.3% not conclusive: might be *1.013x as slow*
r31000 spectral-norm: 1.046x as fast 6.4ms +/- 1.5%
6.1ms +/- 1.1% significant
r32000 spectral-norm: - 6.3ms +/- 1.5%
6.2ms +/- 1.3%
r23700 dna: 1.37x as fast 57.1ms +/- 0.1%
41.5ms +/- 0.2% significant
r24000 dna: 1.37x as fast 56.8ms +/- 0.1%
41.6ms +/- 0.3% significant
r25000 dna: 1.126x as fast 46.8ms +/- 0.2%
41.5ms +/- 0.6% significant
r26000 dna: 1.107x as fast 46.0ms +/- 0.4%
41.6ms +/- 0.2% significant
r27000 dna: 1.119x as fast 46.4ms +/- 0.4%
41.5ms +/- 0.2% significant
r28000 dna: 1.120x as fast 46.5ms +/- 0.3%
41.5ms +/- 0.4% significant
r29000 dna: 1.119x as fast 46.5ms +/- 0.4%
41.5ms +/- 0.2% significant
r30000 dna: 1.121x as fast 46.5ms +/- 0.2%
41.4ms +/- 0.2% significant
r31000 dna: *1.007x as slow* 41.3ms +/- 0.2%
41.6ms +/- 0.2% significant
r32000 dna: - 41.5ms +/- 0.2%
41.5ms +/- 0.2%
r23700 base64: 1.26x as fast 17.1ms +/- 0.3%
13.5ms +/- 0.7% significant
r24000 base64: 1.196x as fast 16.2ms +/- 0.5%
13.6ms +/- 1.0% significant
r25000 base64: 1.23x as fast 16.7ms +/- 0.5%
13.6ms +/- 0.7% significant
r26000 base64: 1.34x as fast 18.1ms +/- 0.7%
13.6ms +/- 0.7% significant
r27000 base64: 1.30x as fast 17.6ms +/- 0.5%
13.6ms +/- 0.7% significant
r28000 base64: 1.31x as fast 17.8ms +/- 0.6%
13.5ms +/- 0.7% significant
r29000 base64: 1.29x as fast 17.4ms +/- 0.6%
13.5ms +/- 0.7% significant
r30000 base64: 1.34x as fast 18.1ms +/- 0.3%
13.5ms +/- 0.7% significant
r31000 base64: 1.30x as fast 17.7ms +/- 0.5%
13.6ms +/- 0.7% significant
r32000 base64: 1.32x as fast 18.0ms +/- 0.2%
13.6ms +/- 0.7% significant
r23700 fasta: 1.23x as fast 77.5ms +/- 0.2%
63.2ms +/- 0.4% significant
r24000 fasta: 1.20x as fast 75.9ms +/- 0.1%
63.1ms +/- 0.4% significant
r25000 fasta: 1.21x as fast 76.7ms +/- 0.1%
63.1ms +/- 0.4% significant
r26000 fasta: 1.25x as fast 79.1ms +/- 0.1%
63.2ms +/- 0.4% significant
r27000 fasta: 1.26x as fast 79.3ms +/- 0.1%
63.1ms +/- 0.6% significant
r28000 fasta: 1.27x as fast 80.3ms +/- 0.2%
63.4ms +/- 0.7% significant
r29000 fasta: 1.22x as fast 77.5ms +/- 0.1%
63.5ms +/- 0.4% significant
r30000 fasta: 1.23x as fast 77.5ms +/- 0.2%
63.1ms +/- 0.4% significant
r31000 fasta: 1.030x as fast 65.2ms +/- 0.1%
63.3ms +/- 0.5% significant
r32000 fasta: *1.016x as slow* 62.3ms +/- 0.2%
63.3ms +/- 0.4% significant
r23700 tagcloud: 1.24x as fast 117.0ms +/- 0.4%
94.6ms +/- 0.1% significant
r24000 tagcloud: 1.168x as fast 110.6ms +/- 0.3%
94.7ms +/- 0.3% significant
r25000 tagcloud: 1.131x as fast 107.0ms +/- 0.3%
94.6ms +/- 0.3% significant
r26000 tagcloud: 1.111x as fast 105.2ms +/- 0.1%
94.6ms +/- 0.1% significant
r27000 tagcloud: 1.126x as fast 106.6ms +/- 0.1%
94.7ms +/- 0.3% significant
r28000 tagcloud: 1.142x as fast 108.1ms +/- 0.1%
94.6ms +/- 0.3% significant
r29000 tagcloud: 1.114x as fast 105.4ms +/- 0.2%
94.6ms +/- 0.1% significant
r30000 tagcloud: 1.141x as fast 107.7ms +/- 0.3%
94.4ms +/- 0.1% significant
r31000 tagcloud: 1.066x as fast 100.7ms +/- 0.3%
94.5ms +/- 0.1% significant
r32000 tagcloud: 1.044x as fast 98.6ms +/- 0.1%
94.4ms +/- 0.1% significant
r23700 unpack-code: 1.41x as fast 134.0ms +/- 0.1%
94.7ms +/- 0.1% significant
r24000 unpack-code: 1.42x as fast 134.6ms +/- 0.1%
94.9ms +/- 0.3% significant
r25000 unpack-code: 1.54x as fast 145.4ms +/- 0.1%
94.7ms +/- 0.2% significant
r26000 unpack-code: 1.44x as fast 136.9ms +/- 0.2%
94.9ms +/- 0.2% significant
r27000 unpack-code: 1.41x as fast 133.3ms +/- 0.2%
94.6ms +/- 0.1% significant
r28000 unpack-code: 1.42x as fast 134.5ms +/- 0.2%
94.8ms +/- 0.3% significant
r29000 unpack-code: 1.26x as fast 119.5ms +/- 0.1%
94.8ms +/- 0.1% significant
r30000 unpack-code: 1.32x as fast 124.6ms +/- 0.2%
94.7ms +/- 0.1% significant
r31000 unpack-code: 1.147x as fast 108.4ms +/- 0.1%
94.5ms +/- 0.1% significant
r32000 unpack-code: 1.001x as fast 94.8ms +/- 0.1%
94.6ms +/- 0.1% significant
r23700 validate-input: 1.196x as fast 32.5ms +/- 0.3%
27.1ms +/- 0.3% significant
r24000 validate-input: 1.196x as fast 32.5ms +/- 0.3%
27.2ms +/- 0.3% significant
r25000 validate-input: 1.21x as fast 32.7ms +/- 0.3%
27.1ms +/- 0.2% significant
r26000 validate-input: 1.21x as fast 33.0ms +/- 0.2%
27.2ms +/- 0.3% significant
r27000 validate-input: 1.22x as fast 33.1ms +/- 0.2%
27.1ms +/- 0.2% significant
r28000 validate-input: 1.22x as fast 33.3ms +/- 0.3%
27.2ms +/- 0.3% significant
r29000 validate-input: 1.196x as fast 32.5ms +/- 0.3%
27.2ms +/- 0.3% significant
r30000 validate-input: 1.187x as fast 32.2ms +/- 0.7%
27.1ms +/- 0.3% significant
r31000 validate-input: 1.122x as fast 30.5ms +/- 0.3%
27.2ms +/- 0.3% significant
r32000 validate-input: 1.122x as fast 30.4ms +/- 0.5%
27.1ms +/- 0.2% significant
Nicholas Nethercote
https://bugzilla.mozilla.org/show_bug.cgi?id=515871
because this newsgroup appears to wrap long lines, which makes it
difficult to read.
Nicholas Nethercote
https://bugzilla.mozilla.org/show_bug.cgi?id=515876
https://bugzilla.mozilla.org/show_bug.cgi?id=515875
Nick