[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration
Current	153918	2012-04-03 01:17:24	0:14:33
Previous	153781	2012-03-30 22:45:23	0:14:27
Baseline	153780	2012-03-30 22:20:19	0:14:25

---

Tests Summary

Status Group	#	# (B)
Performance Regressions	74	100
Performance Improvements	74	106
Existing Failures	8	8
Unchanged Tests	732	674
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)
SingleSource/UnitTests/2002-05-02-CastTest	200.00%	0.0100	0.0300	0.0050	50.00%	-
MultiSource/Benchmarks/Prolangs-C++/primes/primes	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/Benchmarks/Misc-C++/mandel-text	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/Benchmarks/Stanford/Towers	100.00%	0.0200	0.0400	0.0000	100.00%	-
SingleSource/UnitTests/2002-05-02-ManyArguments	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/2002-08-02-CastTest	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/2002-10-09-ArrayResolution	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/2002-10-12-StructureArgsSimple	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/2003-05-12-MinIntProblem	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/2003-10-29-ScalarReplBug	100.00%	0.0100	0.0200	0.0000	100.00%	-
SingleSource/UnitTests/DefaultInitDynArrays	100.00%	0.0100	0.0200	0.0000	100.00%	-
MultiSource/Benchmarks/Prolangs-C++/garage/garage	66.67%	0.0300	0.0500	0.0050	25.00%	-
MultiSource/Benchmarks/McCat/17-bintr/bintr	50.00%	0.0400	0.0600	0.0050	20.00%	-
MultiSource/Benchmarks/Fhourstones/fhourstones	42.86%	0.0700	0.1000	0.0050	25.00%	-
MultiSource/Benchmarks/Olden/mst/mst	42.86%	0.0700	0.1000	0.0050	66.67%	-
MultiSource/Benchmarks/MiBench/security-sha/security-sha	33.33%	0.0600	0.0800	0.0050	14.29%	-
SingleSource/Benchmarks/Stanford/RealMM	33.33%	0.0300	0.0400	0.0000	33.33%	-
SingleSource/UnitTests/Vector/SSE/sse_shift	33.33%	0.0300	0.0400	0.0000	33.33%	-
SingleSource/Benchmarks/Stanford/Oscar	25.00%	0.0400	0.0500	0.0000	25.00%	-
SingleSource/UnitTests/Vector/SSE/sse_expandfft	25.00%	0.0800	0.1000	0.0050	11.11%	-
MultiSource/Applications/viterbi/viterbi	23.08%	0.1300	0.1600	0.0100	45.45%	-
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish	21.05%	0.1900	0.2300	0.0050	15.00%	-
MultiSource/Benchmarks/Prolangs-C++/objects/objects	16.67%	0.0600	0.0700	0.0000	16.67%	-
MultiSource/Benchmarks/Prolangs-C++/trees/trees	16.67%	0.0600	0.0700	0.0000	16.67%	-
MultiSource/Benchmarks/McCat/18-imp/imp	15.38%	0.2600	0.3000	0.0100	7.14%	-
SingleSource/Benchmarks/Misc/oourafft	11.76%	0.1700	0.1900	0.0050	18.75%	-
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	11.11%	0.1800	0.2000	0.0000	11.11%	-
SingleSource/Benchmarks/Shootout-C++/except	11.11%	0.1800	0.2000	0.0050	5.26%	-
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes	9.09%	0.2200	0.2400	0.0000	9.09%	-
MultiSource/Benchmarks/Prolangs-C/loader/loader	9.09%	0.2200	0.2400	0.0050	4.35%	-
MultiSource/Benchmarks/VersaBench/bmm/bmm	9.09%	0.2200	0.2400	0.0000	9.09%	-
MultiSource/Benchmarks/mediabench/gsm/toast/toast	9.00%	1.0000	1.0900	0.0150	12.37%	-
MultiSource/Benchmarks/Olden/bh/bh	8.70%	0.2300	0.2500	0.0050	13.64%	-
SingleSource/Benchmarks/Shootout-C++/sieve	8.70%	0.2300	0.2500	0.0050	4.17%	-
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg	8.09%	3.4600	3.7400	0.0500	5.06%	-
SingleSource/Benchmarks/Misc/himenobmtxpa	7.69%	0.1300	0.1400	0.0000	7.69%	-
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	6.67%	0.1500	0.1600	0.0000	6.67%	-
MultiSource/Applications/hbd/hbd	6.25%	1.1200	1.1900	0.0200	10.19%	-
SingleSource/Benchmarks/Adobe-C++/functionobjects	5.71%	0.3500	0.3700	0.0050	2.78%	-
MultiSource/Applications/sgefa/sgefa	4.00%	0.2500	0.2600	0.0000	4.00%	-
SingleSource/Benchmarks/Adobe-C++/stepanov_vector	3.92%	0.5100	0.5300	0.0050	1.92%	-
MultiSource/Applications/kimwitu++/kc	3.59%	12.5500	13.0000	0.0350	3.01%	-
MultiSource/Benchmarks/nbench/nbench	3.49%	0.8600	0.8900	0.0100	5.95%	-
MultiSource/Applications/siod/siod	2.31%	1.7300	1.7700	0.0050	1.72%	-
MultiSource/Benchmarks/PAQ8p/paq8p	1.91%	1.5700	1.6000	0.0050	1.27%	-
MultiSource/Applications/minisat/minisat	1.82%	0.5500	0.5600	0.0000	1.82%	-
SingleSource/Benchmarks/Misc-C++-EH/spirit	1.79%	3.9200	3.9900	0.0100	2.31%	-
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000	1.62%	5.5700	5.6600	0.0000	1.62%	-
MultiSource/Benchmarks/mafft/pairlocalalign	1.61%	6.8300	6.9400	0.0050	1.76%	-
MultiSource/Applications/JM/ldecod/ldecod	1.51%	5.2900	5.3700	0.0250	2.48%	-
MultiSource/Applications/JM/lencod/lencod	1.33%	12.0200	12.1800	0.0350	1.92%	-
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset	1.13%	10.5800	10.7000	0.0200	0.75%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)
MultiSource/Applications/kimwitu++/kc	150.00%	0.0200	0.0500	0.0050	400.00%	-
SingleSource/Benchmarks/Shootout-C++/ary2	66.67%	0.0300	0.0500	0.0000	66.67%	-
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	33.33%	0.0300	0.0400	0.0000	33.33%	-
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	28.77%	0.7300	0.9400	0.0050	30.56%	-
SingleSource/Benchmarks/Adobe-C++/loop_unroll	22.63%	1.3700	1.6800	0.0100	20.86%	-
SingleSource/Benchmarks/Shootout-C++/hash2	21.74%	2.5300	3.0800	0.0050	21.26%	-
MultiSource/Benchmarks/nbench/nbench	16.12%	16.5600	19.2300	0.1800	13.65%	-
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	10.34%	0.2900	0.3200	0.0050	6.67%	-
SingleSource/Benchmarks/Stanford/Puzzle	7.69%	0.1300	0.1400	0.0000	7.69%	-
SingleSource/UnitTests/Vector/SSE/sse_stepfft	7.50%	0.4000	0.4300	0.0000	7.50%	-
SingleSource/Benchmarks/Shootout-C++/sieve	5.59%	1.6100	1.7000	0.0250	2.41%	-
MultiSource/Benchmarks/FreeBench/mason/mason	5.26%	0.1900	0.2000	0.0000	5.26%	-
SingleSource/Regression/C/uint64_to_float	2.86%	0.3500	0.3600	0.0000	2.86%	-
MultiSource/Applications/obsequi/Obsequi	2.34%	1.7100	1.7500	0.0050	2.94%	-
MultiSource/Applications/lambda-0_1_3/lambda	1.98%	4.0400	4.1200	0.0050	1.73%	-
MultiSource/Applications/lua/lua	1.80%	22.7200	23.1300	0.0150	1.94%	-
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1	1.19%	0.8400	0.8500	0.0000	1.19%	-
SingleSource/Benchmarks/Misc/fbench	1.16%	1.7300	1.7500	0.0050	0.57%	-
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5	1.14%	1.7600	1.7800	0.0050	0.56%	-
SingleSource/Benchmarks/Misc/flops-4	1.11%	0.9000	0.9100	0.0000	1.11%	-
MultiSource/Benchmarks/Olden/em3d/em3d	1.03%	3.8700	3.9100	0.0100	0.51%	-
MultiSource/Benchmarks/mafft/pairlocalalign	1.03%	26.2400	26.5100	0.0100	1.11%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)
SingleSource/Regression/C++/EH/ConditionalExpr	-100.00%	0.0200	0.0000	0.0000	-100.00%	-
SingleSource/Regression/C++/EH/throw_rethrow_test	-100.00%	0.0200	0.0000	0.0050	-100.00%	-
SingleSource/Regression/C/2003-05-21-BitfieldHandling	-100.00%	0.0200	0.0000	0.0000	-100.00%	-
SingleSource/Regression/C/2003-06-16-InvalidInitializer	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/Regression/C/2003-06-16-VolatileError	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers	-100.00%	0.0200	0.0000	0.0050	-100.00%	-
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas	-100.00%	0.0200	0.0000	0.0000	-100.00%	-
SingleSource/Regression/C/PR1386	-100.00%	0.0200	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2002-04-17-PrintfChar	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2002-05-02-CastTest1	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2003-09-18-BitFieldTest	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall	-100.00%	0.0200	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2009-12-07-StructReturn	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/2010-05-24-BitfieldTest	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/Vector/sumarray-dbl	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/block-byref-test	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
SingleSource/UnitTests/block-copied-in-cxxobj	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
MultiSource/Benchmarks/BitBench/uuencode/uuencode	-75.00%	0.0400	0.0100	0.0050	-80.00%	-
SingleSource/Regression/C/PR640	-66.67%	0.0300	0.0100	0.0000	-66.67%	-
SingleSource/UnitTests/SignlessTypes/factor	-66.67%	0.0300	0.0100	0.0000	-66.67%	-
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	-50.00%	0.0400	0.0200	0.0000	-50.00%	-
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Benchmarks/Dhrystone/dry	-50.00%	0.0400	0.0200	0.0000	-50.00%	-
SingleSource/Benchmarks/Misc/pi	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Regression/C++/EH/dead_try_block	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Regression/C/2003-05-22-LocalTypeTest	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Regression/C/2004-02-03-AggregateCopy	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Regression/C/2004-03-15-IndirectGoto	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/Regression/C/test_indvars	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/2002-05-19-DivTest	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/2003-04-22-Switch	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/2006-02-04-DivRem	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/2007-01-04-KNR-Args	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
SingleSource/UnitTests/Vector/divides	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
MultiSource/Benchmarks/BitBench/five11/five11	-40.00%	0.0500	0.0300	0.0000	-40.00%	-
MultiSource/Benchmarks/Olden/treeadd/treeadd	-25.00%	0.0400	0.0300	0.0000	-25.00%	-
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	-23.40%	0.4700	0.3600	0.0100	-20.00%	-
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url	-22.22%	0.1800	0.1400	0.0000	-22.22%	-
SingleSource/Benchmarks/CoyoteBench/almabench	-20.00%	0.0500	0.0400	0.0000	-20.00%	-
SingleSource/UnitTests/SignlessTypes/Large/cast	-20.00%	0.0500	0.0400	0.0000	-20.00%	-
MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-14.29%	0.0700	0.0600	0.0000	-14.29%	-
SingleSource/Benchmarks/McGill/chomp	-14.29%	0.1400	0.1200	0.0050	-7.69%	-
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	-14.29%	0.1400	0.1200	0.0050	-7.69%	-
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	-10.53%	0.1900	0.1700	0.0050	-5.56%	-
SingleSource/Benchmarks/Shootout-C++/methcall	-10.53%	0.1900	0.1700	0.0000	-10.53%	-
MultiSource/Benchmarks/McCat/05-eks/eks	-10.00%	0.4000	0.3600	0.0000	-10.00%	-
MultiSource/Applications/obsequi/Obsequi	-9.89%	0.9100	0.8200	0.0200	-5.75%	-
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5	-9.09%	0.2200	0.2000	0.0050	-4.76%	-
MultiSource/Benchmarks/Prolangs-C/assembler/assembler	-8.16%	0.4900	0.4500	0.0000	-8.16%	-
SingleSource/Benchmarks/Shootout-C++/moments	-6.45%	0.3100	0.2900	0.0050	-3.33%	-
MultiSource/Benchmarks/Prolangs-C/bison/mybison	-5.71%	1.0500	0.9900	0.0050	-4.81%	-
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk	-5.00%	0.4000	0.3800	0.0050	-7.32%	-
MultiSource/Applications/oggenc/oggenc	-4.71%	4.0300	3.8400	0.0100	-4.24%	-
SingleSource/Benchmarks/Adobe-C++/loop_unroll	-4.49%	2.6700	2.5500	0.0100	-3.77%	-
MultiSource/Benchmarks/SciMark2-C/scimark2	-4.35%	0.2300	0.2200	0.0000	-4.35%	-
MultiSource/Benchmarks/Prolangs-C++/city/city	-2.38%	1.2600	1.2300	0.0000	-2.38%	-
MultiSource/Benchmarks/MallocBench/espresso/espresso	-1.37%	3.6500	3.6000	0.0100	-0.83%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-100.00%	0.0100	0.0000	0.0000	-100.00%	-
MultiSource/Benchmarks/MiBench/security-sha/security-sha	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-50.00%	0.0200	0.0100	0.0000	-50.00%	-
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-28.57%	0.0700	0.0500	0.0000	-28.57%	-
MultiSource/Benchmarks/McCat/08-main/main	-25.00%	0.0400	0.0300	0.0000	-25.00%	-
SingleSource/Benchmarks/Shootout-C++/strcat	-22.22%	0.0900	0.0700	0.0050	-12.50%	-
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	-14.29%	0.0700	0.0600	0.0000	-14.29%	-
MultiSource/Benchmarks/Olden/health/health	-10.34%	0.2900	0.2600	0.0000	-10.34%	-
MultiSource/Benchmarks/Olden/perimeter/perimeter	-8.33%	0.2400	0.2200	0.0050	-4.35%	-
SingleSource/Benchmarks/Misc-C++/Large/ray	-6.77%	3.2500	3.0300	0.0150	-5.90%	-
SingleSource/Benchmarks/Shootout-C++/methcall	-5.42%	4.9800	4.7100	0.0100	-5.80%	-
MultiSource/Benchmarks/Ptrdist/ft/ft	-4.76%	0.8400	0.8000	0.0100	-2.44%	-
MultiSource/Benchmarks/Prolangs-C++/life/life	-3.54%	1.1300	1.0900	0.0050	-4.39%	-
SingleSource/Benchmarks/Misc/salsa20	-1.52%	7.8700	7.7500	0.0050	-1.65%	-
SingleSource/Benchmarks/Misc-C++-EH/spirit	-1.47%	4.0900	4.0300	0.0150	-2.18%	-
MultiSource/Applications/SIBsim4/SIBsim4	-1.08%	3.7000	3.6600	0.0150	-1.88%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ
SingleSource/Benchmarks/Misc/fp-convert	200.00%	0.0100	0.0300	-	0.00%	0.0100
SingleSource/Benchmarks/Stanford/Quicksort	200.00%	0.0100	0.0300	-	-25.00%	0.0150
SingleSource/Regression/C/2003-05-21-UnionBitfields	200.00%	0.0100	0.0300	-	50.00%	0.0050
MultiSource/Benchmarks/Prolangs-C++/primes/primes	100.00%	0.0100	0.0200	-	100.00%	0.0000
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc	100.00%	0.0100	0.0200	-	0.00%	0.0050
MultiSource/Benchmarks/llubenchmark/llu	100.00%	0.0200	0.0400	-	33.33%	0.0050
SingleSource/Benchmarks/BenchmarkGame/partialsums	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/Benchmarks/Misc-C++/mandel-text	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/Benchmarks/Shootout/hash	100.00%	0.0200	0.0400	-	0.00%	0.0100
SingleSource/Benchmarks/Stanford/Towers	100.00%	0.0200	0.0400	-	100.00%	0.0000
SingleSource/Benchmarks/Stanford/Treesort	100.00%	0.0200	0.0400	-	33.33%	0.0050
SingleSource/Regression/C++/EH/ctor_dtor_count	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/Regression/C++/EH/simple_throw	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/Regression/C++/fixups	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/2002-05-02-ManyArguments	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2002-08-02-CastTest	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2002-10-09-ArrayResolution	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2002-10-12-StructureArgsSimple	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2002-12-13-MishaTest	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/2003-05-12-MinIntProblem	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2003-05-14-AtExit	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/2003-10-29-ScalarReplBug	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/2005-05-13-SDivTwo	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/2005-07-17-INT-To-FP	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/2006-12-01-float_varg	100.00%	0.0100	0.0200	-	0.00%	0.0050
SingleSource/UnitTests/DefaultInitDynArrays	100.00%	0.0100	0.0200	-	100.00%	0.0000
SingleSource/UnitTests/ms_struct_pack_layout	100.00%	0.0100	0.0200	-	0.00%	0.0050
MultiSource/Applications/aha/aha	80.00%	0.0500	0.0900	-	12.50%	0.0150
MultiSource/Benchmarks/Olden/mst/mst	66.67%	0.0600	0.1000	-	42.86%	0.0050
SingleSource/Benchmarks/Dhrystone/fldry	66.67%	0.0300	0.0500	-	25.00%	0.0050
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	66.67%	0.0900	0.1500	-	25.00%	0.0150
MultiSource/Applications/viterbi/viterbi	45.45%	0.1100	0.1600	-	23.08%	0.0100
MultiSource/Benchmarks/Ptrdist/ft/ft	40.00%	0.1000	0.1400	-	-12.50%	0.0300
SingleSource/Benchmarks/Shootout/matrix	40.00%	0.0500	0.0700	-	0.00%	0.0100
MultiSource/Benchmarks/Prolangs-C/allroots/allroots	33.33%	0.0300	0.0400	-	-42.86%	0.0200
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput	33.33%	0.0300	0.0400	-	0.00%	0.0050
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio	33.33%	0.0300	0.0400	-	0.00%	0.0050
SingleSource/Benchmarks/Stanford/Queens	33.33%	0.0300	0.0400	-	0.00%	0.0050
SingleSource/Benchmarks/Stanford/RealMM	33.33%	0.0300	0.0400	-	33.33%	0.0000
SingleSource/Regression/C/uint64_to_float	33.33%	0.0300	0.0400	-	0.00%	0.0050
SingleSource/UnitTests/Vector/SSE/sse_shift	33.33%	0.0300	0.0400	-	33.33%	0.0000
MultiSource/Benchmarks/BitBench/drop3/drop3	25.00%	0.0400	0.0500	-	0.00%	0.0050
MultiSource/Benchmarks/Fhourstones/fhourstones	25.00%	0.0800	0.1000	-	42.86%	0.0050
MultiSource/Benchmarks/Olden/power/power	25.00%	0.0800	0.1000	-	0.00%	0.0100
MultiSource/Benchmarks/Prolangs-C++/garage/garage	25.00%	0.0400	0.0500	-	66.67%	0.0050
SingleSource/Benchmarks/Stanford/Oscar	25.00%	0.0400	0.0500	-	25.00%	0.0000
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	23.53%	0.1700	0.2100	-	-22.22%	0.0500
MultiSource/Benchmarks/McCat/04-bisect/bisect	22.22%	0.0900	0.1100	-	10.00%	0.0050
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	21.43%	0.1400	0.1700	-	-15.00%	0.0300
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	21.43%	0.1400	0.1700	-	-15.00%	0.0300
MultiSource/Benchmarks/McCat/08-main/main	21.05%	0.1900	0.2300	-	4.55%	0.0150
SingleSource/Benchmarks/Misc/oourafft	18.75%	0.1600	0.1900	-	11.76%	0.0050
MultiSource/Benchmarks/McCat/09-vor/vor	17.39%	0.2300	0.2700	-	3.85%	0.0150
MultiSource/Benchmarks/McCat/03-testtrie/testtrie	16.67%	0.0600	0.0700	-	0.00%	0.0050
MultiSource/Benchmarks/Prolangs-C++/objects/objects	16.67%	0.0600	0.0700	-	16.67%	0.0000
MultiSource/Benchmarks/Prolangs-C++/trees/trees	16.67%	0.0600	0.0700	-	16.67%	0.0000
SingleSource/Benchmarks/Misc/whetstone	16.67%	0.0600	0.0700	-	0.00%	0.0050
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish	15.00%	0.2000	0.2300	-	21.05%	0.0050
MultiSource/Benchmarks/Olden/bh/bh	13.64%	0.2200	0.2500	-	8.70%	0.0050
MultiSource/Benchmarks/mediabench/gsm/toast/toast	12.37%	0.9700	1.0900	-	9.00%	0.0150
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	11.11%	0.1800	0.2000	-	11.11%	0.0000
SingleSource/UnitTests/Vector/SSE/sse_expandfft	11.11%	0.0900	0.1000	-	25.00%	0.0050
MultiSource/Applications/hbd/hbd	10.19%	1.0800	1.1900	-	6.25%	0.0200
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	10.00%	0.4000	0.4400	-	29.41%	0.0300
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes	9.09%	0.2200	0.2400	-	9.09%	0.0000
MultiSource/Benchmarks/VersaBench/bmm/bmm	9.09%	0.2200	0.2400	-	9.09%	0.0000
MultiSource/Applications/lambda-0_1_3/lambda	8.51%	0.4700	0.5100	-	4.08%	0.0100
MultiSource/Benchmarks/FreeBench/neural/neural	8.33%	0.1200	0.1300	-	0.00%	0.0050
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des	8.00%	0.2500	0.2700	-	3.85%	0.0050
SingleSource/Benchmarks/Misc/himenobmtxpa	7.69%	0.1300	0.1400	-	7.69%	0.0000
MultiSource/Benchmarks/McCat/18-imp/imp	7.14%	0.2800	0.3000	-	15.38%	0.0100
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk	6.67%	0.1500	0.1600	-	128.57%	0.0400
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	6.67%	0.1500	0.1600	-	6.67%	0.0000
SingleSource/Regression/C++/ofstream_ctor	6.25%	0.1600	0.1700	-	0.00%	0.0050
MultiSource/Benchmarks/nbench/nbench	5.95%	0.8400	0.8900	-	3.49%	0.0100
SingleSource/Benchmarks/Shootout-C++/heapsort	5.56%	0.1800	0.1900	-	18.75%	0.0100
SingleSource/Benchmarks/Shootout-C++/strcat	5.56%	0.1800	0.1900	-	18.75%	0.0100
MultiSource/Applications/spiff/spiff	5.26%	0.5700	0.6000	-	-10.45%	0.0500
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	5.26%	3.4200	3.6000	-	1.41%	0.0650
SingleSource/Benchmarks/Shootout-C++/except	5.26%	0.1900	0.2000	-	11.11%	0.0050
MultiSource/Applications/hexxagon/hexxagon	5.13%	0.7800	0.8200	-	-3.53%	0.0350
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg	5.06%	3.5600	3.7400	-	8.09%	0.0500

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ
MultiSource/Applications/kimwitu++/kc	400.00%	0.0100	0.0500	-	150.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/ary2	66.67%	0.0300	0.0500	-	66.67%	0.0000
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	33.33%	0.0300	0.0400	-	33.33%	0.0000
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	30.56%	0.7200	0.9400	-	28.77%	0.0050
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	22.22%	0.0900	0.1100	-	0.00%	0.0100
SingleSource/Benchmarks/Shootout-C++/hash2	21.26%	2.5400	3.0800	-	21.74%	0.0050
SingleSource/Benchmarks/Adobe-C++/loop_unroll	20.86%	1.3900	1.6800	-	22.63%	0.0100
MultiSource/Benchmarks/McCat/18-imp/imp	16.67%	0.0600	0.0700	-	0.00%	0.0050
MultiSource/Benchmarks/nbench/nbench	13.65%	16.9200	19.2300	-	16.12%	0.1800
SingleSource/Benchmarks/Stanford/Puzzle	7.69%	0.1300	0.1400	-	7.69%	0.0000
SingleSource/UnitTests/Vector/SSE/sse_stepfft	7.50%	0.4000	0.4300	-	7.50%	0.0000
SingleSource/Benchmarks/BenchmarkGame/Large/fasta	7.06%	0.8500	0.9100	-	2.25%	0.0200
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	6.67%	0.3000	0.3200	-	10.34%	0.0050
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset	6.25%	0.1600	0.1700	-	0.00%	0.0050
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	5.80%	0.6900	0.7300	-	1.39%	0.0150
MultiSource/Benchmarks/FreeBench/mason/mason	5.26%	0.1900	0.2000	-	5.26%	0.0000
SingleSource/Benchmarks/Shootout-C++/lists1	5.26%	0.1900	0.2000	-	-4.76%	0.0100

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ
SingleSource/Benchmarks/Shootout/sieve	-100.00%	0.0200	0.0000	-	-100.00%	0.0050
SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn	-100.00%	0.0200	0.0000	-	-100.00%	0.0050
SingleSource/Regression/C++/EH/ConditionalExpr	-100.00%	0.0200	0.0000	-	-100.00%	0.0000
SingleSource/Regression/C++/EH/throw_rethrow_test	-100.00%	0.0100	0.0000	-	-100.00%	0.0050
SingleSource/Regression/C/2003-05-21-BitfieldHandling	-100.00%	0.0200	0.0000	-	-100.00%	0.0000
SingleSource/Regression/C/2003-06-16-InvalidInitializer	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/Regression/C/2003-06-16-VolatileError	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers	-100.00%	0.0100	0.0000	-	-100.00%	0.0050
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas	-100.00%	0.0200	0.0000	-	-100.00%	0.0000
SingleSource/Regression/C/2008-01-07-LongDouble	-100.00%	0.0200	0.0000	-	0.00%	0.0100
SingleSource/Regression/C/PR1386	-100.00%	0.0200	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2002-04-17-PrintfChar	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2002-05-02-CastTest1	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2003-05-31-CastToBool	-100.00%	0.0200	0.0000	-	-100.00%	0.0050
SingleSource/UnitTests/2003-07-10-SignConversions	-100.00%	0.0200	0.0000	-	-100.00%	0.0050
SingleSource/UnitTests/2003-09-18-BitFieldTest	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2004-02-02-NegativeZero	-100.00%	0.0100	0.0000	-	0.00%	0.0050
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall	-100.00%	0.0200	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2009-12-07-StructReturn	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/2010-05-24-BitfieldTest	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/Vector/sumarray-dbl	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/block-byref-test	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/block-copied-in-cxxobj	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/UnitTests/stmtexpr	-100.00%	0.0200	0.0000	-	-100.00%	0.0050
MultiSource/Benchmarks/BitBench/uuencode/uuencode	-80.00%	0.0500	0.0100	-	-75.00%	0.0050
SingleSource/Regression/C/PR640	-66.67%	0.0300	0.0100	-	-66.67%	0.0000
SingleSource/UnitTests/SignlessTypes/factor	-66.67%	0.0300	0.0100	-	-66.67%	0.0000
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	-50.00%	0.0400	0.0200	-	-50.00%	0.0000
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm	-50.00%	0.0400	0.0200	-	-33.33%	0.0050
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Benchmarks/Dhrystone/dry	-50.00%	0.0400	0.0200	-	-50.00%	0.0000
SingleSource/Benchmarks/Misc/pi	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Regression/C++/EH/dead_try_block	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Regression/C++/pointer_member	-50.00%	0.0200	0.0100	-	0.00%	0.0050
SingleSource/Regression/C/2003-05-22-LocalTypeTest	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Regression/C/2004-02-03-AggregateCopy	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Regression/C/2004-03-15-IndirectGoto	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/Regression/C/PR491	-50.00%	0.0200	0.0100	-	0.00%	0.0050
SingleSource/Regression/C/test_indvars	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/2002-05-19-DivTest	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/2003-04-22-Switch	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/2003-08-20-FoldBug	-50.00%	0.0200	0.0100	-	0.00%	0.0050
SingleSource/UnitTests/2003-10-13-SwitchTest	-50.00%	0.0200	0.0100	-	0.00%	0.0100
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/2005-05-12-Int64ToFP	-50.00%	0.0200	0.0100	-	0.00%	0.0100
SingleSource/UnitTests/2006-02-04-DivRem	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/2007-01-04-KNR-Args	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/AtomicOps	-50.00%	0.0200	0.0100	-	0.00%	0.0050
SingleSource/UnitTests/FloatPrecision	-50.00%	0.0200	0.0100	-	0.00%	0.0050
SingleSource/UnitTests/TestLoop	-50.00%	0.0200	0.0100	-	0.00%	0.0100
SingleSource/UnitTests/Vector/divides	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
SingleSource/UnitTests/Vector/sumarray	-50.00%	0.0200	0.0100	-	0.00%	0.0050
MultiSource/Benchmarks/BitBench/five11/five11	-40.00%	0.0500	0.0300	-	-40.00%	0.0000
MultiSource/Benchmarks/VersaBench/8b10b/8b10b	-33.33%	0.0600	0.0400	-	-20.00%	0.0050
SingleSource/Benchmarks/BenchmarkGame/spectral-norm	-33.33%	0.0600	0.0400	-	-20.00%	0.0050
SingleSource/Benchmarks/CoyoteBench/lpbench	-30.00%	0.1000	0.0700	-	-12.50%	0.0100
MultiSource/Benchmarks/FreeBench/mason/mason	-28.57%	0.0700	0.0500	-	0.00%	0.0100
SingleSource/Benchmarks/Misc/ffbench	-28.57%	0.0700	0.0500	-	-16.67%	0.0050
MultiSource/Benchmarks/Olden/treeadd/treeadd	-25.00%	0.0400	0.0300	-	-25.00%	0.0000
SingleSource/Benchmarks/BenchmarkGame/puzzle	-25.00%	0.0400	0.0300	-	0.00%	0.0050
SingleSource/Benchmarks/Misc/dt	-25.00%	0.0400	0.0300	-	50.00%	0.0100
SingleSource/Benchmarks/Misc/salsa20	-25.00%	0.0400	0.0300	-	0.00%	0.0050
SingleSource/Benchmarks/Stanford/FloatMM	-25.00%	0.0400	0.0300	-	0.00%	0.0050
SingleSource/Regression/C/bigstack	-25.00%	0.0400	0.0300	-	50.00%	0.0100
SingleSource/UnitTests/Vector/SSE/sse_isamax	-25.00%	0.0800	0.0600	-	-14.29%	0.0050
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url	-22.22%	0.1800	0.1400	-	-22.22%	0.0000
SingleSource/Benchmarks/CoyoteBench/huffbench	-22.22%	0.0900	0.0700	-	-12.50%	0.0050
MultiSource/Benchmarks/Olden/perimeter/perimeter	-20.00%	0.0500	0.0400	-	-42.86%	0.0100
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	-20.00%	0.4500	0.3600	-	-23.40%	0.0100
SingleSource/Benchmarks/CoyoteBench/almabench	-20.00%	0.0500	0.0400	-	-20.00%	0.0000
SingleSource/UnitTests/SignlessTypes/Large/cast	-20.00%	0.0500	0.0400	-	-20.00%	0.0000
MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-14.29%	0.0700	0.0600	-	-14.29%	0.0000
MultiSource/Benchmarks/McCat/12-IOtest/iotest	-14.29%	0.0700	0.0600	-	50.00%	0.0150
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1	-14.29%	0.0700	0.0600	-	0.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/ary2	-13.04%	0.2300	0.2000	-	5.26%	0.0200
SingleSource/Benchmarks/Shootout-C++/methcall	-10.53%	0.1900	0.1700	-	-10.53%	0.0000
MultiSource/Benchmarks/McCat/05-eks/eks	-10.00%	0.4000	0.3600	-	-10.00%	0.0000
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-10.00%	0.1000	0.0900	-	12.50%	0.0100
SingleSource/UnitTests/SignlessTypes/rem	-10.00%	0.1000	0.0900	-	0.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/wc	-9.52%	0.2100	0.1900	-	-5.00%	0.0050
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-9.45%	1.2700	1.1500	-	4.55%	0.0850
MultiSource/Benchmarks/Prolangs-C/assembler/assembler	-8.16%	0.4900	0.4500	-	-8.16%	0.0000
SingleSource/Benchmarks/McGill/chomp	-7.69%	0.1300	0.1200	-	-14.29%	0.0050
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	-7.69%	0.1300	0.1200	-	-14.29%	0.0050
SingleSource/Benchmarks/Shootout-C++/wordfreq	-7.69%	0.2600	0.2400	-	-4.00%	0.0050
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk	-7.32%	0.4100	0.3800	-	-5.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/hello	-6.25%	0.1600	0.1500	-	-16.67%	0.0100
MultiSource/Benchmarks/Prolangs-C/football/football	-6.06%	0.6600	0.6200	-	-1.59%	0.0150
MultiSource/Applications/obsequi/Obsequi	-5.75%	0.8700	0.8200	-	-9.89%	0.0200
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-5.71%	0.7000	0.6600	-	-2.94%	0.0100
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction	-5.00%	0.4000	0.3800	-	-2.56%	0.0050

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-100.00%	0.0100	0.0000	-	-100.00%	0.0000
SingleSource/Benchmarks/Shootout-C++/ary	-66.67%	0.0300	0.0100	-	-50.00%	0.0050
MultiSource/Benchmarks/MiBench/security-sha/security-sha	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-50.00%	0.0200	0.0100	-	-50.00%	0.0000
MultiSource/Applications/JM/ldecod/ldecod	-28.57%	0.0700	0.0500	-	25.00%	0.0150
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-28.57%	0.0700	0.0500	-	-28.57%	0.0000
MultiSource/Benchmarks/McCat/08-main/main	-25.00%	0.0400	0.0300	-	-25.00%	0.0000
MultiSource/Benchmarks/Olden/treeadd/treeadd	-23.81%	0.2100	0.1600	-	-5.88%	0.0200
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	-14.29%	0.0700	0.0600	-	-14.29%	0.0000
MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-14.29%	0.0700	0.0600	-	20.00%	0.0100
MultiSource/Benchmarks/Olden/health/health	-10.34%	0.2900	0.2600	-	-10.34%	0.0000
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	-9.52%	0.2100	0.1900	-	-5.00%	0.0050
SingleSource/Benchmarks/Shootout/strcat	-7.69%	0.1300	0.1200	-	-20.00%	0.0100
SingleSource/Benchmarks/Misc-C++/Large/ray	-5.90%	3.2200	3.0300	-	-6.77%	0.0150
SingleSource/Benchmarks/Shootout-C++/methcall	-5.80%	5.0000	4.7100	-	-5.42%	0.0100

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.33s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153924	2012-04-03 02:57:21	0:14:28
Previous	153923	2012-04-03 02:32:17	0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	95
Performance Improvements	18	97
Existing Failures	8	8
Unchanged Tests	859	688
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	15.38%	0.1300	0.1500	0.0069	15.38%	-
SingleSource/Benchmarks/Shootout-C++/objinst	11.11%	0.1800	0.2000	0.0069	17.65%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/richards_benchmark

1.22%

0.8200

0.8300

0.0000

1.22%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/NP/np	-100.00%	0.0200	0.0000	0.0037	-100.00%	-
SingleSource/Benchmarks/Shootout/ary3	-100.00%	0.0300	0.0000	0.0058	-100.00%	-
SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-100.00%

0.0200

0.0000

0.0000

-100.00%

-

SingleSource/Regression/C++/global_ctor	-100.00%	0.0200	0.0000	0.0047	-100.00%	-
SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

0.0000

-100.00%

-

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0200

0.0000

0.0050

-100.00%

-

SingleSource/UnitTests/Threads/tls	-100.00%	0.0100	0.0000	0.0037	-100.00%	-
SingleSource/UnitTests/conditional-gnu-ext-cxx	-100.00%	0.0100	0.0000	0.0037	-100.00%	-
SingleSource/Benchmarks/BenchmarkGame/puzzle	-75.00%	0.0400	0.0100	0.0069	-75.00%	-
SingleSource/Benchmarks/Shootout/methcall	-66.67%	0.0300	0.0100	0.0047	-66.67%	-
SingleSource/Benchmarks/Shootout/nestedloop	-66.67%	0.0300	0.0100	0.0047	-50.00%	-
SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

0.0000

-50.00%

-

SingleSource/UnitTests/SignlessTypes/div	-50.00%	0.0200	0.0100	0.0037	-66.67%	-
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	-30.00%	0.1000	0.0700	0.0069	-22.22%	-
MultiSource/Applications/SIBsim4/SIBsim4	-4.72%	1.0600	1.0100	0.0115	-3.81%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-50.00%	0.0600	0.0300	0.0075	-57.14%	-
MultiSource/Applications/oggenc/oggenc	-7.69%	0.1300	0.1200	0.0037	-7.69%	-
SingleSource/Benchmarks/Shootout/methcall	-1.55%	3.8700	3.8100	0.0107	-1.55%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0058

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

0.00%	0.0090

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%	0.0075
MultiSource/Benchmarks/llubenchmark/llu	150.00%	0.0200	0.0500	-	0.00%	0.0096
SingleSource/Benchmarks/Shootout/hash	150.00%	0.0200	0.0500	-	25.00%	0.0090

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%	0.0050

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

0.00%

0.0076
MultiSource/Benchmarks/Prolangs-C/allroots/allroots	100.00%	0.0300	0.0600	-	0.00%	0.0134
SingleSource/Benchmarks/Misc/fp-convert	100.00%	0.0100	0.0200	-	-33.33%	0.0121

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

0.00%	0.0090

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

100.00%	0.0050

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0037

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0090
SingleSource/Regression/C/DuffsDevice	100.00%	0.0100	0.0200	-	-33.33%	0.0075
SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%

0.0047

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%

0.0037

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%	0.0047

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%	0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0047

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0047

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

100.00%

0.0047

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%	0.0075

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0047

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

0.00%

0.0069

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0047

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

100.00%	0.0047
SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0050

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

0.00%	0.0150

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

25.00%

0.0058
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	52.94%	0.1700	0.2600	-	-7.14%	0.0427
MultiSource/Benchmarks/Fhourstones/fhourstones	37.50%	0.0800	0.1100	-	-8.33%	0.0157
MultiSource/Benchmarks/Olden/power/power	37.50%	0.0800	0.1100	-	10.00%	0.0094
MultiSource/Benchmarks/BitBench/uudecode/uudecode	33.33%	0.0300	0.0400	-	-20.00%	0.0076
MultiSource/Benchmarks/Prolangs-C++/objects/objects	33.33%	0.0600	0.0800	-	0.00%	0.0075

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

0.00%

0.0094

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

33.33%	0.0047
SingleSource/Benchmarks/McGill/queens	33.33%	0.0300	0.0400	-	-20.00%	0.0096
SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%

0.0069
SingleSource/Benchmarks/Shootout/random	33.33%	0.0300	0.0400	-	100.00%	0.0069
SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0047

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%	0.0050

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

33.33%

0.0047

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

33.33%

0.0069
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	33.33%	0.0900	0.1200	-	9.09%	0.0183
MultiSource/Benchmarks/Ptrdist/ft/ft	30.00%	0.1000	0.1300	-	-18.75%	0.0203
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk	28.57%	0.0700	0.0900	-	12.50%	0.0069
MultiSource/Benchmarks/MiBench/security-sha/security-sha	28.57%	0.0700	0.0900	-	12.50%	0.0096
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	28.57%	0.1400	0.1800	-	-5.26%	0.0195

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

25.00%

0.0050

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

-15.00%

0.0236
SingleSource/Regression/C++/ofstream_ctor	18.75%	0.1600	0.1900	-	5.56%	0.0075
SingleSource/Benchmarks/Shootout-C++/objinst	17.65%	0.1700	0.2000	-	11.11%	0.0069

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%	0.0047
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	16.67%	0.1800	0.2100	-	10.53%	0.0096
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	15.38%	0.1300	0.1500	-	15.38%	0.0069

MultiSource/Benchmarks/Olden/bh/bh

13.64%

0.2200

0.2500

-

8.70%

0.0107
SingleSource/Benchmarks/Shootout-C++/lists1	12.00%	0.2500	0.2800	-	0.00%	0.0111
MultiSource/Benchmarks/Prolangs-C++/office/office	11.76%	0.1700	0.1900	-	0.00%	0.0094
MultiSource/Applications/hexxagon/hexxagon	11.54%	0.7800	0.8700	-	3.57%	0.0261
MultiSource/Benchmarks/Olden/health/health	11.11%	0.0900	0.1000	-	-9.09%	0.0121
SingleSource/Benchmarks/Shootout-C++/sumcol	11.11%	0.1800	0.2000	-	0.00%	0.0111

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

25.00%

0.0082
MultiSource/Applications/spiff/spiff	8.77%	0.5700	0.6200	-	5.08%	0.0345

MultiSource/Applications/lambda-0_1_3/lambda

8.51%

0.4700

0.5100

-

-1.92%	0.0257
MultiSource/Applications/Burg/burg	8.33%	0.8400	0.9100	-	8.33%	0.0261

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

8.33%	0.0069
MultiSource/Applications/sgefa/sgefa	8.00%	0.2500	0.2700	-	22.73%	0.0125

MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des

8.00%

0.2500

0.2700

-

3.85%

0.0069

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

27.27%	0.0100

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

6.67%

0.1500

0.1600

-

33.33%	0.0299

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-5.88%	0.0107
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	6.43%	3.4200	3.6400	-	2.25%	0.0657
MultiSource/Benchmarks/Prolangs-C/agrep/agrep	6.32%	0.9500	1.0100	-	5.21%	0.0249
SingleSource/Benchmarks/Shootout-C++/spellcheck	6.25%	0.3200	0.3400	-	9.68%	0.0138
MultiSource/Benchmarks/mediabench/gsm/toast/toast	6.19%	0.9700	1.0300	-	-7.21%	0.0520

MultiSource/Benchmarks/nbench/nbench

5.95%

0.8400

0.8900

-

4.71%	0.0195
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	5.56%	0.1800	0.1900	-	-5.00%	0.0094
SingleSource/Benchmarks/Adobe-C++/functionobjects	5.56%	0.3600	0.3800	-	8.57%	0.0090
MultiSource/Benchmarks/McCat/08-main/main	5.26%	0.1900	0.2000	-	25.00%	0.0236

SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

11.11%

0.0069

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc	300.00%	0.0100	0.0400	-	33.33%	0.0137
MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/Benchmarks/Stanford/Treesort	40.00%	0.0500	0.0700	-	40.00%	0.0082

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/ary2	33.33%	0.0300	0.0400	-	100.00%	0.0090

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

1.08%	0.1030

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%	0.1404

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

16.67%	0.0050
SingleSource/Benchmarks/Shootout-C++/lists1	15.79%	0.1900	0.2200	-	10.00%	0.0096
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	11.11%	0.0900	0.1000	-	0.00%	0.0069

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

2.38%	0.0134

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

0.00%

0.0090
SingleSource/Benchmarks/Shootout-C++/hash2	5.51%	2.5400	2.6800	-	3.08%	0.1883

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/NP/np

-100.00%

0.0200

0.0000

-

-100.00%

0.0037

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Benchmarks/Shootout/ary3

-100.00%

0.0200

0.0000

-

-100.00%

0.0058

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%

0.0037

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-100.00%

0.0200

0.0000

-

-100.00%

0.0000

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C++/global_ctor

-100.00%

0.0200

0.0000

-

-100.00%

0.0047

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0037

SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

0.00%

0.0075

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/globalrefs

-100.00%

0.0200

0.0000

-

0.00%

0.0075

SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

0.00%

0.0037

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

-100.00%

0.0000

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

0.00%

0.0069

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%	0.0047
SingleSource/UnitTests/2005-05-12-Int64ToFP

-100.00%

0.0200

0.0000

-

-100.00%

0.0069

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

0.00%

0.0037

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%

0.0047

SingleSource/UnitTests/Threads/tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0037

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%

0.0037

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0037
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio	-75.00%	0.0400	0.0100	-	-75.00%	0.0090
SingleSource/Benchmarks/BenchmarkGame/puzzle	-75.00%	0.0400	0.0100	-	-75.00%	0.0069
SingleSource/Benchmarks/Shootout/methcall

-66.67%

0.0300

0.0100

-

-66.67%

0.0047

SingleSource/Regression/C/PR640

-66.67%

0.0300

0.0100

-

-66.67%

0.0075

SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-50.00%

0.0037

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-50.00%

0.0400

0.0200

-

-50.00%	0.0090
MultiSource/Benchmarks/Olden/treeadd/treeadd	-50.00%	0.0400	0.0200	-	100.00%	0.0107
SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-50.00%

0.0047
SingleSource/Benchmarks/Shootout/nestedloop	-50.00%	0.0200	0.0100	-	-66.67%	0.0047
SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

0.00%

0.0047

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

-50.00%

0.0047

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%

0.0069

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

-50.00%

0.0000

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

0.00%	0.0075
SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0076

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0037

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0037

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0082

SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-50.00%

0.0200

0.0100

-

0.00%	0.0047
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0076

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

0.00%	0.0047
SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0047

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%

0.0069

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0037

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

-40.00%

0.0137

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%

0.0090

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-16.67%

0.0195

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-25.00%

0.0050

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%

0.0090

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%

0.0075

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

-25.00%	0.0075

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%	0.0076
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	-22.22%	0.0900	0.0700	-	-30.00%	0.0069
MultiSource/Benchmarks/Olden/bisort/bisort	-20.00%	0.0500	0.0400	-	-33.33%	0.0082

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-20.00%	0.0107
SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

-20.00%

0.0075

SingleSource/Benchmarks/Shootout/matrix

-20.00%

0.0500

0.0400

-

-20.00%

0.0090

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

0.00%	0.0094
MultiSource/Benchmarks/Ptrdist/anagram/anagram	-14.29%	0.0700	0.0600	-	-25.00%	0.0075
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk	-12.20%	0.4100	0.3600	-	-5.26%	0.0177
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-11.43%	0.7000	0.6200	-	-19.48%	0.0423
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

0.00%

0.0137

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

0.00%	0.0111
SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%

0.0096

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

12.50%	0.0082
SingleSource/Benchmarks/Shootout-C++/matrix	-9.52%	0.2100	0.1900	-	-9.52%	0.0069
MultiSource/Benchmarks/Prolangs-C/loader/loader	-8.70%	0.2300	0.2100	-	-19.23%	0.0149
SingleSource/Benchmarks/Shootout-C++/lists	-8.70%	0.2300	0.2100	-	-4.55%	0.0096
MultiSource/Benchmarks/Olden/em3d/em3d	-7.69%	0.1300	0.1200	-	0.00%	0.0069
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-7.69%

0.2600

0.2400

-

-4.00%

0.0058
MultiSource/Benchmarks/McCat/05-eks/eks	-7.50%	0.4000	0.3700	-	2.78%	0.0197
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail	-6.82%	0.4400	0.4100	-	0.00%	0.0163
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-5.45%	0.5500	0.5200	-	-1.89%	0.0137
MultiSource/Benchmarks/Olden/voronoi/voronoi	-5.00%	0.2000	0.1900	-	0.00%	0.0125

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/Benchmarks/Shootout-C++/ary

-66.67%

0.0300

0.0100

-

-66.67%	0.0096
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-57.14%	0.0700	0.0300	-	-50.00%	0.0075

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

-28.57%	0.0134
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%

0.0037
MultiSource/Benchmarks/Olden/mst/mst	-25.00%	0.0800	0.0600	-	-25.00%	0.0134
MultiSource/Benchmarks/Olden/perimeter/perimeter	-17.39%	0.2300	0.1900	-	-13.64%	0.0129
SingleSource/Benchmarks/Misc-C++/bigfib	-14.71%	0.3400	0.2900	-	3.57%	0.0222
MultiSource/Benchmarks/Olden/treeadd/treeadd	-14.29%	0.2100	0.1800	-	0.00%	0.0171

MultiSource/Benchmarks/Olden/health/health

-10.34%

0.2900

0.2600

-

-3.70%	0.0149
MultiSource/Applications/oggenc/oggenc	-7.69%	0.1300	0.1200	-	-7.69%	0.0037
SingleSource/Benchmarks/Shootout-C++/nestedloop	-6.25%	0.1600	0.1500	-	-6.25%	0.0050
SingleSource/Benchmarks/Misc-C++/Large/ray	-6.21%	3.2200	3.0200	-	-0.33%	0.0937

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.00%

0.1544

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.35s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153926	2012-04-03 03:22:13	0:14:27
Previous

153924

2012-04-03 02:57:21

0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	7	96
Performance Improvements	14	106
Existing Failures	8	8
Unchanged Tests	859	678
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/flops-7	100.00%	0.0200	0.0400	0.0049	33.33%	-
MultiSource/Benchmarks/McCat/03-testtrie/testtrie	50.00%	0.0600	0.0900	0.0064	50.00%	-
SingleSource/Benchmarks/Shootout/lists	40.00%	0.0500	0.0700	0.0049	16.67%	-
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	12.50%	0.2400	0.2700	0.0064	3.85%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

0.0000

25.00%

-

SingleSource/Benchmarks/Shootout/matrix	1.09%	2.7500	2.7800	0.0070	1.09%	-
SingleSource/Benchmarks/Misc/mandel	1.01%	0.9900	1.0000	0.0000	1.01%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/pi	-100.00%	0.0200	0.0000	0.0049	-100.00%	-
SingleSource/Regression/C/2003-05-22-LocalTypeTest	-100.00%	0.0200	0.0000	0.0035	-100.00%	-
SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

0.0000

-100.00%

-

SingleSource/UnitTests/printargs	-100.00%	0.0200	0.0000	0.0049	-100.00%	-
SingleSource/UnitTests/initp1	-75.00%	0.0400	0.0100	0.0070	-66.67%	-
SingleSource/Benchmarks/Stanford/FloatMM	-50.00%	0.0400	0.0200	0.0045	-50.00%	-
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-22.03%	0.5900	0.4600	0.0192	-20.69%	-
SingleSource/Benchmarks/Shootout-C++/nestedloop	-16.67%	0.1800	0.1500	0.0045	-11.76%	-
MultiSource/Benchmarks/Olden/em3d/em3d	-16.67%	0.1200	0.1000	0.0076	-23.08%	-
MultiSource/Benchmarks/FreeBench/neural/neural	-15.38%	0.1300	0.1100	0.0064	-8.33%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/09-vor/vor	-18.18%	0.1100	0.0900	0.0049	-18.18%	-
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	-7.14%	0.1400	0.1300	0.0035	-7.14%	-
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4	-2.63%	0.3800	0.3700	0.0035	-2.63%	-
SingleSource/UnitTests/Vector/multiplies	-1.06%	1.8800	1.8600	0.0045	-0.53%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

33.33%

0.0083

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

0.00%	0.0064

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0073

SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

50.00%

0.0070

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%

0.0103
MultiSource/Benchmarks/Prolangs-C/allroots/allroots	133.33%	0.0300	0.0700	-	16.67%	0.0128

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

-20.00%	0.0093

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0073

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0035

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0088

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

100.00%

0.0045

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%

0.0070

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0045

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0045

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%	0.0073
SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

100.00%

0.0073

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0049

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

25.00%

0.0088

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

0.00%	0.0064
MultiSource/Benchmarks/McCat/03-testtrie/testtrie	50.00%	0.0600	0.0900	-	50.00%	0.0064
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	50.00%	0.0600	0.0900	-	50.00%	0.0129
MultiSource/Benchmarks/Olden/mst/mst	50.00%	0.0600	0.0900	-	50.00%	0.0164
MultiSource/Benchmarks/Ptrdist/ft/ft	50.00%	0.1000	0.1500	-	15.38%	0.0193
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	41.18%	0.1700	0.2400	-	-7.69%	0.0398
MultiSource/Applications/aha/aha	40.00%	0.0500	0.0700	-	-22.22%	0.0148
MultiSource/Benchmarks/Olden/perimeter/perimeter	40.00%	0.0500	0.0700	-	75.00%	0.0107

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%	0.0073

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

0.00%	0.0045

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%	0.0090
SingleSource/Benchmarks/Misc/flops-7

33.33%

0.0300

0.0400

-

100.00%

0.0049

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0049

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0049

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%	0.0049

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%	0.0049

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

0.00%	0.0076

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

0.00%	0.0181

MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

-9.09%	0.0159
MultiSource/Benchmarks/McCat/15-trie/trie

25.00%

0.0400

0.0500

-

25.00%

0.0035
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm	25.00%	0.0400	0.0500	-	150.00%	0.0093

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

-9.09%	0.0105
MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0064

SingleSource/Benchmarks/Dhrystone/dry

25.00%

0.0400

0.0500

-

25.00%

0.0073

SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

25.00%

0.0049

MultiSource/Benchmarks/McCat/04-bisect/bisect

22.22%

0.0900

0.1100

-

22.22%	0.0083
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	22.22%	0.0900	0.1100	-	-8.33%	0.0169

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

0.00%	0.0225
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	20.00%	0.1500	0.1800	-	12.50%	0.0099
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	18.75%	0.1600	0.1900	-	18.75%	0.0139

SingleSource/Regression/C++/ofstream_ctor

18.75%

0.1600

0.1900

-

0.00%	0.0090

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

-12.50%	0.0083
SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

16.67%

0.0064
SingleSource/Benchmarks/Shootout/lists	16.67%	0.0600	0.0700	-	40.00%	0.0049

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

16.67%

0.1800

0.2100

-

0.00%	0.0125
MultiSource/Applications/spiff/spiff	15.79%	0.5700	0.6600	-	6.45%	0.0320
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

13.64%

0.2200

0.2500

-

8.70%

0.0118

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

0.00%

0.0090
SingleSource/Benchmarks/Shootout-C++/objinst	11.76%	0.1700	0.1900	-	-5.00%	0.0099
SingleSource/Benchmarks/Misc-C++/Large/ray	11.54%	0.2600	0.2900	-	7.41%	0.0099
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	11.11%	0.0900	0.1000	-	42.86%	0.0099
SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

11.11%

0.0099
MultiSource/Applications/lambda-0_1_3/lambda	10.64%	0.4700	0.5200	-	1.96%	0.0238
MultiSource/Benchmarks/McCat/08-main/main	10.53%	0.1900	0.2100	-	5.00%	0.0219
MultiSource/Benchmarks/Olden/voronoi/voronoi	10.00%	0.2000	0.2200	-	15.79%	0.0129
SingleSource/Benchmarks/Shootout-C++/ary	10.00%	0.2000	0.2200	-	4.76%	0.0083
MultiSource/Applications/Burg/burg	9.52%	0.8400	0.9200	-	1.10%	0.0282
MultiSource/Benchmarks/Prolangs-C/simulator/simulator	8.93%	0.5600	0.6100	-	7.02%	0.0232
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	7.69%	0.1300	0.1400	-	-6.67%	0.0099

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%	0.0099
MultiSource/Applications/hbd/hbd	7.41%	1.0800	1.1600	-	2.65%	0.0391
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	7.02%	3.4200	3.6600	-	0.55%	0.0682
MultiSource/Applications/hexxagon/hexxagon	6.41%	0.7800	0.8300	-	-4.60%	0.0282
SingleSource/Benchmarks/Misc/oourafft	6.25%	0.1600	0.1700	-	6.25%	0.0099
SingleSource/Benchmarks/Shootout-C++/hello	6.25%	0.1600	0.1700	-	6.25%	0.0099
MultiSource/Benchmarks/mediabench/gsm/toast/toast	5.15%	0.9700	1.0200	-	-0.97%	0.0481

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%

0.0049

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%

0.0049

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%	0.0984
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0000

SingleSource/Benchmarks/Shootout-C++/moments

25.00%

0.0400

0.0500

-

25.00%

0.0053
SingleSource/Benchmarks/Adobe-C++/loop_unroll	20.14%	1.3900	1.6700	-	-0.60%	0.1348

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%	0.0049

SingleSource/Benchmarks/Shootout-C++/lists1

15.79%

0.1900

0.2200

-

0.00%	0.0103
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset	12.50%	0.1600	0.1800	-	5.88%	0.0088
MultiSource/Applications/oggenc/oggenc	7.69%	0.1300	0.1400	-	16.67%	0.0053
SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

7.69%

0.0118

SingleSource/Benchmarks/Stanford/Puzzle

7.69%

0.1300

0.1400

-

7.69%

0.0045

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%	0.0131
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	7.25%	0.6900	0.7400	-	2.78%	0.0259

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/pi

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

0.00%

0.0083

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0035

SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

0.00%

0.0045

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0045

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

0.00%	0.0035
SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0070

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0035

SingleSource/UnitTests/2003-05-02-DependentPHI

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2003-08-20-FoldBug

-100.00%

0.0200

0.0000

-

-100.00%

0.0070

SingleSource/UnitTests/2003-09-18-BitFieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0045

SingleSource/UnitTests/2003-10-13-SwitchTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0076

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%

0.0045

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0000

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

0.00%	0.0053
SingleSource/UnitTests/member-function-pointers

-100.00%

0.0200

0.0000

-

-100.00%

0.0088

SingleSource/UnitTests/printargs

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-66.67%

0.0103

SingleSource/Benchmarks/Misc/flops-5

-66.67%

0.0300

0.0100

-

-50.00%

0.0076
SingleSource/UnitTests/initp1	-66.67%	0.0300	0.0100	-	-75.00%	0.0070

MultiSource/Benchmarks/Olden/treeadd/treeadd

-50.00%

0.0400

0.0200

-

0.00%	0.0107
MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%

0.0073

SingleSource/Benchmarks/BenchmarkGame/puzzle

-50.00%

0.0400

0.0200

-

100.00%

0.0099

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-50.00%

0.0083

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0088

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

-50.00%

0.0045

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

-50.00%

0.0073

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0035

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

0.00%

0.0073

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

-50.00%

0.0093

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Regression/C/sumarraymalloc

-50.00%

0.0200

0.0100

-

-66.67%

0.0073

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

0.00%	0.0035

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

0.00%	0.0073
SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-50.00%

0.0400

0.0200

-

-50.00%

0.0073

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

0.00%

0.0076

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0076

MultiSource/Benchmarks/FreeBench/mason/mason	-42.86%	0.0700	0.0400	-	-20.00%	0.0083

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%	0.0129

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-33.33%	0.0076

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%

0.0070
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio	-25.00%	0.0400	0.0300	-	200.00%	0.0112
SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

-25.00%

0.0049

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0053
MultiSource/Benchmarks/Olden/em3d/em3d	-23.08%	0.1300	0.1000	-	-16.67%	0.0076
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-20.69%	0.5800	0.4600	-	-22.03%	0.0192
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-20.00%	0.1000	0.0800	-	-11.11%	0.0105
SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

-20.00%

0.0083

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

0.00%	0.0070
SingleSource/Benchmarks/Misc/richards_benchmark

-20.00%

0.0500

0.0400

-

-20.00%

0.0049

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

-20.00%

0.0103
MultiSource/Applications/viterbi/viterbi	-18.18%	0.1100	0.0900	-	-25.00%	0.0169

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

20.00%

0.0181

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

0.00%

0.0088

MultiSource/Benchmarks/Ptrdist/anagram/anagram

-14.29%

0.0700

0.0600

-

0.00%	0.0090

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

-14.29%	0.0099
SingleSource/Benchmarks/Shootout-C++/matrix	-14.29%	0.2100	0.1800	-	-5.26%	0.0076
SingleSource/Benchmarks/Shootout-C++/nestedloop	-11.76%	0.1700	0.1500	-	-16.67%	0.0045
SingleSource/Benchmarks/Shootout-C++/sumcol	-11.11%	0.1800	0.1600	-	-20.00%	0.0112

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-10.53%

0.0090
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish	-10.00%	0.2000	0.1800	-	-10.00%	0.0131

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

0.00%	0.0076
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-9.09%	0.5500	0.5000	-	-3.85%	0.0136
MultiSource/Benchmarks/McCat/09-vor/vor	-8.70%	0.2300	0.2100	-	-4.55%	0.0181

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

-8.16%

0.4900

0.4500

-

-4.26%	0.0285
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-7.14%	0.7000	0.6500	-	4.84%	0.0472
SingleSource/Benchmarks/Shootout-C++/spellcheck	-6.25%	0.3200	0.3000	-	-11.76%	0.0155
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	-6.25%	0.4800	0.4500	-	-8.16%	0.0176
SingleSource/Benchmarks/Adobe-C++/functionobjects	-5.56%	0.3600	0.3400	-	-10.53%	0.0105

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0035

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-50.00%

0.0200

0.0100

-

-50.00%

0.0045
MultiSource/Applications/JM/ldecod/ldecod	-42.86%	0.0700	0.0400	-	-20.00%	0.0125
SingleSource/Benchmarks/Shootout-C++/strcat	-25.00%	0.0800	0.0600	-	-33.33%	0.0112
MultiSource/Benchmarks/McCat/09-vor/vor	-18.18%	0.1100	0.0900	-	-18.18%	0.0049

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0035

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-14.29%

0.0073
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-14.29%	0.0700	0.0600	-	100.00%	0.0136
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-25.00%

0.0076

MultiSource/Benchmarks/Olden/health/health

-10.34%

0.2900

0.2600

-

0.00%	0.0146
MultiSource/Benchmarks/Olden/treeadd/treeadd	-9.52%	0.2100	0.1900	-	5.56%	0.0159
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	-7.14%	0.1400	0.1300	-	-7.14%	0.0035
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-6.67%	0.3000	0.2800	-	-9.68%	0.0118
MultiSource/Benchmarks/nbench/nbench	-6.26%	16.9200	15.8600	-	-6.26%	0.8604

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%	0.0049

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%	0.0916
SingleSource/Benchmarks/Shootout-C++/methcall	-6.00%	5.0000	4.7000	-	-0.21%	0.1452

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.37s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153927	2012-04-03 03:47:04	0:14:27
Previous

153926

2012-04-03 03:22:13

0:14:27

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	9	91
Performance Improvements	19	115
Existing Failures	8	8
Unchanged Tests	852	674
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/VersaBench/8b10b/8b10b	75.00%	0.0400	0.0700	0.0078	16.67%	-
SingleSource/Benchmarks/Misc/perlin	50.00%	0.0400	0.0600	0.0066	20.00%	-
SingleSource/Benchmarks/Shootout-C++/random	17.65%	0.1700	0.2000	0.0043	11.11%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/moments	40.00%	0.0500	0.0700	0.0060	75.00%	-
SingleSource/Benchmarks/Stanford/Bubblesort	25.00%	0.0400	0.0500	0.0033	25.00%	-
SingleSource/Benchmarks/Shootout-C++/objinst	7.11%	4.7800	5.1200	0.0628	3.02%	-
SingleSource/Benchmarks/CoyoteBench/almabench	4.63%	13.3900	14.0100	0.0915	4.63%	-
SingleSource/Benchmarks/Adobe-C++/functionobjects	1.43%	3.5000	3.5500	0.0185	0.28%	-
SingleSource/Benchmarks/Misc/richards_benchmark	1.22%	0.8200	0.8300	0.0033	1.22%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/flops-8	-100.00%	0.0300	0.0000	0.0071	-100.00%	-
SingleSource/Benchmarks/Shootout/nestedloop	-100.00%	0.0300	0.0000	0.0066	-100.00%	-
SingleSource/Regression/C++/2003-08-20-EnumSizeProblem	-100.00%	0.0100	0.0000	0.0033	-100.00%	-
SingleSource/Regression/C++/EH/simple_throw	-100.00%	0.0200	0.0000	0.0048	-100.00%	-
SingleSource/UnitTests/2002-10-09-ArrayResolution	-100.00%	0.0200	0.0000	0.0048	-100.00%	-
SingleSource/UnitTests/2002-10-12-StructureArgsSimple

-100.00%

0.0200

0.0000

0.0050

-100.00%

-

SingleSource/UnitTests/2002-10-13-BadLoad	-100.00%	0.0100	0.0000	0.0033	-100.00%	-
SingleSource/UnitTests/ms_struct_pack_layout-1	-100.00%	0.0100	0.0000	0.0033	-100.00%	-
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra	-75.00%	0.0400	0.0100	0.0083	-75.00%	-
SingleSource/Benchmarks/Misc/flops-7	-75.00%	0.0400	0.0100	0.0066	-66.67%	-
SingleSource/Benchmarks/Misc/lowercase	-66.67%	0.0300	0.0100	0.0043	-66.67%	-
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	-50.00%	0.0400	0.0200	0.0048	-50.00%	-
SingleSource/UnitTests/2009-04-16-BitfieldInitialization	-50.00%	0.0200	0.0100	0.0033	-50.00%	-
SingleSource/UnitTests/ms_struct-bitfield-init-1	-50.00%	0.0200	0.0100	0.0033	-50.00%	-
MultiSource/Benchmarks/McCat/15-trie/trie	-40.00%	0.0500	0.0300	0.0043	-25.00%	-
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow	-10.00%	0.2000	0.1800	0.0071	-14.29%	-
MultiSource/Applications/treecc/treecc	-7.50%	1.6000	1.4800	0.0200	-6.92%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Applications/d/make_dparser	-66.67%	0.0300	0.0100	0.0033	-50.00%	-
MultiSource/Applications/spiff/spiff	-8.29%	1.8100	1.6600	0.0339	-10.75%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

-25.00%

0.0087

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0071

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%

0.0105

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%

0.0087

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

-14.29%	0.0132
SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

33.33%

0.0071

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0066

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0071

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0033

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0048

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0086

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

-33.33%

0.0078

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

100.00%

0.0048

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%

0.0043

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0048

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0071

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0071

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%	0.0050
SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

100.00%

0.0048

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

28.57%	0.0141
MultiSource/Benchmarks/Ptrdist/ft/ft	70.00%	0.1000	0.1700	-	13.33%	0.0183
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	58.82%	0.1700	0.2700	-	12.50%	0.0373
SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

40.00%

0.0100

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

10.00%	0.0150
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	35.71%	0.1400	0.1900	-	5.56%	0.0169

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%

0.0070
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	33.33%	0.0600	0.0800	-	-11.11%	0.0132

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-20.00%	0.0086

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

0.00%

0.0043

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0086

SingleSource/Benchmarks/Shootout/random

33.33%

0.0300

0.0400

-

100.00%

0.0078

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0050

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

300.00%	0.0100
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	28.57%	0.1400	0.1800	-	5.88%	0.0215

MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

28.57%	0.0099
MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

25.00%

0.0066

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

0.00%	0.0162

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

20.00%

0.1500

0.1800

-

0.00%	0.0111

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

18.75%

0.1600

0.1900

-

0.00%	0.0158

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

-22.22%	0.0093
MultiSource/Benchmarks/Olden/mst/mst	16.67%	0.0600	0.0700	-	-22.22%	0.0165

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

0.00%	0.0078
MultiSource/Benchmarks/VersaBench/8b10b/8b10b	16.67%	0.0600	0.0700	-	75.00%	0.0078
SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

16.67%

0.0043

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%	0.0066
SingleSource/Benchmarks/Misc/fbench

16.67%

0.0600

0.0700

-

16.67%

0.0066
MultiSource/Benchmarks/McCat/08-main/main	15.79%	0.1900	0.2200	-	4.76%	0.0206
MultiSource/Benchmarks/Prolangs-C/loader/loader	13.04%	0.2300	0.2600	-	13.04%	0.0171
MultiSource/Applications/lambda-0_1_3/lambda	12.77%	0.4700	0.5300	-	1.92%	0.0228

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

0.00%	0.0117
SingleSource/Benchmarks/Shootout-C++/random	11.11%	0.1800	0.2000	-	17.65%	0.0043

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

11.11%	0.0078
MultiSource/Benchmarks/Olden/bh/bh

9.09%

0.2200

0.2400

-

9.09%

0.0122
MultiSource/Applications/hexxagon/hexxagon	8.97%	0.7800	0.8500	-	2.41%	0.0264

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

18.18%	0.0086

MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des

8.00%

0.2500

0.2700

-

8.00%	0.0078
SingleSource/Benchmarks/Misc-C++/Large/sphereflake	8.00%	0.2500	0.2700	-	8.00%	0.0093

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

0.00%	0.0097
MultiSource/Benchmarks/McCat/05-eks/eks	7.50%	0.4000	0.4300	-	10.26%	0.0180
MultiSource/Applications/Burg/burg	7.14%	0.8400	0.9000	-	-2.17%	0.0304
SingleSource/Benchmarks/CoyoteBench/fftbench	6.67%	0.3000	0.3200	-	3.23%	0.0060

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%	0.0093
SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

6.25%

0.0099

SingleSource/Benchmarks/Shootout-C++/spellcheck

6.25%

0.3200

0.3400

-

13.33%	0.0158

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

-10.53%	0.0097
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	6.14%	3.4200	3.6300	-	-0.82%	0.0712
MultiSource/Benchmarks/Prolangs-C/assembler/assembler	6.12%	0.4900	0.5200	-	15.56%	0.0286
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	5.56%	0.1800	0.1900	-	-9.52%	0.0136
SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

18.75%

0.0141
MultiSource/Applications/hbd/hbd	5.56%	1.0800	1.1400	-	-1.72%	0.0403
MultiSource/Benchmarks/Prolangs-C/simulator/simulator	5.36%	0.5600	0.5900	-	-3.28%	0.0245

MultiSource/Applications/spiff/spiff

5.26%

0.5700

0.6000

-

-9.09%	0.0333
MultiSource/Benchmarks/VersaBench/dbms/dbms	5.26%	0.5700	0.6000	-	7.14%	0.0398

SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

5.26%

0.0071

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

100.00%

0.0050
SingleSource/Benchmarks/Shootout-C++/moments	75.00%	0.0400	0.0700	-	40.00%	0.0060

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%	0.0050

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0942

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

0.00%	0.0033
SingleSource/Benchmarks/Stanford/Bubblesort

25.00%

0.0400

0.0500

-

25.00%

0.0033

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

0.00%	0.1286

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0048

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

12.50%

0.1600

0.1800

-

0.00%	0.0100

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%	0.0071
SingleSource/Benchmarks/Shootout-C++/lists1	10.53%	0.1900	0.2100	-	-4.55%	0.0105
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	8.70%	0.6900	0.7500	-	1.35%	0.0278

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0127

SingleSource/Benchmarks/Shootout-C++/hash2

5.51%

2.5400

2.6800

-

0.75%

0.1635

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/flops-8	-100.00%	0.0300	0.0000	-	-100.00%	0.0071
SingleSource/Benchmarks/Shootout/nestedloop

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0043

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0033

SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

-100.00%

0.0048

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0043

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2008-01-07-LongDouble

-100.00%

0.0200

0.0000

-

-100.00%

0.0087

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

0.00%

0.0043

SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0100

0.0000

-

-100.00%

0.0048

SingleSource/UnitTests/2002-05-03-NotTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0048

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

0.00%	0.0043
SingleSource/UnitTests/2002-10-09-ArrayResolution

-100.00%

0.0100

0.0000

-

-100.00%

0.0048

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

-100.00%

0.0070

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

-100.00%

0.0033

SingleSource/UnitTests/2003-05-02-DependentPHI

-100.00%

0.0200

0.0000

-

0.00%	0.0066
SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0071

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0043

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0048

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%

0.0048

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0033

SingleSource/UnitTests/printargs

-100.00%

0.0100

0.0000

-

0.00%	0.0070
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-75.00%

0.0400

0.0100

-

-75.00%

0.0083
SingleSource/Benchmarks/Stanford/FloatMM	-75.00%	0.0400	0.0100	-	-50.00%	0.0060
SingleSource/Benchmarks/Misc/flops-7

-66.67%

0.0300

0.0100

-

-75.00%

0.0066

SingleSource/Benchmarks/Misc/lowercase

-66.67%

0.0300

0.0100

-

-66.67%

0.0043

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-50.00%

0.0400

0.0200

-

-50.00%

0.0048

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-50.00%

0.0400

0.0200

-

-33.33%

0.0105

SingleSource/Benchmarks/BenchmarkGame/nsieve-bits

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%	0.0087

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0086

SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%

0.0071

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0071

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0071

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

-50.00%

0.0071

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

0.00%	0.0048

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

0.00%

0.0043

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%	0.0048
SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0043

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0071

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0043

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0043

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0071

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

0.00%	0.0048

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0048
SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0033

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0043

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0093

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0033
MultiSource/Benchmarks/Olden/tsp/tsp	-33.33%	0.0900	0.0600	-	-25.00%	0.0122

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

-20.00%

0.0111
MultiSource/Benchmarks/Olden/em3d/em3d	-30.77%	0.1300	0.0900	-	-10.00%	0.0122

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-16.67%

0.0171

SingleSource/Benchmarks/Misc/ffbench

-28.57%

0.0700

0.0500

-

-28.57%

0.0083
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft	-27.27%	0.1100	0.0800	-	-27.27%	0.0127
MultiSource/Benchmarks/McCat/15-trie/trie	-25.00%	0.0400	0.0300	-	-40.00%	0.0043
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

-25.00%

0.0071

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%

0.0066

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

0.00%	0.0050

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

50.00%	0.0097
SingleSource/Benchmarks/Dhrystone/dry	-25.00%	0.0400	0.0300	-	-40.00%	0.0083
SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

50.00%

0.0086

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

-20.00%

0.0070
MultiSource/Benchmarks/BitBench/uuencode/uuencode	-20.00%	0.0500	0.0400	-	33.33%	0.0122

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%	0.0078
MultiSource/Benchmarks/FreeBench/mason/mason

-14.29%

0.0700

0.0600

-

50.00%

0.0087
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow	-14.29%	0.2100	0.1800	-	-10.00%	0.0071
MultiSource/Benchmarks/McCat/09-vor/vor	-13.04%	0.2300	0.2000	-	-4.76%	0.0194
SingleSource/Benchmarks/Shootout-C++/lists	-13.04%	0.2300	0.2000	-	-13.04%	0.0099
SingleSource/Benchmarks/Shootout-C++/hello	-12.50%	0.1600	0.1400	-	-17.65%	0.0100

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

0.00%	0.0097
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch	-10.00%	0.1000	0.0900	-	-10.00%	0.0127
MultiSource/Benchmarks/Olden/voronoi/voronoi	-10.00%	0.2000	0.1800	-	-18.18%	0.0132
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	-10.00%	0.4000	0.3600	-	-7.69%	0.0290

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

12.50%	0.0099

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

-10.00%	0.0097
SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

5.56%

0.0097
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail	-9.09%	0.4400	0.4000	-	-11.11%	0.0179
SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%

0.0097

SingleSource/Benchmarks/Misc/himenobmtxpa

-7.69%

0.1300

0.1200

-

-14.29%

0.0097

MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk

-7.32%

0.4100

0.3800

-

-7.32%	0.0211
MultiSource/Applications/treecc/treecc	-6.92%	1.5900	1.4800	-	-7.50%	0.0200
MultiSource/Benchmarks/Ptrdist/bc/bc	-6.59%	0.9100	0.8500	-	-8.60%	0.0367
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-6.30%	1.2700	1.1900	-	-2.46%	0.0533
SingleSource/Benchmarks/Shootout-C++/hash	-6.06%	0.3300	0.3100	-	-3.13%	0.0105
SingleSource/Benchmarks/Misc-C++/bigfib	-6.00%	0.5000	0.4700	-	-6.00%	0.0149
SingleSource/Benchmarks/Shootout-C++/nestedloop	-5.88%	0.1700	0.1600	-	6.67%	0.0087
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-5.17%	0.5800	0.5500	-	19.57%	0.0479

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout-C++/ary2

-66.67%

0.0300

0.0100

-

-50.00%

0.0093

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-66.67%

0.0033

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

25.00%	0.0122

SingleSource/Benchmarks/Shootout-C++/strcat

-25.00%

0.0800

0.0600

-

0.00%	0.0122

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

0.00%	0.0043

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

0.00%	0.0070

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%	0.0127
MultiSource/Benchmarks/Olden/health/health	-13.79%	0.2900	0.2500	-	-3.85%	0.0141
MultiSource/Applications/spiff/spiff	-10.75%	1.8600	1.6600	-	-8.29%	0.0339

MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

-9.52%

0.2100

0.1900

-

-5.00%

0.0050

MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

0.00%	0.0150

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0048

SingleSource/Benchmarks/Misc-C++/Large/ray

-5.90%

3.2200

3.0300

-

0.33%	0.0888
SingleSource/Benchmarks/Misc-C++/bigfib	-5.88%	0.3400	0.3200	-	-5.88%	0.0233

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.21%

0.1378

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.39s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153928	2012-04-03 04:12:04	0:14:29
Previous

153927

2012-04-03 03:47:04

0:14:27

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	99
Performance Improvements	9	105
Existing Failures	8	8
Unchanged Tests	868	676
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Stanford/Oscar	50.00%	0.0400	0.0600	0.0050	50.00%	-
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	17.50%	0.4000	0.4700	0.0120	11.90%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

3.67%

1.0900

1.1300

0.0031

3.67%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

0.0050

-100.00%

-

SingleSource/Regression/C/2003-05-21-UnionBitfields	-100.00%	0.0300	0.0000	0.0068	-100.00%	-
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-100.00%

0.0200

0.0000

0.0047

-100.00%

-

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

0.0047

-100.00%

-

SingleSource/UnitTests/ms_struct_pack_layout

-100.00%

0.0200

0.0000

0.0047

-100.00%

-

SingleSource/Benchmarks/Shootout-C++/random	-25.00%	0.2000	0.1500	0.0082	-16.67%	-
SingleSource/UnitTests/Vector/SSE/sse_stepfft	-22.22%	0.0900	0.0700	0.0042	-22.22%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

0.0000

-100.00%

-

MultiSource/Benchmarks/BitBench/uudecode/uudecode	-25.00%	0.0800	0.0600	0.0000	-25.00%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

33.33%

0.0082

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%

0.0105

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

0.00%	0.0126

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

0.00%	0.0074

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%	0.0063

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%	0.0067

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

-20.00%

0.0087

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0068

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0068

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0031

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0047

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%	0.0074

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%	0.0047
SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0068

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%

0.0063

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

100.00%

0.0047

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

100.00%

0.0047

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0074

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0068

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0074

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/vla

100.00%

0.0200

0.0400

-

33.33%

0.0047

MultiSource/Benchmarks/BitBench/uudecode/uudecode

66.67%

0.0300

0.0500

-

25.00%

0.0067

MultiSource/Benchmarks/Olden/mst/mst

66.67%

0.0600

0.1000

-

42.86%

0.0156

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

25.00%

0.0082

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

66.67%

0.0300

0.0500

-

25.00%

0.0042
MultiSource/Benchmarks/Fhourstones/fhourstones	62.50%	0.0800	0.1300	-	18.18%	0.0149
MultiSource/Benchmarks/Ptrdist/ft/ft	60.00%	0.1000	0.1600	-	-5.88%	0.0195

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

52.94%

0.1700

0.2600

-

-3.70%	0.0359
SingleSource/Benchmarks/Stanford/Oscar	50.00%	0.0400	0.0600	-	50.00%	0.0050

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

0.00%	0.0105

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

35.71%

0.1400

0.1900

-

0.00%	0.0163

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

0.00%	0.0125

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

14.29%	0.0074
MultiSource/Benchmarks/VersaBench/8b10b/8b10b	33.33%	0.0600	0.0800	-	14.29%	0.0099
SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

33.33%

0.0074

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

33.33%	0.0050

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%	0.0099
MultiSource/Benchmarks/Olden/health/health	33.33%	0.0900	0.1200	-	33.33%	0.0110

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

12.50%	0.0074

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

0.00%	0.0067
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

25.00%

0.0400

0.0500

-

25.00%

0.0105

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

11.11%	0.0096
MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0063

SingleSource/Benchmarks/Dhrystone/dry

25.00%

0.0400

0.0500

-

66.67%	0.0082
MultiSource/Benchmarks/Olden/em3d/em3d	23.08%	0.1300	0.1600	-	77.78%	0.0162

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

0.00%

0.0155

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

-5.56%	0.0202

SingleSource/Regression/C++/ofstream_ctor

18.75%

0.1600

0.1900

-

11.76%	0.0094
MultiSource/Applications/viterbi/viterbi	18.18%	0.1100	0.1300	-	18.18%	0.0200
MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

16.67%

0.0047

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0057

SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

0.00%	0.0057

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%

0.0067
MultiSource/Applications/spiff/spiff	14.04%	0.5700	0.6500	-	8.33%	0.0321

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

13.64%

0.2200

0.2500

-

8.70%

0.0117
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	12.50%	0.1600	0.1800	-	-5.26%	0.0166

SingleSource/Benchmarks/Shootout-C++/lists1

12.00%

0.2500

0.2800

-

7.69%	0.0105
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	11.90%	0.4200	0.4700	-	17.50%	0.0120

SingleSource/Benchmarks/Misc-C++/Large/ray

11.54%

0.2600

0.2900

-

7.41%

0.0105
MultiSource/Benchmarks/Olden/tsp/tsp	11.11%	0.0900	0.1000	-	66.67%	0.0141
MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

11.11%

0.0094

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

0.00%

0.0125

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%	0.0079

MultiSource/Applications/lambda-0_1_3/lambda

10.64%

0.4700

0.5200

-

-1.89%	0.0226

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

3.39%	0.0233
MultiSource/Benchmarks/Prolangs-C/loader/loader	8.70%	0.2300	0.2500	-	-3.85%	0.0176

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%	0.0082

MultiSource/Applications/sgefa/sgefa

8.00%

0.2500

0.2700

-

12.50%	0.0133

MultiSource/Benchmarks/McCat/05-eks/eks

7.50%

0.4000

0.4300

-

0.00%	0.0221

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-11.11%	0.0117

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

-2.35%	0.0254

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%

0.0087

SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

0.00%	0.0094

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

21.43%	0.0113

MultiSource/Benchmarks/mediabench/gsm/toast/toast

6.19%

0.9700

1.0300

-

7.29%	0.0477
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	5.88%	1.0200	1.0800	-	2.86%	0.0245

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

11.76%

0.0099

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/moments	50.00%	0.0400	0.0600	-	-14.29%	0.0107

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0050

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0050

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0903

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%	0.1231

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0047

SingleSource/Benchmarks/Shootout/strcat

15.38%

0.1300

0.1500

-

15.38%

0.0107

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

0.00%	0.0067

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

0.00%	0.0099
SingleSource/Benchmarks/Shootout-C++/hash2	6.69%	2.5400	2.7100	-	1.12%	0.1541
MultiSource/Benchmarks/nbench/nbench	6.26%	16.9200	17.9800	-	6.52%	0.9189

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

-5.56%	0.0105
SingleSource/Benchmarks/Shootout-C++/lists	5.88%	4.9300	5.2200	-	5.45%	0.2094
MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%

0.0042

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%	0.0047
SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

0.00%	0.0063
SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C/2003-05-21-UnionBitfields

-100.00%

0.0100

0.0000

-

-100.00%

0.0068

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

-100.00%

0.0042

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/2002-05-02-CastTest2

-100.00%

0.0200

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%	0.0042
SingleSource/UnitTests/2003-08-20-FoldBug

-100.00%

0.0200

0.0000

-

-100.00%

0.0079

SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-100.00%

0.0200

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0068

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/Threads/tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0057

SingleSource/UnitTests/ms_struct_pack_layout

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%	0.0042

SingleSource/Benchmarks/BenchmarkGame/puzzle

-75.00%

0.0400

0.0100

-

-66.67%	0.0092
SingleSource/Benchmarks/Misc/flops-3

-66.67%

0.0300

0.0100

-

-50.00%

0.0068

SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-50.00%

0.0099

SingleSource/Benchmarks/Stanford/Perm

-66.67%

0.0300

0.0100

-

-50.00%

0.0047

SingleSource/UnitTests/Vector/build2

-66.67%

0.0300

0.0100

-

-66.67%

0.0067

MultiSource/Benchmarks/McCat/15-trie/trie

-50.00%

0.0400

0.0200

-

-33.33%

0.0057

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

-

100.00%

0.0105

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

-50.00%

0.0068

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

-33.33%

0.0050

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-50.00%

0.0047

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%

0.0087

SingleSource/Benchmarks/Misc/flops-6

-50.00%

0.0200

0.0100

-

-66.67%

0.0067

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Benchmarks/Shootout/nestedloop

-50.00%

0.0200

0.0100

-

0.00%

0.0094

SingleSource/Benchmarks/Shootout/strcat

-50.00%

0.0200

0.0100

-

-66.67%

0.0063

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%	0.0079
SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0042

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

0.00%	0.0068
SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0087

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%	0.0068

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0074

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0074

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

0.00%	0.0068
SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0063

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

-50.00%

0.0068

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%	0.0047

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

0.00%	0.0042
SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0074
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1	-42.86%	0.0700	0.0400	-	-42.86%	0.0094

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

-25.00%	0.0117
MultiSource/Benchmarks/Olden/bisort/bisort

-40.00%

0.0500

0.0300

-

-40.00%

0.0082
SingleSource/UnitTests/Vector/SSE/sse_isamax	-37.50%	0.0800	0.0500	-	-28.57%	0.0068

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%	0.0107
MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0105

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

50.00%

0.0068

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-25.00%

0.0067

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

200.00%

0.0087

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

0.00%	0.0082
SingleSource/UnitTests/Vector/SSE/sse_stepfft	-22.22%	0.0900	0.0700	-	-22.22%	0.0042
SingleSource/Benchmarks/Shootout-C++/methcall	-21.05%	0.1900	0.1500	-	-11.76%	0.0099
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-20.00%

0.1000

0.0800

-

-11.11%

0.0125

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-20.00%

0.1000

0.0800

-

-11.11%

0.0096

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

-20.00%

0.0094
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk	-20.00%	0.1500	0.1200	-	-14.29%	0.0275
SingleSource/Benchmarks/Misc-C++/oopack_v1p8	-18.18%	0.1100	0.0900	-	-10.00%	0.0063
SingleSource/Benchmarks/Shootout-C++/random	-16.67%	0.1800	0.1500	-	-25.00%	0.0082

MultiSource/Benchmarks/FreeBench/mason/mason

-14.29%

0.0700

0.0600

-

0.00%	0.0087

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

20.00%	0.0162

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

-14.29%	0.0087
MultiSource/Benchmarks/SciMark2-C/scimark2	-13.04%	0.2300	0.2000	-	-9.09%	0.0105
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	-11.11%	0.1800	0.1600	-	-5.88%	0.0096

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%	0.0092
SingleSource/Benchmarks/Shootout-C++/ary3	-9.09%	0.2200	0.2000	-	-9.09%	0.0103

MultiSource/Benchmarks/McCat/09-vor/vor

-8.70%

0.2300

0.2100

-

5.00%	0.0213

SingleSource/Benchmarks/Shootout-C++/lists

-8.70%

0.2300

0.2100

-

5.00%	0.0120

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%	0.0094

SingleSource/Benchmarks/Shootout-C++/wordfreq

-7.69%

0.2600

0.2400

-

-7.69%	0.0063
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-7.09%	1.2700	1.1800	-	-0.84%	0.0503
MultiSource/Benchmarks/VersaBench/dbms/dbms	-7.02%	0.5700	0.5300	-	-11.67%	0.0406

SingleSource/Benchmarks/Shootout-C++/spellcheck

-6.25%

0.3200

0.3000

-

-11.76%

0.0166
SingleSource/Benchmarks/Shootout-C++/fibo	-5.88%	0.1700	0.1600	-	-11.11%	0.0067

SingleSource/Benchmarks/Adobe-C++/functionobjects

-5.56%

0.3600

0.3400

-

-8.11%

0.0123

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0047

SingleSource/Benchmarks/Shootout-C++/ary2

-100.00%

0.0300

0.0000

-

-100.00%

0.0110

SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

-

-100.00%

0.0000

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-20.00%

0.0115

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-16.67%

0.0120

MultiSource/Benchmarks/BitBench/uudecode/uudecode

-25.00%

0.0800

0.0600

-

-25.00%

0.0000

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

-25.00%

0.0120

MultiSource/Benchmarks/McCat/09-vor/vor

-18.18%

0.1100

0.0900

-

-18.18%

0.0068
SingleSource/Benchmarks/Misc-C++/bigfib	-11.76%	0.3400	0.3000	-	-6.25%	0.0223

MultiSource/Benchmarks/Olden/health/health

-10.34%

0.2900

0.2600

-

4.00%	0.0147
MultiSource/Applications/oggenc/oggenc

-7.69%

0.1300

0.1200

-

-7.69%

0.0057
SingleSource/Benchmarks/Shootout-C++/hash	-6.38%	0.4700	0.4400	-	-8.33%	0.0189

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0047

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

-0.33%	0.0854

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

-0.21%

0.1310

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.42s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153933	2012-04-03 04:39:10	0:14:29
Previous

153928

2012-04-03 04:12:04

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	6	92
Performance Improvements	14	113
Existing Failures	8	8
Unchanged Tests	860	675
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/city/city	4.84%	1.2400	1.3000	0.0162	3.17%	-
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc	2.86%	6.9900	7.1900	0.0441	2.71%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/BitBench/five11/five11	5.49%	1.8200	1.9200	0.0049	4.92%	-
MultiSource/Applications/aha/aha	3.52%	2.5600	2.6500	0.0180	3.52%	-
SingleSource/Benchmarks/Shootout/hash	3.28%	3.3500	3.4600	0.0229	2.06%	-
SingleSource/Benchmarks/Misc/ReedSolomon	1.07%	5.6100	5.6700	0.0128	0.53%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2002-05-02-CastTest1	-100.00%	0.0100	0.0000	0.0030	-100.00%	-
SingleSource/UnitTests/AtomicOps	-100.00%	0.0200	0.0000	0.0040	-100.00%	-
SingleSource/UnitTests/SignlessTypes/factor	-100.00%	0.0200	0.0000	0.0067	-100.00%	-
SingleSource/UnitTests/conditional-gnu-ext	-100.00%	0.0100	0.0000	0.0030	-100.00%	-
SingleSource/UnitTests/ms_struct-bitfield-1	-100.00%	0.0100	0.0000	0.0030	-100.00%	-
SingleSource/Benchmarks/Misc/mandel-2	-66.67%	0.0300	0.0100	0.0054	-66.67%	-
SingleSource/UnitTests/SignlessTypes/div	-66.67%	0.0300	0.0100	0.0064	-66.67%	-
SingleSource/Benchmarks/Stanford/IntMM	-50.00%	0.0400	0.0200	0.0050	-33.33%	-
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-37.50%	0.0800	0.0500	0.0092	-50.00%	-
MultiSource/Benchmarks/Prolangs-C++/life/life	-28.57%	0.0700	0.0500	0.0049	-16.67%	-
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-7.41%	0.2700	0.2500	0.0049	-7.41%	-
MultiSource/Applications/d/make_dparser	-3.38%	2.6600	2.5700	0.0166	-3.38%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/flops-6	-1.41%	1.4200	1.4000	0.0049	-0.71%	-
SingleSource/Benchmarks/Misc-C++/Large/sphereflake	-1.23%	2.4300	2.4000	0.0080	-1.23%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/fp-convert

200.00%

0.0100

0.0300

-

200.00%	0.0102

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0100

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%

0.0104

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%

0.0083

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

33.33%

0.0070

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

100.00%

0.0066

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

0.00%

0.0120

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%

0.0060

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%

0.0066
SingleSource/Benchmarks/Stanford/Quicksort	100.00%	0.0100	0.0200	-	-50.00%	0.0083
SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

33.33%

0.0070

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0030

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%	0.0066
SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%	0.0046

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/Threads/tls

100.00%

0.0100

0.0200

-

0.00%

0.0054

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0067

MultiSource/Applications/aha/aha	60.00%	0.0500	0.0800	-	60.00%	0.0157

MultiSource/Benchmarks/Ptrdist/ft/ft

60.00%

0.1000

0.1600

-

0.00%	0.0191

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

3.85%	0.0342

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

-10.00%	0.0169
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk	42.86%	0.0700	0.1000	-	11.11%	0.0075
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	42.86%	0.1400	0.2000	-	17.65%	0.0195

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

0.00%	0.0077

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-20.00%

0.0080

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

-20.00%	0.0054

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

0.00%	0.0070
SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

33.33%

0.0080

SingleSource/Benchmarks/Shootout/random

33.33%

0.0300

0.0400

-

33.33%

0.0077

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0050

MultiSource/Benchmarks/Olden/health/health

33.33%

0.0900

0.1200

-

0.00%	0.0122

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

-5.26%	0.0158

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

0.00%

0.0066

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

-16.67%	0.0066
SingleSource/Regression/C++/ofstream_ctor	25.00%	0.1600	0.2000	-	5.26%	0.0098

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

0.00%

0.0149

MultiSource/Benchmarks/McCat/08-main/main

21.05%

0.1900

0.2300

-

21.05%	0.0196
SingleSource/Benchmarks/Shootout-C++/ackermann

18.75%

0.1600

0.1900

-

11.76%

0.0090

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

0.00%	0.0191
MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

11.11%

0.0080

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

40.00%	0.0104

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%	0.0063

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%

0.0066

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

16.67%

0.1800

0.2100

-

16.67%	0.0126
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

15.38%

0.1300

0.1500

-

15.38%

0.0090

MultiSource/Benchmarks/Olden/bh/bh

13.64%

0.2200

0.2500

-

13.64%	0.0118
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	13.33%	0.1500	0.1700	-	6.25%	0.0112

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

1.92%

0.0217

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

5.88%

0.0083

SingleSource/Benchmarks/Shootout-C++/hello

12.50%

0.1600

0.1800

-

5.88%

0.0114

SingleSource/Benchmarks/Misc-C++/Large/ray

11.54%

0.2600

0.2900

-

0.00%	0.0112
SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

11.11%

0.0128

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0078
MultiSource/Applications/spiff/spiff	10.53%	0.5700	0.6300	-	-3.08%	0.0319
MultiSource/Benchmarks/McCat/09-vor/vor	8.70%	0.2300	0.2500	-	19.05%	0.0212

MultiSource/Applications/Burg/burg

8.33%

0.8400

0.9100

-

5.81%	0.0286

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%

0.0078
MultiSource/Benchmarks/mediabench/gsm/toast/toast	8.25%	0.9700	1.0500	-	1.94%	0.0453
SingleSource/Benchmarks/Shootout-C++/lists1	8.00%	0.2500	0.2700	-	-3.57%	0.0108
SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

3.23%

0.0066

MultiSource/Benchmarks/Prolangs-C/agrep/agrep

6.32%

0.9500

1.0100

-

3.06%	0.0226
SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

-5.00%

0.0128
SingleSource/Benchmarks/Shootout-C++/random	5.56%	0.1800	0.1900	-	26.67%	0.0119

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

0.00%	0.0098

MultiSource/Benchmarks/VersaBench/dbms/dbms

5.26%

0.5700

0.6000

-

13.21%	0.0393
SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

5.26%

0.0070

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%	0.0077

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%	0.0049

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0049

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0868

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%	0.1187

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0046

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

0.00%

0.0094

MultiSource/Benchmarks/nbench/nbench

6.26%

16.9200

17.9800

-

0.00%	0.9004

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

0.00%	0.0100
SingleSource/Benchmarks/Shootout-C++/hash2	5.91%	2.5400	2.6900	-	-0.74%	0.1464

SingleSource/Benchmarks/Shootout-C++/lists

5.88%

4.9300

5.2200

-

0.00%	0.2057
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	5.50%	1.0900	1.1500	-	1.77%	0.0127

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0046

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/sieve

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Regression/C++/EH/ConditionalExpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%	0.0050

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

0.00%	0.0070

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

0.00%	0.0046

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Regression/C/2008-01-07-LongDouble

-100.00%

0.0200

0.0000

-

-100.00%

0.0083

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/2002-08-19-CodegenBug

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-10-09-ArrayResolution

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/AtomicOps

-100.00%

0.0200

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/SignlessTypes/cast2

-100.00%

0.0100

0.0000

-

-100.00%

0.0063

SingleSource/UnitTests/SignlessTypes/factor

-100.00%

0.0300

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/TestLoop

-100.00%

0.0200

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

0.00%	0.0060
SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Benchmarks/Misc/flops-7

-66.67%

0.0300

0.0100

-

-50.00%

0.0081

SingleSource/Benchmarks/Misc/mandel-2

-66.67%

0.0300

0.0100

-

-66.67%

0.0054

SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-66.67%

0.0064
MultiSource/Benchmarks/BitBench/uuencode/uuencode	-60.00%	0.0500	0.0200	-	-33.33%	0.0112
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-50.00%

0.0400

0.0200

-

-50.00%

0.0064
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-50.00%	0.1000	0.0500	-	-37.50%	0.0092
SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

-50.00%

0.0054

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0081

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

0.00%	0.0066

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

-66.67%

0.0066

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

0.00%	0.0064

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-40.00%

0.0075

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

-25.00%

0.0090

SingleSource/UnitTests/Vector/SSE/sse_isamax

-37.50%

0.0800

0.0500

-

0.00%	0.0080

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-50.00%	0.0128
MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

-16.67%

0.0087

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-16.67%

0.0155

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-28.57%

0.0700

0.0500

-

25.00%

0.0108

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

-25.00%

0.0067

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

0.00%	0.0100
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

-25.00%

0.0104

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

200.00%

0.0102

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

50.00%

0.0087

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0054

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%	0.0083

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

0.00%

0.0078

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-20.00%

0.0063

SingleSource/Benchmarks/Shootout/matrix

-20.00%

0.0500

0.0400

-

-42.86%	0.0108
SingleSource/UnitTests/SignlessTypes/rem	-20.00%	0.1000	0.0800	-	-20.00%	0.0075
MultiSource/Benchmarks/Olden/voronoi/voronoi	-15.00%	0.2000	0.1700	-	-15.00%	0.0142

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

0.00%	0.0083
SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0087

MultiSource/Benchmarks/SciMark2-C/scimark2

-13.04%

0.2300

0.2000

-

0.00%	0.0122

SingleSource/Benchmarks/Shootout-C++/lists

-13.04%

0.2300

0.2000

-

-4.76%	0.0118
SingleSource/Benchmarks/Misc/ReedSolomon	-12.50%	0.1600	0.1400	-	-12.50%	0.0098

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

13.33%	0.0133

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%

0.0087

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-5.00%	0.0090
SingleSource/Benchmarks/Adobe-C++/functionobjects	-8.33%	0.3600	0.3300	-	-2.94%	0.0134

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

-8.16%

0.4900

0.4500

-

-4.26%

0.0288
MultiSource/Applications/sgefa/sgefa	-8.00%	0.2500	0.2300	-	-14.81%	0.0145

MultiSource/Benchmarks/Olden/em3d/em3d

-7.69%

0.1300

0.1200

-

-25.00%	0.0191

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%

0.0092

MultiSource/Benchmarks/McCat/05-eks/eks

-7.50%

0.4000

0.3700

-

-13.95%	0.0242
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-7.41%	0.2700	0.2500	-	-7.41%	0.0049

MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk

-7.32%

0.4100

0.3800

-

-5.00%	0.0196
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	-7.14%	0.4200	0.3900	-	-17.02%	0.0210

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-6.82%

0.4400

0.4100

-

-4.65%	0.0176
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	-6.67%	0.4500	0.4200	-	-6.67%	0.0329
MultiSource/Benchmarks/Prolangs-C/football/football	-6.06%	0.6600	0.6200	-	-7.46%	0.0170
SingleSource/Benchmarks/Adobe-C++/stepanov_vector	-5.77%	0.5200	0.4900	-	-5.77%	0.0102
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-5.51%	1.2700	1.2000	-	1.69%	0.0478
MultiSource/Benchmarks/Ptrdist/bc/bc	-5.49%	0.9100	0.8600	-	-3.37%	0.0389
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-5.45%	0.5500	0.5200	-	-1.89%	0.0147

SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction

-5.00%

0.4000

0.3800

-

-5.00%

0.0078

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%	0.0050

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%	0.0114
MultiSource/Benchmarks/Olden/treeadd/treeadd	-28.57%	0.2100	0.1500	-	-31.82%	0.0170
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0040
MultiSource/Benchmarks/Olden/health/health	-20.69%	0.2900	0.2300	-	-11.54%	0.0142
SingleSource/Benchmarks/Shootout/strcat	-15.38%	0.1300	0.1100	-	-26.67%	0.0111

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-3.33%	0.0214
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0046

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

20.00%

0.0117
MultiSource/Benchmarks/Olden/perimeter/perimeter	-8.70%	0.2300	0.2100	-	-8.70%	0.0145

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%	0.0828
MultiSource/Applications/spiff/spiff	-5.91%	1.8600	1.7500	-	-7.41%	0.0602

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.21%

0.1254

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.74s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153937	2012-04-03 07:07:00	0:14:31
Previous	153935	2012-04-03 05:33:12	0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	5	91
Performance Improvements	10	90
Existing Failures	8	8
Unchanged Tests	865	699
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	17.07%	0.4100	0.4800	0.0224	14.29%	-
MultiSource/Benchmarks/Bullet/bullet	1.13%	26.4800	26.7800	0.0774	1.06%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/BenchmarkGame/partialsums	17.46%	0.6300	0.7400	0.0070	17.46%	-
SingleSource/Benchmarks/Shootout-C++/lists	13.59%	4.9300	5.6000	0.1286	13.59%	-
SingleSource/Benchmarks/Misc/whetstone	1.47%	1.3600	1.3800	0.0045	1.47%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C++/2003-06-13-Crasher

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/PR491	-100.00%	0.0200	0.0000	0.0046	-100.00%	-
SingleSource/UnitTests/2003-07-09-SignedArgs

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Benchmarks/Misc/fbench	-71.43%	0.0700	0.0200	0.0092	-66.67%	-
SingleSource/Benchmarks/Stanford/Oscar	-50.00%	0.0600	0.0300	0.0070	-25.00%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Benchmarks/BenchmarkGame/spectral-norm	-1.59%	1.2600	1.2400	0.0000	-1.59%	-
SingleSource/Benchmarks/Misc/fbench	-1.14%	1.7500	1.7300	0.0060	-0.57%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%

0.0049

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

-12.50%	0.0100

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

0.00%	0.0070
MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

-20.00%

0.0066

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%	0.0049
SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

-33.33%

0.0108

SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

-50.00%

0.0060

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

0.00%

0.0092

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0092

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

-33.33%	0.0064

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%	0.0077
SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0075

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

0.00%	0.0137

MultiSource/Benchmarks/Ptrdist/ft/ft

60.00%

0.1000

0.1600

-

0.00%

0.0117

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

80.00%	0.0185
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	41.18%	0.1700	0.2400	-	-11.11%	0.0212
MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

75.00%

0.0066

SingleSource/Benchmarks/CoyoteBench/almabench

40.00%

0.0500

0.0700

-

16.67%

0.0066

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

-11.11%	0.0125

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-20.00%

0.0066

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

33.33%	0.0054

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

100.00%	0.0078

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

0.00%	0.0046
SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0049

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

28.57%

0.1400

0.1800

-

0.00%	0.0143
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

28.57%

0.0700

0.0900

-

12.50%

0.0160

MultiSource/Benchmarks/Ptrdist/anagram/anagram

28.57%

0.0700

0.0900

-

12.50%

0.0092
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	26.67%	0.1500	0.1900	-	26.67%	0.0100
MultiSource/Benchmarks/McCat/15-trie/trie	25.00%	0.0400	0.0500	-	25.00%	0.0083

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

0.00%	0.0092
SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

25.00%

0.0064

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

10.00%	0.0135
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

21.43%

0.1400

0.1700

-

0.00%

0.0075

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

18.75%

0.1600

0.1900

-

11.76%

0.0127

SingleSource/Benchmarks/Shootout-C++/ackermann

18.75%

0.1600

0.1900

-

11.76%

0.0110

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

0.00%

0.0185

MultiSource/Benchmarks/Ptrdist/ks/ks

18.18%

0.1100

0.1300

-

0.00%

0.0102
MultiSource/Benchmarks/VersaBench/dbms/dbms	17.54%	0.5700	0.6700	-	4.69%	0.0301
MultiSource/Benchmarks/FreeBench/neural/neural	16.67%	0.1200	0.1400	-	7.69%	0.0075
MultiSource/Benchmarks/Prolangs-C++/life/life	16.67%	0.0600	0.0700	-	16.67%	0.0064

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%

0.0075

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

16.67%	0.0066

MultiSource/Benchmarks/McCat/08-main/main

15.79%

0.1900

0.2200

-

15.79%	0.0206
SingleSource/Benchmarks/Misc/himenobmtxpa	15.38%	0.1300	0.1500	-	7.14%	0.0098
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	14.29%	0.4200	0.4800	-	17.07%	0.0224

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

0.00%	0.0151

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

5.88%

0.0078

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

-5.26%

0.0092

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

0.00%

0.0075
SingleSource/Benchmarks/Shootout-C++/nestedloop	11.76%	0.1700	0.1900	-	5.56%	0.0094

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

5.56%	0.0087

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

-16.67%	0.0128
MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

0.00%

0.0143

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

17.65%	0.0110

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0066
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	10.34%	0.5800	0.6400	-	3.23%	0.0429

MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

0.00%	0.0168
MultiSource/Benchmarks/nbench/nbench	8.33%	0.8400	0.9100	-	4.60%	0.0204

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

8.00%	0.0104
MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

16.67%

0.0185

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

0.00%

0.0102

MultiSource/Applications/Burg/burg

7.14%

0.8400

0.9000

-

-4.26%	0.0308

MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg

7.02%

3.4200

3.6600

-

0.55%

0.0546

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

0.00%	0.0215

MultiSource/Benchmarks/mediabench/gsm/toast/toast

6.19%

0.9700

1.0300

-

0.00%	0.0412

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

6.12%

0.4900

0.5200

-

4.00%	0.0306

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

5.56%	0.0140

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

11.76%

0.0080

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

200.00%

0.0100

0.0300

-

200.00%

0.0141

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

40.00%	0.0083
SingleSource/Benchmarks/Shootout-C++/ary

33.33%

0.0300

0.0400

-

0.00%

0.0102

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0070

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

1.20%	0.0067
SingleSource/Benchmarks/BenchmarkGame/partialsums	17.46%	0.6300	0.7400	-	17.46%	0.0070
SingleSource/Benchmarks/Shootout-C++/lists	13.59%	4.9300	5.6000	-	13.59%	0.1286

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

7.69%

0.0125

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

2.38%	0.0049

MultiSource/Benchmarks/nbench/nbench

6.26%

16.9200

17.9800

-

3.57%	0.8672

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

6.25%	0.0100
SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

0.00%

0.0077

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C++/2003-06-13-Crasher

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%	0.0049
SingleSource/Regression/C/PR491

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-10-09-ArrayResolution

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

-100.00%	0.0049
SingleSource/UnitTests/2003-07-09-SignedArgs

-100.00%

0.0300

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2006-02-04-DivRem

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0049
SingleSource/Benchmarks/Misc/fbench	-66.67%	0.0600	0.0200	-	-71.43%	0.0092
SingleSource/Benchmarks/Misc/flops-3

-66.67%

0.0300

0.0100

-

-66.67%

0.0067

SingleSource/Benchmarks/Misc/flops-8

-66.67%

0.0300

0.0100

-

-50.00%

0.0087

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-60.00%

0.0500

0.0200

-

-33.33%

0.0104
MultiSource/Benchmarks/McCat/12-IOtest/iotest	-57.14%	0.0700	0.0300	-	-25.00%	0.0075
MultiSource/Benchmarks/Olden/treeadd/treeadd

-50.00%

0.0400

0.0200

-

0.00%

0.0090

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-50.00%

0.0400

0.0200

-

0.00%

0.0098

SingleSource/Benchmarks/BenchmarkGame/puzzle

-50.00%

0.0400

0.0200

-

-50.00%

0.0102
SingleSource/Benchmarks/BenchmarkGame/spectral-norm	-50.00%	0.0600	0.0300	-	-50.00%	0.0102
SingleSource/Benchmarks/Dhrystone/dry

-50.00%

0.0400

0.0200

-

-50.00%

0.0087

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

0.00%	0.0089

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

-50.00%

0.0081

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

-50.00%

0.0081

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0049

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-40.00%	0.1000	0.0600	-	-14.29%	0.0125

SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-25.00%	0.0070

SingleSource/UnitTests/Vector/SSE/sse_isamax

-37.50%

0.0800

0.0500

-

-16.67%	0.0063

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%	0.0063
MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-25.00%

0.0066

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%	0.0098
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

50.00%

0.0120

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

0.00%

0.0066

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

0.00%	0.0075

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

50.00%	0.0080

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%

0.0075
SingleSource/Benchmarks/Stanford/Oscar	-25.00%	0.0400	0.0300	-	-50.00%	0.0070
SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

-25.00%

0.0046

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-22.22%

0.1800

0.1400

-

-22.22%

0.0130

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

-42.86%

0.0114

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

33.33%	0.0094
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

20.00%

0.0102
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk	-13.33%	0.1500	0.1300	-	-7.14%	0.0160

MultiSource/Benchmarks/SciMark2-C/scimark2

-13.04%

0.2300

0.2000

-

17.65%

0.0189

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

-12.50%

0.0098

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

-40.00%	0.0205
SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

-10.00%

0.0083

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

0.00%	0.0080

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-9.09%

0.5500

0.5000

-

-3.85%

0.0128
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-8.66%	1.2700	1.1600	-	-4.13%	0.0294

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%

0.0078

MultiSource/Benchmarks/McCat/05-eks/eks

-7.50%

0.4000

0.3700

-

0.00%	0.0256
MultiSource/Applications/obsequi/Obsequi	-6.90%	0.8700	0.8100	-	0.00%	0.0192
SingleSource/Benchmarks/Shootout-C++/except	-5.26%	0.1900	0.1800	-	0.00%	0.0075
SingleSource/Benchmarks/Shootout-C++/methcall	-5.26%	0.1900	0.1800	-	0.00%	0.0120

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%	0.0050
SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-20.00%	0.0090
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-16.67%

0.0102

MultiSource/Benchmarks/Olden/treeadd/treeadd

-23.81%

0.2100

0.1600

-

-11.11%	0.0185
SingleSource/Benchmarks/Misc-C++/bigfib	-17.65%	0.3400	0.2800	-	3.70%	0.0212

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

0.00%

0.0050

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%

0.0070
MultiSource/Benchmarks/Olden/health/health	-6.90%	0.2900	0.2700	-	-3.57%	0.0141
MultiSource/Applications/spiff/spiff	-6.45%	1.8600	1.7400	-	-4.92%	0.0582

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

0.00%	0.0185

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0098

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

3.30%

0.0575

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.42s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153938	2012-04-03 07:32:01	0:14:30
Previous

153937

2012-04-03 07:07:00

0:14:31

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	97
Performance Improvements	16	101
Existing Failures	8	8
Unchanged Tests	861	682
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Execution Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/18-imp/imp	33.33%	0.0600	0.0800	0.0046	33.33%	-
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	7.34%	1.0900	1.1700	0.0212	7.34%	-
SingleSource/Benchmarks/Shootout/matrix	2.19%	2.7400	2.8000	0.0151	1.82%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/mandel-2	-100.00%	0.0300	0.0000	0.0092	-100.00%	-
SingleSource/Regression/C++/2011-03-28-Bitfield

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Regression/C/badidx	-100.00%	0.0200	0.0000	0.0060	-100.00%	-
SingleSource/UnitTests/2002-05-02-CastTest	-100.00%	0.0300	0.0000	0.0067	-100.00%	-
SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

MultiSource/Benchmarks/Prolangs-C++/family/family	-75.00%	0.0400	0.0100	0.0075	-50.00%	-
MultiSource/Benchmarks/Olden/power/power	-30.00%	0.1000	0.0700	0.0092	-12.50%	-
SingleSource/Benchmarks/Misc-C++/oopack_v1p8	-30.00%	0.1000	0.0700	0.0054	-36.36%	-
SingleSource/Benchmarks/Shootout-C++/lists1	-11.11%	0.2700	0.2400	0.0100	-4.00%	-
SingleSource/Benchmarks/Shootout-C++/ary2	-9.09%	0.2200	0.2000	0.0064	-13.04%	-
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-7.69%	0.2600	0.2400	0.0060	-11.11%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Applications/obsequi/Obsequi	-5.85%	1.7100	1.6100	0.0259	-5.29%	-
MultiSource/Benchmarks/Olden/bisort/bisort	-4.00%	0.5000	0.4800	0.0046	-4.00%	-
SingleSource/Benchmarks/Misc/fbench	-1.73%	1.7300	1.7000	0.0080	-2.30%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

50.00%	0.0092
SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

200.00%

0.0075

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

25.00%

0.0066

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

0.00%	0.0050
SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

33.33%

0.0049

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%	0.0100
SingleSource/Regression/C++/EH/throw_rethrow_test

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0078

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/UnitTests/2008-04-18-LoopBug

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0066

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

0.00%

0.0137

MultiSource/Benchmarks/Prolangs-C/allroots/allroots	66.67%	0.0300	0.0500	-	-28.57%	0.0078

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

66.67%	0.0070

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

-6.25%	0.0111

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

42.86%

0.0700

0.1000

-

42.86%	0.0100
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

42.86%

0.1400

0.2000

-

17.65%

0.0075

MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

0.00%	0.0081
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	35.29%	0.1700	0.2300	-	-4.17%	0.0150
MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

33.33%

0.0075
MultiSource/Benchmarks/McCat/03-testtrie/testtrie	33.33%	0.0600	0.0800	-	33.33%	0.0104
MultiSource/Benchmarks/Olden/mst/mst

33.33%

0.0600

0.0800

-

-11.11%

0.0174

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

33.33%	0.0078

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

0.00%	0.0066
SingleSource/Benchmarks/Shootout/random

33.33%

0.0300

0.0400

-

100.00%

0.0094

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

0.00%

0.0046

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%

0.0064

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0049

MultiSource/Applications/viterbi/viterbi	27.27%	0.1100	0.1400	-	7.69%	0.0149
MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

11.11%

0.0135

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0060

SingleSource/Regression/C++/ofstream_ctor

25.00%

0.1600

0.2000

-

11.11%	0.0081

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%	0.0066

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%	0.0067
SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%

0.0046

SingleSource/Benchmarks/Shootout/lists

16.67%

0.0600

0.0700

-

40.00%

0.0060
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	14.29%	0.1400	0.1600	-	-11.11%	0.0136

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

0.00%	0.0060
SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

-5.26%

0.0119

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

0.00%

0.0070

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

11.11%

0.0900

0.1000

-

-9.09%

0.0078

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

11.11%

0.1800

0.2000

-

17.65%

0.0119

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

0.00%

0.0120

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0066

MultiSource/Applications/lambda-0_1_3/lambda

10.64%

0.4700

0.5200

-

-1.89%

0.0149
MultiSource/Applications/hexxagon/hexxagon	10.26%	0.7800	0.8600	-	3.61%	0.0211

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%

0.0080

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

5.17%	0.0173

MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

0.00%

0.0169
SingleSource/Benchmarks/Shootout-C++/sieve	8.33%	0.2400	0.2600	-	8.33%	0.0080

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

0.00%

0.0090
SingleSource/Benchmarks/Shootout-C++/reversefile	6.90%	0.2900	0.3100	-	3.33%	0.0050

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

6.67%

0.1500

0.1600

-

23.08%	0.0143

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-15.79%	0.0118

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

10.34%	0.0102
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	6.67%	0.4500	0.4800	-	9.09%	0.0260
MultiSource/Benchmarks/Ptrdist/bc/bc	6.59%	0.9100	0.9700	-	8.99%	0.0406
SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

6.25%

0.0114

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%	0.0120

SingleSource/Benchmarks/Adobe-C++/functionobjects

5.56%

0.3600

0.3800

-

8.57%

0.0162

SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

-5.00%

0.0117

SingleSource/Benchmarks/Shootout-C++/random

5.56%

0.1800

0.1900

-

11.76%

0.0133

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

300.00%

0.0100

0.0400

-

33.33%

0.0108

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Benchmarks/Shootout-C++/moments

50.00%

0.0400

0.0600

-

50.00%	0.0120
MultiSource/Benchmarks/McCat/18-imp/imp	33.33%	0.0600	0.0800	-	33.33%	0.0046
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0049

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%

0.0049

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0070

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%	0.0067
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	11.59%	0.6900	0.7700	-	13.24%	0.0291

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%	0.0046

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

5.00%	0.0077
SingleSource/Benchmarks/Shootout-C++/hash2	8.27%	2.5400	2.7500	-	5.36%	0.0425

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

0.00%	0.0120
MultiSource/Benchmarks/nbench/nbench	7.62%	16.9200	18.2100	-	1.28%	0.6765

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%	0.0049
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	7.34%	1.0900	1.1700	-	7.34%	0.0212
SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%

0.0046

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

0.00%

0.0100

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/mandel-2

-100.00%

0.0300

0.0000

-

-100.00%

0.0092

SingleSource/Benchmarks/Shootout/ary3

-100.00%

0.0200

0.0000

-

-100.00%

0.0092

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/Regression/C++/2011-03-28-Bitfield

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C++/EH/simple_rethrow

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

0.00%	0.0049
SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2003-05-23-TransparentUnion

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2004-02-03-AggregateCopy

-100.00%

0.0200

0.0000

-

-100.00%

0.0080

SingleSource/Regression/C/badidx

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2005-11-29-LongSwitch

-100.00%

0.0200

0.0000

-

-100.00%

0.0080

SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/printargs

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/Benchmarks/Misc/flops-2

-66.67%

0.0300

0.0100

-

-66.67%

0.0066
SingleSource/UnitTests/2003-07-09-SignedArgs	-66.67%	0.0300	0.0100	-	0.00%	0.0090
SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-66.67%

0.0080

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

MultiSource/Benchmarks/Prolangs-C++/family/family	-50.00%	0.0200	0.0100	-	-75.00%	0.0075
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-50.00%

0.0400

0.0200

-

-33.33%

0.0064

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-33.33%	0.0075
SingleSource/Benchmarks/Shootout/strcat

-50.00%

0.0200

0.0100

-

-66.67%

0.0078

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

0.00%	0.0067

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

0.00%

0.0089

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C/sumarraymalloc

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0046

MultiSource/Benchmarks/FreeBench/mason/mason

-42.86%

0.0700

0.0400

-

-20.00%

0.0063

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

50.00%	0.0087
SingleSource/Benchmarks/Misc-C++/oopack_v1p8	-36.36%	0.1100	0.0700	-	-30.00%	0.0054

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

33.33%	0.0111
MultiSource/Benchmarks/McCat/12-IOtest/iotest	-28.57%	0.0700	0.0500	-	66.67%	0.0112
MultiSource/Benchmarks/SciMark2-C/scimark2	-26.09%	0.2300	0.1700	-	-15.00%	0.0190

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

0.00%	0.0075
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

-25.00%

0.0050

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

50.00%

0.0092

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

-25.00%

0.0070

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

50.00%

0.0092

SingleSource/Benchmarks/Stanford/Oscar

-25.00%

0.0400

0.0300

-

0.00%	0.0090

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

20.00%	0.0070

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

-12.50%	0.0064

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-33.33%	0.0092

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-20.00%

0.0070

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

33.33%

0.0070

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

0.00%	0.0094
MultiSource/Benchmarks/McCat/09-vor/vor	-17.39%	0.2300	0.1900	-	-20.83%	0.0168

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-33.33%	0.0196

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

0.00%	0.0102
SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0080
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-13.39%	1.2700	1.1000	-	-5.17%	0.0280
SingleSource/Benchmarks/Shootout-C++/ary2

-13.04%

0.2300

0.2000

-

-9.09%

0.0064

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

0.00%	0.0100
MultiSource/Benchmarks/Prolangs-C++/employ/employ	-11.11%	0.2700	0.2400	-	-7.69%	0.0060
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url	-11.11%	0.1800	0.1600	-	14.29%	0.0130

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-5.56%	0.0120

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

50.00%	0.0128
SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

-5.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

-9.09%

0.0104

MultiSource/Benchmarks/Olden/em3d/em3d

-7.69%

0.1300

0.1200

-

-14.29%	0.0191
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-7.69%

0.2600

0.2400

-

-7.69%

0.0090

MultiSource/Applications/obsequi/Obsequi

-6.90%

0.8700

0.8100

-

0.00%

0.0204
SingleSource/Benchmarks/Shootout-C++/hash2	-5.71%	0.3500	0.3300	-	-2.94%	0.0064

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0077
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish	-5.00%	0.2000	0.1900	-	-5.00%	0.0087

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

25.00%

0.0092

MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan

-20.00%

0.0500

0.0400

-

-20.00%

0.0040

SingleSource/Benchmarks/Misc-C++/bigfib

-17.65%

0.3400

0.2800

-

0.00%	0.0196

MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

18.75%	0.0185
SingleSource/Benchmarks/Shootout-C++/hash	-8.51%	0.4700	0.4300	-	-2.27%	0.0179

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0100

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

0.00%	0.0571
MultiSource/Applications/obsequi/Obsequi	-5.29%	1.7000	1.6100	-	-5.85%	0.0259

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.86s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153939	2012-04-03 07:56:59	0:14:30
Previous

153938

2012-04-03 07:32:01

0:14:30

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	5	97
Performance Improvements	13	98
Existing Failures	8	8
Unchanged Tests	862	685
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc	200.00%	0.0100	0.0300	0.0050	200.00%	-
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	30.00%	0.4000	0.5200	0.0298	23.81%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc-C++-EH/spirit	14.14%	4.0300	4.6000	0.0118	11.65%	-
MultiSource/Benchmarks/Ptrdist/ft/ft	4.82%	0.8300	0.8700	0.0145	6.10%	-
SingleSource/Benchmarks/Misc/mandel	1.01%	0.9900	1.0000	0.0030	1.01%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/ackermann	-100.00%	0.0200	0.0000	0.0045	-100.00%	-
SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/UnitTests/2003-05-12-MinIntProblem

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/UnitTests/2006-01-23-UnionInit	-100.00%	0.0200	0.0000	0.0049	0.00%	-
SingleSource/Benchmarks/Stanford/Queens

-66.67%

0.0300

0.0100

0.0054

-66.67%

-

SingleSource/Regression/C/bigstack	-50.00%	0.0400	0.0200	0.0046	-50.00%	-
SingleSource/UnitTests/ms_struct-bitfield-init	-50.00%	0.0200	0.0100	0.0030	0.00%	-
SingleSource/Benchmarks/Shootout-C++/wordfreq	-16.00%	0.2500	0.2100	0.0060	-19.23%	-
MultiSource/Benchmarks/sim/sim	-11.54%	0.2600	0.2300	0.0083	-11.54%	-
SingleSource/Benchmarks/Misc-C++/stepanov_container	-5.88%	0.6800	0.6400	0.0077	-5.88%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-50.00%	0.0400	0.0200	0.0049	-33.33%	-
MultiSource/Benchmarks/Prolangs-C++/primes/primes	-6.45%	0.3100	0.2900	0.0049	-3.33%	-
SingleSource/Benchmarks/Shootout-C++/ary3	-1.10%	1.8100	1.7900	0.0049	0.00%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

200.00%

0.0050

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0046

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

200.00%

0.0094

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%	0.0092

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%	0.0064

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

0.00%

0.0049

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%	0.0066

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

100.00%	0.0070
SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Regression/C++/EH/throw_rethrow_test

100.00%

0.0100

0.0200

-

0.00%	0.0064
SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%	0.0040
SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

-33.33%

0.0083

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%	0.0046
SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0066

MultiSource/Benchmarks/Prolangs-C/compiler/compiler	70.59%	0.1700	0.2900	-	26.09%	0.0181

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

0.00%	0.0087

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

0.00%	0.0075

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-11.11%	0.0125
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	57.14%	0.1400	0.2200	-	10.00%	0.0092

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

50.00%

0.0119

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

42.86%

0.0700

0.1000

-

0.00%	0.0111
MultiSource/Benchmarks/Olden/perimeter/perimeter

40.00%

0.0500

0.0700

-

75.00%

0.0092

MultiSource/Benchmarks/Ptrdist/ft/ft

40.00%

0.1000

0.1400

-

-6.67%	0.0111
SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

16.67%

0.0102

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

10.00%

0.0128

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

0.00%	0.0110

MultiSource/Benchmarks/Olden/mst/mst

33.33%

0.0600

0.0800

-

0.00%	0.0151

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

0.00%	0.0067

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

0.00%

0.0067

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

33.33%

0.0070

SingleSource/Benchmarks/Shootout/random

33.33%

0.0300

0.0400

-

0.00%

0.0090

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%

0.0064

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0049

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

33.33%

0.0100

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

33.33%

0.0900

0.1200

-

20.00%	0.0063

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

28.57%

0.0700

0.0900

-

50.00%	0.0178

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

26.67%

0.1500

0.1900

-

18.75%	0.0117

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

66.67%	0.0077
MultiSource/Benchmarks/McCat/15-trie/trie

25.00%

0.0400

0.0500

-

25.00%

0.0089

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

25.00%

0.0400

0.0500

-

25.00%

0.0100

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

42.86%	0.0112

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

0.00%	0.0060
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

25.00%

0.0400

0.0500

-

150.00%

0.0075

SingleSource/Regression/C++/ofstream_ctor

25.00%

0.1600

0.2000

-

0.00%	0.0090
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	23.81%	0.4200	0.5200	-	30.00%	0.0298

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

-7.14%

0.0133

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%

0.0066

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0064

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%	0.0046

MultiSource/Benchmarks/McCat/08-main/main

15.79%

0.1900

0.2200

-

15.79%

0.0194

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

14.29%

0.1400

0.1600

-

0.00%	0.0126

MultiSource/Applications/spiff/spiff

14.04%

0.5700

0.6500

-

10.17%	0.0314
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	12.50%	0.4000	0.4500	-	7.14%	0.0168

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

0.00%

0.0064

SingleSource/Benchmarks/Shootout-C++/hello

12.50%

0.1600

0.1800

-

5.88%

0.0114

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

0.00%

0.0063

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

5.56%

0.0087

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	11.11%	0.1800	0.2000	-	5.26%	0.0112

SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

11.11%

0.0130

MultiSource/Applications/lambda-0_1_3/lambda

10.64%

0.4700

0.5200

-

0.00%	0.0102
SingleSource/Benchmarks/CoyoteBench/fftbench	10.00%	0.3000	0.3300	-	3.13%	0.0102

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%	0.0080

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

0.00%	0.0187
MultiSource/Benchmarks/VersaBench/dbms/dbms	8.77%	0.5700	0.6200	-	8.77%	0.0413

MultiSource/Benchmarks/McCat/09-vor/vor

8.70%

0.2300

0.2500

-

31.58%	0.0194

MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

0.00%

0.0162

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

8.33%	0.0087
MultiSource/Benchmarks/Prolangs-C/assembler/assembler	8.16%	0.4900	0.5300	-	10.42%	0.0277

MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

16.67%

0.0190

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

7.69%

0.0110

MultiSource/Applications/Burg/burg

7.14%

0.8400

0.9000

-

5.88%	0.0308
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail	6.82%	0.4400	0.4700	-	6.82%	0.0187

SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

0.00%

0.0114

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

100.00%

0.0100

0.0200

-

-50.00%

0.0126

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%	0.0046

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

40.00%

0.0089

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%	0.0049
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	29.17%	0.7200	0.9300	-	-1.06%	0.0070
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%

0.0067

SingleSource/Benchmarks/Shootout/strcat

15.38%

0.1300

0.1500

-

7.14%

0.0110
SingleSource/Benchmarks/Misc-C++-EH/spirit	11.65%	4.1200	4.6000	-	14.14%	0.0118

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0049

SingleSource/Benchmarks/Shootout-C++/hash2

6.69%

2.5400

2.7100

-

-1.45%	0.0425
MultiSource/Benchmarks/Ptrdist/ft/ft	6.10%	0.8200	0.8700	-	4.82%	0.0145

SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

-4.76%

0.0077

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/NP/np

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Benchmarks/Shootout/ackermann

-100.00%

0.0200

0.0000

-

-100.00%

0.0045

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/Regression/C++/EH/ConditionalExpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0060

SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

0.00%	0.0075
SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

-100.00%

0.0083

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

0.00%	0.0080

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0100

0.0000

-

0.00%	0.0066
SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

-100.00%

0.0100

0.0000

-

-100.00%

0.0080

SingleSource/Regression/C/PR491

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-05-12-MinIntProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2003-10-13-SwitchTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

0.00%	0.0040

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/Benchmarks/Stanford/Queens

-66.67%

0.0300

0.0100

-

-66.67%

0.0054

SingleSource/Regression/C/sumarray

-66.67%

0.0300

0.0100

-

-50.00%

0.0090

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-50.00%

0.0400

0.0200

-

-33.33%

0.0050

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-66.67%

0.0063

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%	0.0066
SingleSource/Benchmarks/Shootout/heapsort

-50.00%

0.0400

0.0200

-

-50.00%

0.0066

SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

-50.00%

0.0083

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/Regression/C/bigstack

-50.00%

0.0400

0.0200

-

-50.00%

0.0046

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/vla

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%	0.0087

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-40.00%

0.1000

0.0600

-

-33.33%	0.0135

MultiSource/Benchmarks/Olden/tsp/tsp

-33.33%

0.0900

0.0600

-

-25.00%

0.0150

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%	0.0110
MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

25.00%

0.0063

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%	0.0112
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-28.57%

0.0700

0.0500

-

-16.67%

0.0090

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0094

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

0.00%	0.0090
SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

-25.00%

0.0111

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

-25.00%

0.0087

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-25.00%

0.0063

SingleSource/Benchmarks/Stanford/Oscar

-25.00%

0.0400

0.0300

-

0.00%

0.0102

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

-25.00%

0.0083

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%	0.0070

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%	0.0070
SingleSource/Benchmarks/Shootout-C++/wordfreq	-19.23%	0.2600	0.2100	-	-16.00%	0.0060
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-18.18%

0.1100

0.0900

-

-18.18%

0.0092
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish	-15.00%	0.2000	0.1700	-	-10.53%	0.0087
MultiSource/Benchmarks/MiBench/security-sha/security-sha

-14.29%

0.0700

0.0600

-

-25.00%

0.0140

MultiSource/Benchmarks/Ptrdist/anagram/anagram

-14.29%

0.0700

0.0600

-

-14.29%

0.0102

MultiSource/Benchmarks/SciMark2-C/scimark2

-13.04%

0.2300

0.2000

-

17.65%

0.0220
MultiSource/Benchmarks/McCat/05-eks/eks	-12.50%	0.4000	0.3500	-	-14.63%	0.0247

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

0.00%

0.0100

MultiSource/Benchmarks/sim/sim	-11.54%	0.2600	0.2300	-	-11.54%	0.0083

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

0.00%	0.0118
SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

-10.00%

0.0049

MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5

-9.52%

0.2100

0.1900

-

-9.52%

0.0075

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-9.52%	0.0092

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

0.00%	0.0104
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-14.29%

0.0087
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-7.27%	0.5500	0.5100	-	-7.27%	0.0163
SingleSource/Benchmarks/Shootout-C++/ackermann

-6.25%

0.1600

0.1500

-

-16.67%

0.0120
SingleSource/Benchmarks/Misc-C++/stepanov_container	-5.88%	0.6800	0.6400	-	-5.88%	0.0077

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0083

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

5.88%

0.0111

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

MultiSource/Applications/JM/ldecod/ldecod	-57.14%	0.0700	0.0300	-	-40.00%	0.0090
MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-50.00%

0.0060

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/moments	-50.00%	0.0400	0.0200	-	-66.67%	0.0127
SingleSource/Benchmarks/Shootout-C++/strcat	-37.50%	0.0800	0.0500	-	-37.50%	0.0112

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-28.57%	0.0110

MultiSource/Benchmarks/McCat/09-vor/vor

-18.18%

0.1100

0.0900

-

-18.18%

0.0078

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%

0.0070

MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

-3.57%

0.0145

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%	0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0066

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.21%

0.0469

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153949	2012-04-03 11:03:12	0:14:28
Previous

153939

2012-04-03 07:56:59

0:14:30

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	9	93
Performance Improvements	5	102
Existing Failures	8	8
Unchanged Tests	866	685
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput	50.00%	0.0400	0.0600	0.0046	100.00%	-
MultiSource/Benchmarks/McCat/18-imp/imp	7.14%	0.2800	0.3000	0.0070	7.14%	-
MultiSource/Applications/lambda-0_1_3/lambda	3.85%	0.5200	0.5400	0.0064	14.89%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Stanford/Bubblesort	25.00%	0.0400	0.0500	0.0030	25.00%	-
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	22.22%	0.0900	0.1100	0.0049	22.22%	-
SingleSource/Benchmarks/Adobe-C++/loop_unroll	3.57%	1.6800	1.7400	0.0066	25.18%	-
SingleSource/UnitTests/Vector/SSE/sse_expandfft	3.03%	0.3300	0.3400	0.0030	3.03%	-
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	2.15%	0.9300	0.9500	0.0040	31.94%	-

SingleSource/Benchmarks/Misc/flops-4

1.11%

0.9000

0.9100

0.0000

1.11%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/hello	-100.00%	0.0100	0.0000	0.0030	0.00%	-
SingleSource/UnitTests/blockstret	-100.00%	0.0100	0.0000	0.0030	0.00%	-
MultiSource/Benchmarks/llubenchmark/llu	-40.00%	0.0500	0.0300	0.0030	50.00%	-
MultiSource/Benchmarks/Prolangs-C++/office/office	-10.53%	0.1900	0.1700	0.0054	0.00%	-
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-7.69%	0.9100	0.8400	0.0164	-5.62%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

33.33%

0.0094

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

0.00%

0.0049

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0092

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

100.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

-33.33%

0.0066

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

20.00%	0.0087
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput	100.00%	0.0300	0.0600	-	50.00%	0.0046

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

33.33%

0.0049

SingleSource/Benchmarks/BenchmarkGame/nsieve-bits

100.00%

0.0200

0.0400

-

33.33%

0.0067

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

-20.00%

0.0049

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

33.33%

0.0070

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0000
SingleSource/Regression/C++/short_circuit_dtor	100.00%	0.0100	0.0200	-	0.00%	0.0040

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0078

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%	0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

100.00%

0.0063

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0066

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

12.50%	0.0125
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	76.47%	0.1700	0.3000	-	3.45%	0.0181

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

0.00%	0.0119

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

12.50%	0.0148

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

0.00%	0.0120
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	35.71%	0.1400	0.1900	-	18.75%	0.0135
MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

33.33%

0.0075

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

0.00%

0.0110

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

-20.00%

0.0078

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

100.00%

0.0092

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%	0.0064

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0046

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%	0.0100

MultiSource/Benchmarks/Ptrdist/ft/ft

30.00%

0.1000

0.1300

-

-7.14%	0.0111

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

-10.00%	0.0110
SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

66.67%

0.0110

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

21.43%

0.1400

0.1700

-

-22.73%	0.0142

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

0.00%	0.0135

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

-12.50%	0.0066

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%	0.0066
SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

16.67%

0.0054
MultiSource/Applications/lambda-0_1_3/lambda	14.89%	0.4700	0.5400	-	3.85%	0.0064

MultiSource/Applications/spiff/spiff

14.04%

0.5700

0.6500

-

0.00%	0.0326

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

12.50%

0.1600

0.1800

-

12.50%	0.0133

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

0.00%

0.0066

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

20.00%	0.0135

SingleSource/Benchmarks/Shootout-C++/hello

12.50%

0.1600

0.1800

-

0.00%	0.0127

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

0.00%	0.0080

SingleSource/Benchmarks/Misc-C++/Large/ray

11.54%

0.2600

0.2900

-

7.41%	0.0119

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

11.11%

0.0900

0.1000

-

-16.67%	0.0063
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

11.11%

0.1800

0.2000

-

11.11%

0.0137

MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

66.67%	0.0150
SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

5.26%

0.0114
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	11.11%	0.4500	0.5000	-	11.11%	0.0220
MultiSource/Benchmarks/mediabench/gsm/toast/toast	10.31%	0.9700	1.0700	-	8.08%	0.0375

MultiSource/Benchmarks/Olden/voronoi/voronoi

10.00%

0.2000

0.2200

-

10.00%	0.0142

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%

0.0081

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

0.00%

0.0187

MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

0.00%

0.0162

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%	0.0078

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

3.85%	0.0128

MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

0.00%	0.0190

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%	0.0110

MultiSource/Benchmarks/McCat/18-imp/imp

7.14%

0.2800

0.3000

-

7.14%	0.0070

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-15.79%

0.0130

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

-3.03%	0.0125
SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

10.34%

0.0104

MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg

6.43%

3.4200

3.6400

-

2.25%

0.0602

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

2.47%	0.0220

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

-15.00%	0.0094

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

-5.00%	0.0112

SingleSource/Benchmarks/Shootout-C++/random

5.56%

0.1800

0.1900

-

11.76%

0.0140

MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

-9.09%

0.0200

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0046

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

100.00%	0.0067

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0046
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	31.94%	0.7200	0.9500	-	2.15%	0.0040
SingleSource/Benchmarks/Adobe-C++/loop_unroll	25.18%	1.3900	1.7400	-	3.57%	0.0066
SingleSource/Benchmarks/Shootout-C++/moments

25.00%

0.0400

0.0500

-

150.00%

0.0143

SingleSource/Benchmarks/Stanford/Bubblesort

25.00%

0.0400

0.0500

-

25.00%

0.0030

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

22.22%

0.0900

0.1100

-

22.22%

0.0049

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

16.67%

0.0060

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

5.00%

0.0075
SingleSource/Benchmarks/Shootout-C++/hash2	8.66%	2.5400	2.7600	-	1.85%	0.0435
MultiSource/Benchmarks/nbench/nbench	6.32%	16.9200	17.9900	-	9.03%	0.7540

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

6.25%

0.0063

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/Benchmarks/Shootout/ary3

-100.00%

0.0200

0.0000

-

-100.00%

0.0102

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0083

SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

0.00%	0.0078

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

0.00%

0.0087

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%	0.0050

SingleSource/Regression/C/PR491

-100.00%

0.0200

0.0000

-

0.00%	0.0080
SingleSource/Regression/C/badidx

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

0.00%	0.0046

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/member-function-pointers

-100.00%

0.0200

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/printargs

-100.00%

0.0100

0.0000

-

-100.00%

0.0083

SingleSource/UnitTests/vla

-100.00%

0.0200

0.0000

-

-100.00%

0.0080

SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-50.00%

0.0075

SingleSource/Benchmarks/Misc/flops-7

-66.67%

0.0300

0.0100

-

-50.00%

0.0092

SingleSource/Benchmarks/Misc/mandel-2

-66.67%

0.0300

0.0100

-

-66.67%

0.0120

SingleSource/Regression/C/PR640

-66.67%

0.0300

0.0100

-

-66.67%

0.0066

MultiSource/Benchmarks/McCat/15-trie/trie

-50.00%

0.0400

0.0200

-

-60.00%	0.0094

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/Benchmarks/Dhrystone/dry

-50.00%

0.0400

0.0200

-

-33.33%

0.0087

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%	0.0083
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0054

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%	0.0066

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0083

SingleSource/Benchmarks/Misc/fbench

-33.33%

0.0600

0.0400

-

-33.33%

0.0143

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%	0.0063

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%

0.0111

SingleSource/Benchmarks/Misc-C++/oopack_v1p8

-27.27%

0.1100

0.0800

-

-27.27%

0.0108

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-40.00%	0.0083

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%	0.0089

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

-40.00%	0.0108
MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0092

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

-25.00%

0.0064

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

0.00%

0.0090

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

-25.00%

0.0066

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

0.00%	0.0110
SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

50.00%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%

0.0070

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

-22.22%

0.0900

0.0700

-

-22.22%

0.0098

SingleSource/UnitTests/2006-12-11-LoadConstants

-22.22%

0.0900

0.0700

-

-12.50%

0.0050

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-42.86%	0.0102

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-20.00%

0.1000

0.0800

-

33.33%	0.0143

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0063

SingleSource/UnitTests/SignlessTypes/rem

-20.00%

0.1000

0.0800

-

-20.00%

0.0078
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url	-16.67%	0.1800	0.1500	-	-6.25%	0.0122

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

20.00%	0.0092
SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0080

SingleSource/Benchmarks/Shootout-C++/matrix

-14.29%

0.2100

0.1800

-

-5.26%

0.0092
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-10.91%	0.5500	0.4900	-	-3.92%	0.0145

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-5.56%

0.0112

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

-18.18%	0.0187

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

-10.00%

0.4000

0.3600

-

-20.00%	0.0239

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%	0.0049
SingleSource/Benchmarks/Shootout-C++/hash	-9.09%	0.3300	0.3000	-	-9.09%	0.0111

SingleSource/Benchmarks/Shootout-C++/wordfreq

-7.69%

0.2600

0.2400

-

14.29%	0.0140

MultiSource/Benchmarks/McCat/05-eks/eks

-7.50%

0.4000

0.3700

-

5.71%	0.0273

MultiSource/Benchmarks/VersaBench/dbms/dbms

-7.02%

0.5700

0.5300

-

-14.52%	0.0422
SingleSource/Benchmarks/Misc/ReedSolomon	-6.25%	0.1600	0.1500	-	7.14%	0.0100
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-5.62%	0.8900	0.8400	-	-7.69%	0.0164

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0087

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

0.00%	0.0049

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

0.00%	0.0070

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

33.33%	0.0102
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-42.86%

0.0700

0.0400

-

-20.00%

0.0102

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0046

SingleSource/Benchmarks/Shootout/strcat

-15.38%

0.1300

0.1100

-

-26.67%

0.0111

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-12.12%	0.0227
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

0.00%	0.0070
MultiSource/Benchmarks/Olden/perimeter/perimeter	-8.70%	0.2300	0.2100	-	-4.55%	0.0127

MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

0.00%	0.0142
SingleSource/Benchmarks/Shootout-C++/methcall	-6.60%	5.0000	4.6700	-	-0.85%	0.0469

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

-6.38%	0.0197

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0040

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.40s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153951	2012-04-03 11:33:10	0:14:29
Previous

153949

2012-04-03 11:03:12

0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	6	93
Performance Improvements	13	106
Existing Failures	8	8
Unchanged Tests	861	681
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/methcall

100.00%

0.0200

0.0400

0.0060

33.33%

-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	18.18%	0.2200	0.2600	0.0087	18.18%	-
SingleSource/Benchmarks/Shootout-C++/objinst	7.95%	4.7800	5.1600	0.1122	3.82%	-
SingleSource/Benchmarks/Stanford/Puzzle	7.69%	0.1300	0.1400	0.0030	7.69%	-
SingleSource/Benchmarks/Stanford/FloatMM	2.44%	0.4100	0.4200	0.0030	0.00%	-
SingleSource/Benchmarks/McGill/queens	1.00%	2.0000	2.0200	0.0030	1.00%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/Benchmarks/BenchmarkGame/fannkuch	-50.00%	0.0400	0.0200	0.0049	0.00%	-
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft	-36.36%	0.1100	0.0700	0.0100	-36.36%	-
MultiSource/Benchmarks/Prolangs-C++/objects/objects	-28.57%	0.0700	0.0500	0.0067	-16.67%	-
MultiSource/Benchmarks/VersaBench/bmm/bmm	-17.39%	0.2300	0.1900	0.0060	-13.64%	-
SingleSource/Benchmarks/Shootout-C++/moments	-12.50%	0.3200	0.2800	0.0110	-6.67%	-
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	-11.32%	1.0600	0.9400	0.0265	-7.84%	-
MultiSource/Applications/lambda-0_1_3/lambda	-7.41%	0.5400	0.5000	0.0081	6.38%	-
SingleSource/Benchmarks/Shootout-C++/reversefile	-6.90%	0.2900	0.2700	0.0066	-6.90%	-

Performance Improvements - Execution Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-28.57%	0.0700	0.0500	0.0049	-28.57%	-
SingleSource/Benchmarks/BenchmarkGame/recursive	-2.17%	0.9200	0.9000	0.0050	-2.17%	-
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	-1.44%	1.3900	1.3700	0.0040	-1.44%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

0.00%	0.0100
SingleSource/Benchmarks/Misc/fp-convert

200.00%

0.0100

0.0300

-

50.00%

0.0070

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

16.67%	0.0087
MultiSource/Applications/aha/aha	100.00%	0.0500	0.1000	-	11.11%	0.0125

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

0.00%	0.0066
SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0050

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

0.00%	0.0049
SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

33.33%

0.0063

SingleSource/Regression/C++/EH/throw_rethrow_test

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0000
SingleSource/Regression/C++/short_circuit_dtor	100.00%	0.0100	0.0200	-	0.00%	0.0040

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

-33.33%

0.0092

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%

0.0092

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%	0.0050
SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%	0.0078

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0054

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

0.00%	0.0060

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%	0.0046

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0064

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

-16.67%	0.0067

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

25.00%	0.0078
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	64.71%	0.1700	0.2800	-	-6.67%	0.0210

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

0.00%	0.0148

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

15.38%	0.0130

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

42.86%

0.1400

0.2000

-

17.65%

0.0150

MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

16.67%

0.0087

SingleSource/Benchmarks/CoyoteBench/almabench

40.00%

0.0500

0.0700

-

16.67%

0.0064
MultiSource/Applications/viterbi/viterbi	36.36%	0.1100	0.1500	-	15.38%	0.0136

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

35.71%

0.1400

0.1900

-

0.00%	0.0120

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%	0.0064
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

-11.11%

0.0125

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

100.00%

0.0080

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%	0.0078
SingleSource/Benchmarks/Shootout/methcall

33.33%

0.0300

0.0400

-

100.00%

0.0060

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0050

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%

0.0067

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0064

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

10.00%

0.0070

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

-12.50%

0.0114
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	16.67%	0.1800	0.2100	-	5.00%	0.0137

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

6.25%

0.0134

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

0.00%	0.0125
SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

5.88%

0.0108

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

11.76%	0.0078
MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

25.00%

0.0137

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

25.00%	0.0137
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	11.11%	0.0900	0.1000	-	42.86%	0.0102

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

25.00%	0.0066

MultiSource/Applications/spiff/spiff

10.53%

0.5700

0.6300

-

-3.08%

0.0314

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%

0.0081

MultiSource/Applications/Burg/burg

9.52%

0.8400

0.9200

-

6.98%	0.0277
MultiSource/Benchmarks/mediabench/gsm/toast/toast	9.28%	0.9700	1.0600	-	-0.93%	0.0295

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

4.35%	0.0098

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

2.41%

0.0219
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2	8.70%	0.2300	0.2500	-	8.70%	0.0078

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%

0.0075

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

0.00%	0.0120
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

7.69%

0.0087

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%

0.0080
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	6.90%	0.5800	0.6200	-	8.77%	0.0465

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

6.67%

0.1500

0.1600

-

6.67%	0.0120
MultiSource/Applications/lambda-0_1_3/lambda	6.38%	0.4700	0.5000	-	-7.41%	0.0081

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

-5.56%	0.0066

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%	0.0112
SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

-5.00%

0.0098

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

5.56%	0.0077

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

5.36%

0.5600

0.5900

-

-3.28%

0.0169

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%	0.0083
SingleSource/Benchmarks/Shootout-C++/ary2

33.33%

0.0300

0.0400

-

33.33%

0.0110

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	30.56%	0.7200	0.9400	-	-1.05%	0.0045
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/moments

25.00%

0.0400

0.0500

-

0.00%	0.0143

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

-3.45%	0.0204
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	18.18%	0.2200	0.2600	-	18.18%	0.0087
SingleSource/Benchmarks/Shootout-C++/lists1

15.79%

0.1900

0.2200

-

4.76%

0.0070

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

-9.09%	0.0064
SingleSource/Benchmarks/Stanford/Puzzle	7.69%	0.1300	0.1400	-	7.69%	0.0030

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

2.38%	0.0049

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

8.82%	0.0314
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

6.67%

0.3000

0.3200

-

10.34%

0.0122

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%

0.0040
SingleSource/Benchmarks/Shootout-C++/hash2	5.12%	2.5400	2.6700	-	-3.26%	0.0408

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/NP/np

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Benchmarks/Shootout/nestedloop

-100.00%

0.0200

0.0000

-

-100.00%

0.0100

SingleSource/Benchmarks/Shootout/sieve

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C++/BuiltinTypeInfo

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

-100.00%

0.0100

0.0000

-

-100.00%

0.0080

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Benchmarks/Misc/flops-2

-66.67%

0.0300

0.0100

-

-66.67%

0.0066

SingleSource/Benchmarks/Misc/flops-5

-66.67%

0.0300

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2003-07-09-SignedArgs

-66.67%

0.0300

0.0100

-

-66.67%

0.0094

SingleSource/UnitTests/2003-08-11-VaListArg

-66.67%

0.0300

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/SignlessTypes/shr

-66.67%

0.0300

0.0100

-

-50.00%

0.0049

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-50.00%

0.0400

0.0200

-

-50.00%	0.0066
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-50.00%

0.0400

0.0200

-

-33.33%

0.0110

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-50.00%

0.0400

0.0200

-

-33.33%

0.0064

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-50.00%

0.0400

0.0200

-

-33.33%

0.0080

SingleSource/Benchmarks/BenchmarkGame/nsieve-bits

-50.00%

0.0200

0.0100

-

-75.00%

0.0080

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-33.33%

0.0066

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

0.00%	0.0067

SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

0.00%

0.0089

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

0.00%

0.0087

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/test_indvars

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%	0.0050

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-42.86%

0.0700

0.0400

-

-42.86%

0.0143

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-42.86%

0.0700

0.0400

-

-33.33%	0.0090

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0054

SingleSource/UnitTests/Vector/SSE/sse_isamax

-37.50%

0.0800

0.0500

-

-16.67%

0.0070
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft	-36.36%	0.1100	0.0700	-	-36.36%	0.0100
MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-33.33%

0.0120

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%

0.0063

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%

0.0110

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

0.00%	0.0075

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

0.00%	0.0066
SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-25.00%

0.0063

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0078

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

-25.00%

0.0094

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

-25.00%

0.0066

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

-25.00%

0.0075

SingleSource/Benchmarks/CoyoteBench/huffbench

-22.22%

0.0900

0.0700

-

-12.50%

0.0049

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

-20.00%

0.0110

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0063

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

-20.00%

0.0060

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

-20.00%	0.0075

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

0.00%	0.0067
MultiSource/Benchmarks/VersaBench/bmm/bmm	-13.64%	0.2200	0.1900	-	-17.39%	0.0060

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

12.50%	0.0078

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

5.56%	0.0083
MultiSource/Benchmarks/SciMark2-C/scimark2	-8.70%	0.2300	0.2100	-	-4.55%	0.0220
SingleSource/Benchmarks/Shootout-C++/ary2	-8.70%	0.2300	0.2100	-	-4.55%	0.0083
SingleSource/Benchmarks/Shootout-C++/lists

-8.70%

0.2300

0.2100

-

-8.70%

0.0130
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	-7.84%	1.0200	0.9400	-	-11.32%	0.0265

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%	0.0050

MultiSource/Benchmarks/McCat/05-eks/eks

-7.50%

0.4000

0.3700

-

0.00%	0.0265

MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk

-7.32%

0.4100

0.3800

-

-7.32%	0.0200

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-7.27%

0.5500

0.5100

-

4.08%	0.0168
SingleSource/Benchmarks/Shootout-C++/reversefile	-6.90%	0.2900	0.2700	-	-6.90%	0.0066
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-6.74%	0.8900	0.8300	-	-1.19%	0.0211
SingleSource/Benchmarks/Shootout-C++/moments	-6.67%	0.3000	0.2800	-	-12.50%	0.0110
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-6.25%

0.1600

0.1500

-

-16.67%

0.0128

SingleSource/Benchmarks/Shootout-C++/hello

-6.25%

0.1600

0.1500

-

-16.67%

0.0128

SingleSource/Benchmarks/Shootout-C++/hash

-6.06%

0.3300

0.3100

-

3.33%	0.0128

SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

-11.11%

0.0064

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

-5.88%	0.0111

SingleSource/Benchmarks/Shootout-C++/hash2

-5.71%

0.3500

0.3300

-

-2.94%

0.0070
MultiSource/Benchmarks/McCat/08-main/main	-5.26%	0.1900	0.1800	-	-10.00%	0.0142

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0087

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

5.88%

0.0100

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

-100.00%

0.0100

0.0000

-

-100.00%

0.0122

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%	0.0064
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-28.57%

0.0049

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

25.00%	0.0110
MultiSource/Benchmarks/Olden/treeadd/treeadd	-19.05%	0.2100	0.1700	-	-19.05%	0.0200

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

0.00%	0.0050
SingleSource/Benchmarks/Misc-C++/bigfib	-8.82%	0.3400	0.3100	-	6.90%	0.0221

SingleSource/Benchmarks/Shootout/strcat

-7.69%

0.1300

0.1200

-

9.09%

0.0135

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0030

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.86%

0.0467

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.44s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153957	2012-04-03 16:01:09	0:14:33
Previous

153951

2012-04-03 11:33:10

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	8	97
Performance Improvements	10	105
Existing Failures	8	8
Unchanged Tests	862	678
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/primes/primes	100.00%	0.0100	0.0200	0.0030	100.00%	-
SingleSource/Benchmarks/Stanford/Puzzle	28.57%	0.0700	0.0900	0.0049	12.50%	-
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4	1.22%	18.0000	18.2200	0.0583	1.05%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/nbench/nbench	14.28%	17.5800	20.0900	0.7409	18.74%	-
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits	2.50%	0.8000	0.8200	0.0054	3.80%	-
SingleSource/Benchmarks/Misc/pi	1.69%	0.5900	0.6000	0.0030	0.00%	-
MultiSource/Applications/siod/siod	1.36%	2.9500	2.9900	0.0087	2.40%	-
SingleSource/Benchmarks/Misc/flops-4	1.11%	0.9000	0.9100	0.0030	1.11%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2002-08-02-CastTest

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/2007-04-10-BitfieldTest	-100.00%	0.0200	0.0000	0.0046	0.00%	-
SingleSource/Benchmarks/Stanford/RealMM

-50.00%

0.0400

0.0200

0.0049

-33.33%

-

SingleSource/Benchmarks/Shootout/lists	-33.33%	0.0600	0.0400	0.0054	-33.33%	-
MultiSource/Benchmarks/Ptrdist/ks/ks	-25.00%	0.1200	0.0900	0.0083	-18.18%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/08-main/main	-25.00%	0.0400	0.0300	0.0030	-25.00%	-
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame	-8.33%	0.2400	0.2200	0.0040	-8.33%	-
SingleSource/Benchmarks/Shootout/fib2	-1.48%	2.7000	2.6600	0.0064	-0.75%	-
MultiSource/Benchmarks/Olden/em3d/em3d	-1.29%	3.8900	3.8400	0.0122	-1.29%	-
MultiSource/Applications/viterbi/viterbi	-1.00%	2.0000	1.9800	0.0077	-1.00%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

0.00%

0.0104

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

50.00%

0.0066

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

50.00%

0.0092

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

66.67%	0.0081

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%	0.0050
MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

100.00%

0.0030

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

-14.29%	0.0090

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

100.00%

0.0300

0.0600

-

20.00%	0.0066

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

100.00%	0.0064

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

33.33%

0.0060

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0000
SingleSource/Regression/C++/short_circuit_dtor	100.00%	0.0100	0.0200	-	0.00%	0.0040

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0092

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%	0.0083

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast2	100.00%	0.0100	0.0200	-	0.00%	0.0060
SingleSource/UnitTests/Vector/sumarray-dbl	100.00%	0.0100	0.0200	-	0.00%	0.0046

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

0.00%	0.0078

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-20.00%	0.0135

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

-3.57%	0.0216

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

0.00%	0.0110
MultiSource/Benchmarks/Olden/bisort/bisort

40.00%

0.0500

0.0700

-

75.00%

0.0110

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

40.00%	0.0094

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

37.50%	0.0133

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

37.50%	0.0104

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

35.71%

0.1400

0.1900

-

0.00%

0.0125

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%

0.0064

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

14.29%	0.0108

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

0.00%	0.0110
MultiSource/Benchmarks/Olden/mst/mst

33.33%

0.0600

0.0800

-

-11.11%

0.0135

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

60.00%	0.0098

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0078

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

33.33%

0.0078

SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

33.33%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0040

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

33.33%

0.0100

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

28.57%

0.0700

0.0900

-

28.57%	0.0145
MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

25.00%

0.0083
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	25.00%	0.1600	0.2000	-	33.33%	0.0142
SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

25.00%

0.0110

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

0.00%	0.0060
SingleSource/UnitTests/Vector/SSE/sse_expandfft

22.22%

0.0900

0.1100

-

10.00%

0.0066

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

-13.33%	0.0155
MultiSource/Applications/spiff/spiff	17.54%	0.5700	0.6700	-	6.35%	0.0313

MultiSource/Benchmarks/FreeBench/neural/neural

16.67%

0.1200

0.1400

-

7.69%

0.0075

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

40.00%	0.0054
SingleSource/Benchmarks/Shootout-C++/heapsort

16.67%

0.1800

0.2100

-

10.53%

0.0090

MultiSource/Benchmarks/Olden/em3d/em3d

15.38%

0.1300

0.1500

-

15.38%

0.0196
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	14.29%	0.1400	0.1600	-	-20.00%	0.0155

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

13.64%

0.2200

0.2500

-

4.17%	0.0100
MultiSource/Benchmarks/McCat/09-vor/vor	13.04%	0.2300	0.2600	-	8.33%	0.0215

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

0.00%

0.0120

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

0.00%	0.0110

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

0.00%	0.0078
MultiSource/Benchmarks/mediabench/gsm/toast/toast	11.34%	0.9700	1.0800	-	1.89%	0.0317

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

11.11%

0.1800

0.2000

-

-4.76%	0.0164

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

0.00%	0.0137
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	11.11%	0.1800	0.2000	-	5.26%	0.0100
MultiSource/Applications/Burg/burg	10.71%	0.8400	0.9300	-	1.09%	0.0284

MultiSource/Applications/lambda-0_1_3/lambda

10.64%

0.4700

0.5200

-

4.00%	0.0102

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

0.00%	0.0192

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

3.39%	0.0150

SingleSource/Benchmarks/Shootout-C++/sieve

8.33%

0.2400

0.2600

-

4.00%	0.0104

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

0.00%

0.0110

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

0.00%

0.0078

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%

0.0080

MultiSource/Benchmarks/VersaBench/dbms/dbms	7.02%	0.5700	0.6100	-	7.02%	0.0435

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-5.88%	0.0130

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%

0.0050

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

0.00%	0.0083
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%	0.0045

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

-0.60%	0.0204
MultiSource/Benchmarks/nbench/nbench	18.74%	16.9200	20.0900	-	14.28%	0.7409

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

16.67%

0.0060

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

0.00%	0.0064

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

-4.55%	0.0070

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%	0.0049
SingleSource/Benchmarks/Shootout-C++/hash2	7.48%	2.5400	2.7300	-	2.25%	0.0413

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

0.00%	0.0323

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

6.67%

0.3000

0.3200

-

0.00%	0.0133

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

0.00%	0.0046

MultiSource/Benchmarks/Ptrdist/ft/ft

6.10%

0.8200

0.8700

-

8.75%	0.0189

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%

0.0040

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/NP/np

-100.00%

0.0200

0.0000

-

0.00%	0.0075

SingleSource/Benchmarks/Shootout/sieve

-100.00%

0.0200

0.0000

-

0.00%	0.0078

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

-100.00%

0.0077

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-08-02-CastTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2003-07-06-IntOverflow

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-07-10-SignConversions

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-08-11-VaListArg

-100.00%

0.0300

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/UnitTests/Threads/tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0045

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Benchmarks/Misc/flops-5

-66.67%

0.0300

0.0100

-

0.00%	0.0083
SingleSource/Benchmarks/Misc/flops-7

-66.67%

0.0300

0.0100

-

-66.67%

0.0100

MultiSource/Benchmarks/McCat/15-trie/trie

-50.00%

0.0400

0.0200

-

-50.00%

0.0108

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

-33.33%

0.0064

SingleSource/Benchmarks/Dhrystone/dry

-50.00%

0.0400

0.0200

-

-50.00%

0.0102

SingleSource/Benchmarks/Misc/flops-6

-50.00%

0.0200

0.0100

-

-66.67%

0.0060

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

-50.00%

0.0089

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

0.00%	0.0075
SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-50.00%

0.0400

0.0200

-

-33.33%

0.0070

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%	0.0067
SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0081

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

MultiSource/Benchmarks/FreeBench/mason/mason

-42.86%

0.0700

0.0400

-

-20.00%

0.0063

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0054

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

-25.00%

0.0070

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

0.00%	0.0127

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

-20.00%	0.0081
SingleSource/Benchmarks/CoyoteBench/huffbench	-33.33%	0.0900	0.0600	-	-14.29%	0.0064
SingleSource/Benchmarks/Shootout/lists

-33.33%

0.0600

0.0400

-

-33.33%

0.0054
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-30.00%	0.1000	0.0700	-	-30.00%	0.0150
SingleSource/Benchmarks/Misc/ffbench

-28.57%

0.0700

0.0500

-

-16.67%

0.0066

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-27.27%

0.1100

0.0800

-

14.29%	0.0137
MultiSource/Benchmarks/FreeBench/distray/distray

-25.00%

0.0800

0.0600

-

-14.29%

0.0075

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0094

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

50.00%	0.0075
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

-25.00%

0.0092

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

-25.00%

0.0094

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

50.00%

0.0049

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

0.00%	0.0070

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

0.00%	0.0075

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%	0.0087

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

20.00%	0.0075
MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

-33.33%

0.0054

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-33.33%	0.0102

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-33.33%	0.0070

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0054

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

0.00%	0.0060
MultiSource/Benchmarks/Ptrdist/ks/ks

-18.18%

0.1100

0.0900

-

-25.00%

0.0083

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

-14.29%

0.0700

0.0600

-

-25.00%

0.0110

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

50.00%	0.0092
MultiSource/Benchmarks/Prolangs-C/loader/loader

-13.04%

0.2300

0.2000

-

-13.04%

0.0120

MultiSource/Benchmarks/SciMark2-C/scimark2

-13.04%

0.2300

0.2000

-

-4.76%	0.0189

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

-11.11%	0.0128
SingleSource/Benchmarks/Shootout-C++/random	-11.11%	0.1800	0.1600	-	-11.11%	0.0141
SingleSource/Benchmarks/Shootout-C++/strcat	-11.11%	0.1800	0.1600	-	-15.79%	0.0083
MultiSource/Benchmarks/McCat/08-main/main

-10.53%

0.1900

0.1700

-

-5.56%

0.0163

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

-10.00%	0.0050

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

0.00%	0.0078
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	-9.52%	0.4200	0.3800	-	-7.32%	0.0417

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-9.09%

0.5500

0.5000

-

-1.96%	0.0169

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%	0.0049
SingleSource/Benchmarks/Misc-C++/Large/ray	-7.69%	0.2600	0.2400	-	-11.11%	0.0120
SingleSource/Benchmarks/Misc/ReedSolomon

-6.25%

0.1600

0.1500

-

-6.25%

0.0094

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0080

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

0.00%	0.0087

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

-5.00%

0.2000

0.1900

-

-5.00%

0.0127

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

25.00%

0.0060

MultiSource/Benchmarks/McCat/08-main/main

-25.00%

0.0400

0.0300

-

-25.00%

0.0030

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

-14.29%	0.0066

MultiSource/Benchmarks/Olden/treeadd/treeadd

-23.81%

0.2100

0.1600

-

-5.88%	0.0206

MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan

-20.00%

0.0500

0.0400

-

-33.33%	0.0060

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-6.45%	0.0221
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

20.00%

0.0081
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame	-8.33%	0.2400	0.2200	-	-8.33%	0.0040

SingleSource/Benchmarks/Shootout/strcat

-7.69%

0.1300

0.1200

-

0.00%	0.0140
SingleSource/Benchmarks/Misc-C++/Large/ray	-6.52%	3.2200	3.0100	-	-0.33%	0.0030

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%	0.0046

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.00%

0.0467

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.53s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153958	2012-04-03 16:41:02	0:14:28
Previous

153957

2012-04-03 16:01:09

0:14:33

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	93
Performance Improvements	13	95
Existing Failures	8	8
Unchanged Tests	864	692
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Execution Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Applications/JM/ldecod/ldecod	40.00%	0.0500	0.0700	0.0064	0.00%	-
MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

0.0030

7.69%

-

MultiSource/Benchmarks/Ptrdist/bc/bc	6.12%	0.4900	0.5200	0.0050	4.00%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/BenchmarkGame/recursive	-100.00%	0.0300	0.0000	0.0077	-100.00%	-
SingleSource/Benchmarks/Shootout/fib2	-100.00%	0.0200	0.0000	0.0040	0.00%	-
SingleSource/Regression/C++/fixups

-100.00%

0.0200

0.0000

0.0050

-100.00%

-

SingleSource/Regression/C/DuffsDevice	-100.00%	0.0200	0.0000	0.0064	-100.00%	-
SingleSource/UnitTests/2002-05-02-ArgumentTest

-100.00%

0.0100

0.0000

0.0030

0.00%

-

SingleSource/Regression/C++/EH/function_try_block	-66.67%	0.0300	0.0100	0.0049	-66.67%	-
SingleSource/Benchmarks/Shootout-C++/matrix	-15.00%	0.2000	0.1700	0.0078	-19.05%	-
SingleSource/Benchmarks/Shootout-C++/wc	-14.29%	0.2100	0.1800	0.0064	-14.29%	-
SingleSource/Benchmarks/Misc-C++-EH/spirit	-2.49%	4.0200	3.9200	0.0191	0.51%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/hash2	-7.69%	2.7300	2.5200	0.0409	-0.79%	-
SingleSource/Benchmarks/McGill/misr	-5.26%	0.1900	0.1800	0.0000	-5.26%	-
SingleSource/UnitTests/Vector/build2	-1.63%	1.2300	1.2100	0.0046	-1.63%	-
SingleSource/Benchmarks/Misc/flops-6	-1.42%	1.4100	1.3900	0.0063	-1.42%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0046

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

-25.00%

0.0104

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

16.67%

0.0087

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%	0.0040

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

-33.33%	0.0075

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

0.00%	0.0066

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%	0.0067
SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

-20.00%	0.0049
SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

100.00%

0.0070

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0000
SingleSource/Regression/C++/short_circuit_dtor	100.00%	0.0100	0.0200	-	0.00%	0.0040

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

-33.33%

0.0092

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0070

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

0.00%	0.0049

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%	0.0046
SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

100.00%

0.0064

MultiSource/Benchmarks/BitBench/uudecode/uudecode

66.67%

0.0300

0.0500

-

25.00%

0.0064

MultiSource/Benchmarks/Olden/mst/mst

66.67%

0.0600

0.1000

-

25.00%	0.0133

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%	0.0128
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	50.00%	0.1400	0.2100	-	31.25%	0.0175

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

42.86%

0.0700

0.1000

-

66.67%	0.0136

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

41.18%

0.1700

0.2400

-

-11.11%

0.0199

MultiSource/Benchmarks/Ptrdist/ft/ft

40.00%

0.1000

0.1400

-

-6.67%

0.0110

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

0.00%

0.0117

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

-20.00%

0.0078

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0078

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%	0.0078

SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

0.00%	0.0078
SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0040

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%	0.0078

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

25.00%

0.1600

0.2000

-

0.00%	0.0156
MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0064

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

0.00%

0.0060

SingleSource/Regression/C++/ofstream_ctor

18.75%

0.1600

0.1900

-

5.56%	0.0111

MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

5.26%	0.0078
MultiSource/Applications/lambda-0_1_3/lambda	17.02%	0.4700	0.5500	-	5.77%	0.0102

MultiSource/Benchmarks/FreeBench/neural/neural

16.67%

0.1200

0.1400

-

0.00%	0.0054

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

-12.50%

0.0094

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

16.67%

0.0600

0.0700

-

-12.50%

0.0104

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

16.67%

0.0064
MultiSource/Benchmarks/VersaBench/8b10b/8b10b	16.67%	0.0600	0.0700	-	75.00%	0.0127
SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

16.67%

0.0070

SingleSource/Benchmarks/Misc/fbench

16.67%

0.0600

0.0700

-

40.00%

0.0142

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%	0.0060
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

15.38%

0.1300

0.1500

-

7.14%

0.0078
MultiSource/Benchmarks/Olden/voronoi/voronoi	15.00%	0.2000	0.2300	-	9.52%	0.0141

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

14.29%

0.1400

0.1600

-

-15.79%	0.0126

MultiSource/Benchmarks/Olden/bh/bh

13.64%

0.2200

0.2500

-

13.64%

0.0100

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

6.25%

0.0130

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

5.88%

0.0050
MultiSource/Benchmarks/VersaBench/dbms/dbms	12.28%	0.5700	0.6400	-	4.92%	0.0427

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

11.11%

0.1800

0.2000

-

0.00%	0.0173

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

0.00%

0.0133

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

-4.76%

0.0102

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

-9.09%	0.0075

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

6.45%	0.0130
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

10.00%

0.2000

0.2200

-

15.79%

0.0117

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%	0.0081

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

-4.00%	0.0100

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

0.00%

0.0200

MultiSource/Benchmarks/mediabench/gsm/toast/toast

8.25%

0.9700

1.0500

-

-2.78%	0.0358
SingleSource/Benchmarks/Misc-C++/Large/ray	7.69%	0.2600	0.2800	-	16.67%	0.0151
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	6.25%	0.4800	0.5100	-	6.25%	0.0128

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

-5.00%	0.0087

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

18.75%	0.0104

MultiSource/Applications/spiff/spiff

5.26%

0.5700

0.6000

-

-10.45%	0.0324

MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

17.65%	0.0192

SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

11.11%	0.0081
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	5.17%	0.5800	0.6100	-	7.02%	0.0293

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%

0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0045

SingleSource/Benchmarks/Shootout-C++/moments

25.00%

0.0400

0.0500

-

25.00%

0.0143

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%	0.0204

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%	0.0060

SingleSource/Benchmarks/Shootout-C++/lists1

15.79%

0.1900

0.2200

-

4.76%

0.0060

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

12.50%

0.1600

0.1800

-

12.50%

0.0064
MultiSource/Applications/oggenc/oggenc	7.69%	0.1300	0.1400	-	7.69%	0.0030
SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

16.67%

0.0141

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0049

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

0.00%

0.0323

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

6.67%

0.3000

0.3200

-

0.00%

0.0120

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0046

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/BenchmarkGame/recursive

-100.00%

0.0200

0.0000

-

-100.00%

0.0077

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0089

SingleSource/Regression/C++/fixups

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/DuffsDevice

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-05-02-DependentPHI

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2003-08-05-CastFPToUint

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2003-08-20-FoldBug

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%

0.0049

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-75.00%

0.0400

0.0100

-

-66.67%

0.0089

SingleSource/Benchmarks/Misc/flops-3

-66.67%

0.0300

0.0100

-

-50.00%

0.0070

SingleSource/Benchmarks/Misc/flops-7

-66.67%

0.0300

0.0100

-

0.00%	0.0089
SingleSource/Benchmarks/Misc/flops-8

-66.67%

0.0300

0.0100

-

-50.00%

0.0083

SingleSource/Benchmarks/Misc/mandel-2

-66.67%

0.0300

0.0100

-

-50.00%

0.0110

SingleSource/Regression/C++/EH/function_try_block

-66.67%

0.0300

0.0100

-

-66.67%

0.0049

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-50.00%

0.0400

0.0200

-

-50.00%

0.0075

SingleSource/Benchmarks/BenchmarkGame/puzzle

-50.00%

0.0400

0.0200

-

-33.33%

0.0089

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

-33.33%

0.0083

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

-66.67%

0.0100

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%	0.0067
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-50.00%

0.0400

0.0200

-

0.00%	0.0070

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0054

SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-25.00%

0.0054

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%	0.0080
MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

25.00%

0.0063

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

-28.57%	0.0119

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-27.27%

0.1100

0.0800

-

0.00%	0.0143

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-40.00%

0.0087

MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

50.00%

0.0112

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

0.00%	0.0090

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

0.00%	0.0050

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

0.00%

0.0064

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

0.00%

0.0075

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%	0.0063
SingleSource/Benchmarks/Shootout-C++/matrix	-19.05%	0.2100	0.1700	-	-15.00%	0.0078
MultiSource/Benchmarks/Olden/em3d/em3d

-15.38%

0.1300

0.1100

-

-26.67%

0.0187
SingleSource/Benchmarks/Shootout-C++/wordfreq	-15.38%	0.2600	0.2200	-	-15.38%	0.0147
SingleSource/Benchmarks/Shootout-C++/wc	-14.29%	0.2100	0.1800	-	-14.29%	0.0064

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

-13.33%

0.1500

0.1300

-

-7.14%

0.0119

SingleSource/Benchmarks/Shootout-C++/lists

-13.04%

0.2300

0.2000

-

-16.67%	0.0141

MultiSource/Benchmarks/McCat/05-eks/eks

-12.50%

0.4000

0.3500

-

-10.26%	0.0265
SingleSource/Benchmarks/Shootout-C++/hello

-12.50%

0.1600

0.1400

-

-12.50%

0.0136

SingleSource/Benchmarks/Shootout-C++/sumcol

-11.11%

0.1800

0.1600

-

-11.11%

0.0090

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-10.91%

0.5500

0.4900

-

-2.00%	0.0169

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

-18.18%

0.0185

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%	0.0049
SingleSource/Benchmarks/Misc/himenobmtxpa	-7.69%	0.1300	0.1200	-	-14.29%	0.0080
SingleSource/Benchmarks/Shootout-C++/ackermann

-6.25%

0.1600

0.1500

-

-16.67%

0.0111

MultiSource/Applications/obsequi/Obsequi

-5.75%

0.8700

0.8200

-

-4.65%

0.0234

SingleSource/Benchmarks/Shootout-C++/hash2

-5.71%

0.3500

0.3300

-

-2.94%

0.0070

SingleSource/Benchmarks/Adobe-C++/functionobjects

-5.56%

0.3600

0.3400

-

-5.56%	0.0148

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

0.00%

0.0090

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout-C++/ary

-66.67%

0.0300

0.0100

-

-50.00%

0.0075

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-16.67%

0.0081

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

0.00%	0.0078
SingleSource/Benchmarks/Shootout-C++/strcat

-25.00%

0.0800

0.0600

-

-14.29%

0.0120

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%	0.0070

MultiSource/Benchmarks/Olden/treeadd/treeadd

-14.29%

0.2100

0.1800

-

12.50%	0.0219
MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

-6.90%

0.0176

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.33%	0.0045

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

-0.21%	0.0471
SingleSource/Benchmarks/McGill/misr	-5.26%	0.1900	0.1800	-	-5.26%	0.0000

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.48s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153959	2012-04-03 17:06:00	0:14:29
Previous

153958

2012-04-03 16:41:02

0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	8	101
Performance Improvements	15	105
Existing Failures	8	8
Unchanged Tests	857	674
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/FreeBench/mason/mason	40.00%	0.0500	0.0700	0.0054	0.00%	-
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1	30.00%	0.1000	0.1300	0.0070	18.18%	-
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	18.18%	0.1100	0.1300	0.0060	44.44%	-
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	12.94%	0.8500	0.9600	0.0254	7.87%	-
SingleSource/Benchmarks/Shootout-C++/objinst	11.11%	0.1800	0.2000	0.0070	17.65%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/MallocBench/espresso/espresso	4.76%	0.4200	0.4400	0.0046	2.33%	-
MultiSource/Applications/SIBsim4/SIBsim4	3.03%	3.6300	3.7400	0.0335	0.27%	-

SingleSource/Benchmarks/Stanford/FloatMM

2.44%

0.4100

0.4200

0.0030

0.00%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0200

0.0000

0.0064

-100.00%

-

SingleSource/UnitTests/FloatPrecision

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Benchmarks/McGill/misr	-33.33%	0.0600	0.0400	0.0049	-33.33%	-
SingleSource/Benchmarks/Misc/richards_benchmark

-20.00%

0.0500

0.0400

0.0000

-20.00%

-

MultiSource/Benchmarks/Olden/bh/bh	-20.00%

0.2500

0.2000

0.0114

-9.09%

-

SingleSource/Regression/C++/ofstream_ctor	-15.79%	0.1900	0.1600	0.0098	0.00%	-
MultiSource/Benchmarks/McCat/18-imp/imp	-13.79%	0.2900	0.2500	0.0066	-10.71%	-
SingleSource/Benchmarks/Shootout-C++/reversefile	-13.79%	0.2900	0.2500	0.0100	-13.79%	-
SingleSource/Benchmarks/Misc/oourafft	-11.11%	0.1800	0.1600	0.0049	0.00%	-
SingleSource/Benchmarks/Shootout-C++/ary	-9.09%	0.2200	0.2000	0.0064	0.00%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-42.86%	0.0700	0.0400	0.0066	-42.86%	-
SingleSource/Benchmarks/Shootout-C++/lists1	-13.64%	0.2200	0.1900	0.0070	0.00%	-
MultiSource/Benchmarks/FreeBench/distray/distray	-7.14%	0.1400	0.1300	0.0000	-7.14%	-
SingleSource/Benchmarks/Shootout-C++/methcall	-2.98%	4.7000	4.5600	0.0467	-8.80%	-
SingleSource/Benchmarks/Misc/ffbench	-2.82%	0.7100	0.6900	0.0046	-2.82%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

50.00%

0.0070

SingleSource/Benchmarks/Misc/fp-convert

200.00%

0.0100

0.0300

-

50.00%

0.0070

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

0.00%	0.0104
SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0049

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

33.33%

0.0054

SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

0.00%	0.0075
SingleSource/Regression/C++/EH/throw_rethrow_test

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/Regression/C++/pointer_method	100.00%	0.0100	0.0200	-	0.00%	0.0000
SingleSource/Regression/C++/short_circuit_dtor	100.00%	0.0100	0.0200	-	0.00%	0.0040

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

100.00%

0.0090

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

100.00%

0.0092

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

100.00%

0.0063

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

76.47%

0.1700

0.3000

-

25.00%	0.0216

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

-28.57%	0.0090

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

66.67%	0.0092
SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

25.00%

0.0066

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%

0.0127
MultiSource/Benchmarks/Fhourstones/fhourstones	50.00%	0.0800	0.1200	-	33.33%	0.0137
MultiSource/Benchmarks/McCat/15-trie/trie	50.00%	0.0400	0.0600	-	100.00%	0.0112
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	44.44%	0.0900	0.1300	-	18.18%	0.0060

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

42.86%

0.0700

0.1000

-

0.00%	0.0143

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

42.86%

0.1400

0.2000

-

-4.76%	0.0190

MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

16.67%

0.0089

MultiSource/Benchmarks/Ptrdist/ft/ft

40.00%

0.1000

0.1400

-

0.00%	0.0100

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

16.67%	0.0089
MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

-20.00%

0.0075

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

33.33%	0.0108
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

33.33%

0.0081

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0078

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

33.33%

0.0060

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%

0.0067

SingleSource/UnitTests/Vector/SSE/sse_shift	33.33%	0.0300	0.0400	-	0.00%	0.0040
SingleSource/UnitTests/initp1	33.33%	0.0300	0.0400	-	0.00%	0.0078

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

66.67%	0.0089
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

25.00%

0.0400

0.0500

-

25.00%

0.0102

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

0.00%	0.0066
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

25.00%

0.0400

0.0500

-

66.67%

0.0080

SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

66.67%

0.0066

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

25.00%

0.0111

MultiSource/Benchmarks/Olden/health/health

22.22%

0.0900

0.1100

-

10.00%

0.0127
MultiSource/Applications/lambda-0_1_3/lambda	19.15%	0.4700	0.5600	-	1.82%	0.0128

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

18.18%	0.0094
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1	18.18%	0.1100	0.1300	-	30.00%	0.0070
SingleSource/Benchmarks/Shootout-C++/objinst

17.65%

0.1700

0.2000

-

11.11%

0.0070

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%	0.0066

SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

0.00%	0.0070
MultiSource/Benchmarks/VersaBench/dbms/dbms	15.79%	0.5700	0.6600	-	3.13%	0.0449

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

15.00%

0.2000

0.2300

-

4.55%	0.0134

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

0.00%	0.0125

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

12.50%

0.1600

0.1800

-

-10.00%	0.0169

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

20.00%	0.0136

MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

11.11%	0.0125
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	11.11%	0.1800	0.2000	-	5.26%	0.0087

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

11.11%	0.0090

SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

25.00%	0.0120
MultiSource/Benchmarks/McCat/08-main/main

10.53%

0.1900

0.2100

-

5.00%

0.0181

MultiSource/Benchmarks/Olden/voronoi/voronoi

10.00%

0.2000

0.2200

-

-4.35%	0.0150

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0102

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

0.00%

0.0200

MultiSource/Applications/spiff/spiff

8.77%

0.5700

0.6200

-

3.33%	0.0324
MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

8.70%

0.0166
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	8.62%	0.5800	0.6300	-	3.28%	0.0269

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

-7.14%	0.0060
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	7.87%	0.8900	0.9600	-	12.94%	0.0254
MultiSource/Benchmarks/sim/sim	7.69%	0.2600	0.2800	-	7.69%	0.0111

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

-6.67%	0.0087
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	7.60%	3.4200	3.6800	-	2.51%	0.0535
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

7.50%

0.4000

0.4300

-

7.50%

0.0233

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

-3.03%

0.0141
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	5.71%	0.7000	0.7400	-	2.78%	0.0245
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

-5.00%

0.0174

SingleSource/Benchmarks/Adobe-C++/functionobjects

5.56%

0.3600

0.3800

-

11.76%	0.0155
SingleSource/Benchmarks/Shootout-C++/random

5.56%

0.1800

0.1900

-

5.56%

0.0135

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

0.00%	0.0104
MultiSource/Benchmarks/Prolangs-C/simulator/simulator	5.36%	0.5600	0.5900	-	5.36%	0.0185

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%	0.0049

SingleSource/Benchmarks/Shootout-C++/moments

75.00%

0.0400

0.0700

-

40.00%

0.0120

SingleSource/Benchmarks/Stanford/Quicksort

66.67%

0.0300

0.0500

-

25.00%

0.0046

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0066

SingleSource/Benchmarks/Shootout-C++/ary2

33.33%

0.0300

0.0400

-

33.33%

0.0102

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0045

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

-0.60%

0.0200

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/lists	13.18%	4.9300	5.5800	-	13.18%	0.2142
SingleSource/Benchmarks/Shootout-C++/hash2	11.02%	2.5400	2.8200	-	11.90%	0.0682
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	9.09%	0.2200	0.2400	-	14.29%	0.0150

MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

-

0.00%

0.0045

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0049

SingleSource/Benchmarks/BenchmarkGame/Large/fasta	5.88%	0.8500	0.9000	-	3.45%	0.0128

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0049

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0030

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-100.00%

0.0200

0.0000

-

-100.00%

0.0054

SingleSource/Regression/C/matrixTranspose

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2002-05-03-NotTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-12-13-MishaTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2003-08-20-FoldBug

-100.00%

0.0200

0.0000

-

0.00%	0.0070
SingleSource/UnitTests/FloatPrecision

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-33.33%

0.0049

SingleSource/Benchmarks/Misc/flops-6

-50.00%

0.0200

0.0100

-

-50.00%

0.0063

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

-50.00%

0.0092

SingleSource/Benchmarks/Shootout/strcat

-50.00%

0.0200

0.0100

-

-66.67%

0.0078

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

0.00%	0.0063
SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%	0.0087
SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%	0.0067
SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%	0.0060

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0064

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0040

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

-40.00%	0.0077

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-42.86%

0.0127

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/McGill/misr

-33.33%

0.0600

0.0400

-

-33.33%

0.0049

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-30.00%

0.1000

0.0700

-

-30.00%

0.0162

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%	0.0104
SingleSource/Benchmarks/Misc/ffbench

-28.57%

0.0700

0.0500

-

-28.57%

0.0066

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

200.00%	0.0089
MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0070

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

-25.00%	0.0078
SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

-25.00%

0.0078

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

50.00%

0.0094

SingleSource/Benchmarks/Misc/flops

-25.00%

0.0800

0.0600

-

-14.29%

0.0049

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

50.00%

0.0077

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

-14.29%

0.0064

MultiSource/Benchmarks/Olden/tsp/tsp

-22.22%

0.0900

0.0700

-

-12.50%

0.0125

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%

0.0063

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

-20.00%

0.0122

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

-11.11%

0.0049

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

33.33%	0.0060

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

-20.00%	0.0046
SingleSource/Benchmarks/Misc/richards_benchmark

-20.00%

0.0500

0.0400

-

-20.00%

0.0000

SingleSource/UnitTests/SignlessTypes/rem

-20.00%

0.1000

0.0800

-

-20.00%

0.0078

SingleSource/Benchmarks/Shootout-C++/wc	-19.05%	0.2100	0.1700	-	-5.56%	0.0094
SingleSource/Benchmarks/Misc/ReedSolomon	-18.75%	0.1600	0.1300	-	-18.75%	0.0089

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-18.18%

0.1100

0.0900

-

12.50%	0.0143
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-14.29%

0.0136

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-14.29%

0.0700

0.0600

-

-25.00%

0.0154

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

-14.29%

0.0092
SingleSource/Benchmarks/Shootout-C++/reversefile	-13.79%	0.2900	0.2500	-	-13.79%	0.0100

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

-13.33%

0.1500

0.1300

-

0.00%	0.0125
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

-11.11%

0.0128
MultiSource/Benchmarks/McCat/18-imp/imp	-10.71%	0.2800	0.2500	-	-13.79%	0.0066

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

0.00%	0.0185

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-9.09%

0.5500

0.5000

-

2.04%	0.0178
MultiSource/Benchmarks/Olden/bh/bh	-9.09%	0.2200	0.2000	-	-20.00%	0.0114
SingleSource/Benchmarks/Shootout-C++/ary2	-8.70%	0.2300	0.2100	-	-4.55%	0.0083

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%	0.0049

SingleSource/Benchmarks/Misc/himenobmtxpa

-7.69%

0.1300

0.1200

-

0.00%	0.0080

MultiSource/Applications/obsequi/Obsequi

-6.90%

0.8700

0.8100

-

-1.22%	0.0240

SingleSource/Benchmarks/Shootout-C++/hash

-6.06%

0.3300

0.3100

-

-8.82%	0.0128

SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

-5.88%	0.0075

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

-10.00%	0.0081

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

0.00%

0.0092

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-42.86%	0.0102
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-42.86%

0.0700

0.0400

-

-42.86%

0.0066

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

0.00%	0.0080
SingleSource/Benchmarks/Misc-C++/bigfib	-20.59%	0.3400	0.2700	-	-18.18%	0.0195
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049
SingleSource/Benchmarks/Shootout-C++/hash	-10.64%	0.4700	0.4200	-	-6.67%	0.0122
MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

5.56%

0.0218
SingleSource/Benchmarks/Shootout-C++/methcall	-8.80%	5.0000	4.5600	-	-2.98%	0.0467
MultiSource/Applications/spiff/spiff	-8.06%	1.8600	1.7100	-	-5.00%	0.0454
MultiSource/Benchmarks/FreeBench/distray/distray

-7.14%

0.1400

0.1300

-

-7.14%

0.0000

MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

0.00%

0.0164

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0030

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.46s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153960	2012-04-03 17:49:03	0:14:30
Previous

153959

2012-04-03 17:06:00

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	5	85
Performance Improvements	11	124
Existing Failures	8	8
Unchanged Tests	864	671
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/dt	100.00%	0.0200	0.0400	0.0049	0.00%	-
MultiSource/Applications/hbd/hbd	11.01%	1.0900	1.2100	0.0215	12.04%	-
SingleSource/Benchmarks/Shootout-C++/hash2	5.88%	0.3400	0.3600	0.0075	2.86%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/sieve	5.59%	1.6100	1.7000	0.0262	2.41%	-
SingleSource/Benchmarks/Misc/oourafft	1.43%	5.6000	5.6800	0.0228	1.61%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Stanford/Perm	-100.00%	0.0300	0.0000	0.0064	-100.00%	-
SingleSource/Regression/C++/short_circuit_dtor

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/UnitTests/stmtexpr

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

MultiSource/Benchmarks/BitBench/uudecode/uudecode	-50.00%	0.0400	0.0200	0.0064	-33.33%	-
SingleSource/UnitTests/Vector/SSE/sse_shift	-50.00%	0.0400	0.0200	0.0030	-33.33%	-
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	-26.32%	0.1900	0.1400	0.0151	-22.22%	-
MultiSource/Applications/sgefa/sgefa	-16.00%	0.2500	0.2100	0.0119	-16.00%	-
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	-16.00%	0.5000	0.4200	0.0143	-12.50%	-
MultiSource/Applications/minisat/minisat	-5.45%	0.5500	0.5200	0.0102	-5.45%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/ary2

-75.00%

0.0400

0.0100

0.0070

-66.67%

-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

0.00%	0.0070

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

0.00%

0.0100

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

200.00%	0.0066

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

66.67%

0.0094

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

33.33%

0.0083

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

-33.33%

0.0064

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

33.33%

0.0066

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%	0.0090

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%	0.0066

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%	0.0070

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

70.59%

0.1700

0.2900

-

-3.33%	0.0239

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

0.00%	0.0098

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%

0.0066

MultiSource/Benchmarks/Ptrdist/ft/ft

40.00%

0.1000

0.1400

-

0.00%

0.0098

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

0.00%	0.0089

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

-8.33%	0.0118

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

22.22%	0.0127

MultiSource/Applications/viterbi/viterbi

36.36%

0.1100

0.1500

-

15.38%

0.0094

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

33.33%

0.0075

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

33.33%

0.0120

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

-20.00%

0.0067

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

33.33%

0.0083

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

33.33%

0.0900

0.1200

-

-7.69%	0.0089

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%	0.0100

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

13.33%	0.0162
MultiSource/Benchmarks/McCat/08-main/main	21.05%	0.1900	0.2300	-	9.52%	0.0181

MultiSource/Applications/lambda-0_1_3/lambda

19.15%

0.4700

0.5600

-

0.00%	0.0161
MultiSource/Benchmarks/Olden/mst/mst

16.67%

0.0600

0.0700

-

16.67%

0.0145

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

40.00%

0.0077

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

14.29%

0.1400

0.1600

-

-20.00%

0.0194

MultiSource/Benchmarks/McCat/09-vor/vor

13.04%

0.2300

0.2600

-

13.04%	0.0183

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

12.50%	0.0067
SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

12.50%

0.0128
MultiSource/Applications/spiff/spiff	12.28%	0.5700	0.6400	-	3.23%	0.0319

MultiSource/Benchmarks/VersaBench/dbms/dbms

12.28%

0.5700

0.6400

-

-3.03%	0.0421
MultiSource/Applications/hbd/hbd	12.04%	1.0800	1.2100	-	11.01%	0.0215

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

3.13%	0.0140
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

10.00%

0.2000

0.2200

-

-4.35%

0.0160

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0090

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

3.39%

0.0176

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%	0.0060
MultiSource/Benchmarks/nbench/nbench	7.14%	0.8400	0.9000	-	4.65%	0.0181

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-5.88%

0.0122

SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

3.23%	0.0140

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

-2.35%	0.0206
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

6.25%

0.1600

0.1700

-

-5.56%

0.0169

MultiSource/Applications/Burg/burg

5.95%

0.8400

0.8900

-

3.49%

0.0339

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

-5.00%

0.0080

SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

5.56%

0.0108

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

0.00%

0.0104

Performance Regressions - Execution Time

Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/SignlessTypes/Large/cast

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/ary

66.67%

0.0300

0.0500

-

66.67%

0.0090

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%

0.0087

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%	0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

29.17%

0.7200

0.9300

-

-1.06%

0.0045

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

0.00%	0.0060

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

0.00%

0.0204

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

10.53%	0.0090

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

8.70%

0.6900

0.7500

-

8.70%	0.0320
SingleSource/Benchmarks/Shootout/strcat	7.69%	0.1300	0.1400	-	7.69%	0.0130

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0046
SingleSource/Benchmarks/Shootout-C++/hash2	7.09%	2.5400	2.7200	-	-3.55%	0.0793

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%	0.0049
MultiSource/Benchmarks/nbench/nbench	6.15%	16.9200	17.9600	-	6.02%	0.9437

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/ary3

-100.00%

0.0200

0.0000

-

-100.00%

0.0092

SingleSource/Benchmarks/Stanford/Perm

-100.00%

0.0300

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C++/BuiltinTypeInfo

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C++/EH/ConditionalExpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0089

SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

-100.00%

0.0070

SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

-100.00%

0.0077

SingleSource/Regression/C++/short_circuit_dtor

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0030

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0083

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/2002-05-02-CastTest2

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0100

0.0000

-

0.00%	0.0081
SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

-

-100.00%

0.0081

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/Threads/tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0045

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/stmtexpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-50.00%

0.0078

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-50.00%

0.0094

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

-50.00%

0.0090

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%	0.0060
SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-40.00%

0.1000

0.0600

-

-14.29%	0.0163

SingleSource/Benchmarks/McGill/misr

-33.33%

0.0600

0.0400

-

0.00%	0.0067
MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

-28.57%

0.0077

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-16.67%

0.0136

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%

0.0100

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%	0.0083
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

-40.00%

0.0102

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

0.00%	0.0070

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%	0.0075

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

-40.00%	0.0092
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

-25.00%

0.0077

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

0.00%	0.0066

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

0.00%	0.0070

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-40.00%	0.0075
SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0070

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

50.00%

0.0070

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

0.00%	0.0077
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	-22.22%	0.1800	0.1400	-	-26.32%	0.0151

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%

0.0070

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-20.00%

0.0500

0.0400

-

33.33%

0.0040

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-20.00%

0.1000

0.0800

-

-11.11%

0.0174

MultiSource/Benchmarks/NPB-serial/is/is

-20.00%

0.0500

0.0400

-

-20.00%

0.0049

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-20.00%

0.0070

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

0.00%	0.0049

SingleSource/UnitTests/SignlessTypes/rem

-20.00%

0.1000

0.0800

-

0.00%	0.0083

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-18.18%

0.1100

0.0900

-

0.00%	0.0143
MultiSource/Applications/sgefa/sgefa	-16.00%	0.2500	0.2100	-	-16.00%	0.0119

MultiSource/Benchmarks/Olden/em3d/em3d

-15.38%

0.1300

0.1100

-

-15.38%	0.0118

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

-14.29%

0.0700

0.0600

-

-40.00%	0.0149

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-14.29%

0.0700

0.0600

-

0.00%	0.0150
SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

20.00%

0.0075
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	-12.50%	0.4800	0.4200	-	-16.00%	0.0143

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

7.69%	0.0100
SingleSource/Benchmarks/Shootout-C++/wordfreq	-11.54%	0.2600	0.2300	-	-8.00%	0.0163

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

0.00%	0.0128

SingleSource/Benchmarks/Shootout-C++/sumcol

-11.11%

0.1800

0.1600

-

-20.00%	0.0128
SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-5.56%

0.0046

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

12.50%	0.0064

SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

11.76%	0.0133
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-9.45%	1.2700	1.1500	-	-4.96%	0.0376

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

-4.76%	0.0094
SingleSource/Benchmarks/Shootout-C++/sieve	-8.33%	0.2400	0.2200	-	-12.00%	0.0112

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%	0.0049
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-14.29%

0.0083

MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk

-7.32%

0.4100

0.3800

-

-7.32%

0.0160
MultiSource/Benchmarks/McCat/18-imp/imp	-7.14%	0.2800	0.2600	-	4.00%	0.0127

MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl

-7.14%

0.7000

0.6500

-

-12.16%	0.0287

MultiSource/Applications/obsequi/Obsequi

-6.90%

0.8700

0.8100

-

0.00%	0.0254

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

-6.67%

0.4500

0.4200

-

-10.64%	0.0244

SingleSource/Benchmarks/Shootout-C++/ackermann

-6.25%

0.1600

0.1500

-

-16.67%

0.0136

SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

0.00%	0.0075

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

-11.11%	0.0080
MultiSource/Applications/minisat/minisat	-5.45%	0.5500	0.5200	-	-5.45%	0.0102

SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction

-5.00%

0.4000

0.3800

-

-5.00%

0.0090

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

-100.00%

0.0100

0.0000

-

-100.00%

0.0112

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/Benchmarks/Shootout-C++/ary2

-66.67%

0.0300

0.0100

-

-75.00%	0.0070
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-42.86%

0.0700

0.0400

-

-20.00%

0.0080

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

25.00%

0.0102

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

-14.29%

0.0075
MultiSource/Benchmarks/Olden/health/health	-17.24%	0.2900	0.2400	-	-11.11%	0.0160
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%

0.0064

MultiSource/Benchmarks/Olden/treeadd/treeadd

-14.29%

0.2100

0.1800

-

-5.26%	0.0181

SingleSource/Benchmarks/Misc-C++/bigfib

-8.82%

0.3400

0.3100

-

14.81%	0.0211

MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame

-8.33%

0.2400

0.2200

-

-4.35%

0.0054

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.52%

3.2200

3.0100

-

-0.33%

0.0030

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

4.76%	0.0149
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

-6.25%

0.1600

0.1500

-

-6.25%

0.0066
SingleSource/Benchmarks/Shootout-C++/methcall	-6.00%	5.0000	4.7000	-	3.07%	0.0596

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153961	2012-04-03 18:13:47	0:14:28
Previous

153960

2012-04-03 17:49:03

0:14:30

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	4	94
Performance Improvements	12	99
Existing Failures	8	8
Unchanged Tests	864	687
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Olden/mst/mst	71.43%	0.0700	0.1200	0.0145	100.00%	-
SingleSource/Benchmarks/Shootout/heapsort	66.67%	0.0300	0.0500	0.0070	25.00%	-
MultiSource/Benchmarks/Prolangs-C++/city/city	2.38%	1.2600	1.2900	0.0102	2.38%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/CoyoteBench/almabench

1.42%

13.3900

13.5800

0.0348

1.42%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/2003-05-14-expr_stmt

-100.00%

0.0100

0.0000

0.0030

0.00%

-

SingleSource/UnitTests/2005-07-15-Bitfield-ABI	-100.00%	0.0100	0.0000	0.0000	0.00%	-
SingleSource/UnitTests/blockstret

-100.00%

0.0100

0.0000

0.0030

0.00%

-

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm	-66.67%	0.0300	0.0100	0.0064	-75.00%	-
SingleSource/Benchmarks/Misc/lowercase	-66.67%	0.0300	0.0100	0.0050	-66.67%	-
SingleSource/UnitTests/2003-05-07-VarArgs

-66.67%

0.0300

0.0100

0.0049

-66.67%

-

SingleSource/Benchmarks/Misc/mandel	-60.00%

0.0500

0.0200

0.0054

-60.00%

-

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-50.00%	0.1200	0.0600	0.0094	-33.33%	-
SingleSource/Benchmarks/Shootout/matrix	-42.86%	0.0700	0.0400	0.0064	-20.00%	-
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-13.56%	0.5900	0.5100	0.0262	-12.07%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

0.0030

-25.00%

-

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	-22.22%	0.0900	0.0700	0.0066	-22.22%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

33.33%	0.0094

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%	0.0066

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

0.00%	0.0094
MultiSource/Benchmarks/Olden/mst/mst	100.00%	0.0600	0.1200	-	71.43%	0.0145

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

0.00%	0.0083
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

-33.33%

0.0075

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

20.00%	0.0104
SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

33.33%

0.0075

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%	0.0060

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

0.00%

0.0064

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers	100.00%	0.0100	0.0200	-	0.00%	0.0090
SingleSource/Regression/C/ConstructorDestructorAttributes	100.00%	0.0100	0.0200	-	0.00%	0.0066

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

100.00%

0.0092

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0090

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%	0.0050
SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

0.00%	0.0060

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%	0.0066
SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

0.00%	0.0050

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%	0.0049
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

66.67%

0.0102

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%

0.0066

MultiSource/Benchmarks/Ptrdist/ft/ft	60.00%	0.1000	0.1600	-	14.29%	0.0092

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

52.94%

0.1700

0.2600

-

-10.34%	0.0247

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

0.00%	0.0117

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

0.00%	0.0128

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

100.00%	0.0080

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

0.00%

0.0067

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

33.33%

0.0067

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0075

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

100.00%	0.0060

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

12.50%	0.0211

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

25.00%	0.0083

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%	0.0066
SingleSource/Benchmarks/Shootout/heapsort	25.00%	0.0400	0.0500	-	66.67%	0.0070

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%

0.0100

MultiSource/Benchmarks/McCat/04-bisect/bisect

22.22%

0.0900

0.1100

-

37.50%	0.0126

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

0.00%	0.0142
MultiSource/Applications/spiff/spiff	19.30%	0.5700	0.6800	-	6.25%	0.0321

MultiSource/Benchmarks/FreeBench/neural/neural

16.67%

0.1200

0.1400

-

7.69%	0.0060

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

-12.50%

0.0078

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

16.67%

0.0600

0.0700

-

-12.50%

0.0108

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%	0.0077
SingleSource/Benchmarks/Shootout/lists

16.67%

0.0600

0.0700

-

16.67%

0.0075

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

15.00%

0.2000

0.2300

-

4.55%

0.0168

MultiSource/Benchmarks/Olden/voronoi/voronoi

15.00%

0.2000

0.2300

-

15.00%	0.0100

MultiSource/Applications/lambda-0_1_3/lambda

14.89%

0.4700

0.5400

-

-3.57%	0.0185
MultiSource/Applications/Burg/burg	13.10%	0.8400	0.9500	-	6.74%	0.0333

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

12.50%

0.4000

0.4500

-

9.76%	0.0245

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

20.00%

0.0145

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

0.00%	0.0119

MultiSource/Applications/hexxagon/hexxagon

11.54%

0.7800

0.8700

-

4.82%	0.0145

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

25.00%	0.0117
SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

5.26%

0.0108
MultiSource/Benchmarks/Prolangs-C/simulator/simulator	10.71%	0.5600	0.6200	-	1.64%	0.0180

MultiSource/Benchmarks/McCat/08-main/main

10.53%

0.1900

0.2100

-

-8.70%	0.0181
MultiSource/Benchmarks/Olden/bh/bh

9.09%

0.2200

0.2400

-

4.35%

0.0127

MultiSource/Benchmarks/VersaBench/bmm/bmm

9.09%

0.2200

0.2400

-

4.35%

0.0114

MultiSource/Benchmarks/mediabench/gsm/toast/toast

8.25%

0.9700

1.0500

-

6.06%	0.0314
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des

8.00%

0.2500

0.2700

-

3.85%

0.0050

SingleSource/Benchmarks/Misc-C++/Large/sphereflake

8.00%

0.2500

0.2700

-

3.85%

0.0098

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

3.85%	0.0100
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	7.84%	1.0200	1.1000	-	8.91%	0.0324

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

0.00%	0.0125

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

-3.03%

0.0150
MultiSource/Applications/hbd/hbd	6.48%	1.0800	1.1500	-	-4.96%	0.0427

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

6.25%

0.1600

0.1700

-

0.00%	0.0162
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	5.85%	3.4200	3.6200	-	2.55%	0.0499

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

35.71%	0.0211

SingleSource/Benchmarks/Shootout-C++/random

5.56%

0.1800

0.1900

-

11.76%	0.0104

MultiSource/Benchmarks/VersaBench/dbms/dbms

5.26%

0.5700

0.6000

-

-6.25%

0.0427

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

400.00%

0.0100

0.0500

-

0.00%	0.0120

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0046

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

1.08%

0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%

0.0207

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0060

MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

-

7.69%

0.0040

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

0.00%	0.0117

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

0.00%	0.0050
SingleSource/Benchmarks/Shootout-C++/hash2	6.30%	2.5400	2.7000	-	-0.74%	0.0796

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%	0.0046
SingleSource/Benchmarks/Shootout-C++/lists1	5.26%	0.1900	0.2000	-	-4.76%	0.0090
MultiSource/Applications/sqlite3/sqlite3	5.10%	3.5300	3.7100	-	3.92%	0.0351

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/BuiltinTypeInfo

-100.00%

0.0200

0.0000

-

0.00%	0.0075

SingleSource/Regression/C++/EH/ConditionalExpr

-100.00%

0.0200

0.0000

-

0.00%	0.0075

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

0.00%	0.0087
SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-08-02-CastTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/2003-10-13-SwitchTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/FloatPrecision

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/byval-alignment

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

0.00%	0.0040

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/ms_struct-bitfield-init

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/ms_struct-bitfield-init-1

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/printargs

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-75.00%

0.0400

0.0100

-

-66.67%

0.0064

SingleSource/Benchmarks/Misc/flops-8

-66.67%

0.0300

0.0100

-

-50.00%

0.0063

SingleSource/Benchmarks/Misc/lowercase

-66.67%

0.0300

0.0100

-

-66.67%

0.0050

SingleSource/UnitTests/2003-05-07-VarArgs

-66.67%

0.0300

0.0100

-

-66.67%

0.0049

SingleSource/Benchmarks/Misc/mandel	-60.00%	0.0500	0.0200	-	-60.00%	0.0054
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-57.14%

0.0700

0.0300

-

-40.00%

0.0136

SingleSource/Benchmarks/BenchmarkGame/nsieve-bits

-50.00%

0.0200

0.0100

-

-66.67%

0.0075

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0102

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0090

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0081

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

0.00%	0.0046

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

0.00%	0.0087
SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0077

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

0.00%

0.0090

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

MultiSource/Benchmarks/FreeBench/mason/mason

-42.86%

0.0700

0.0400

-

-20.00%

0.0077
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-33.33%	0.0900	0.0600	-	-50.00%	0.0094

SingleSource/Benchmarks/McGill/misr

-33.33%

0.0600

0.0400

-

0.00%

0.0078

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-30.00%

0.1000

0.0700

-

16.67%	0.0150

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%

0.0077

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

0.00%

0.0102

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

0.00%

0.0070

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

0.00%

0.0077

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

0.00%

0.0070

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%	0.0070
SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

-14.29%

0.0063

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%

0.0075

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-20.00%

0.0500

0.0400

-

0.00%	0.0045
SingleSource/Benchmarks/Shootout/matrix

-20.00%

0.0500

0.0400

-

-42.86%

0.0064

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

-20.00%

0.1500

0.1200

-

-14.29%

0.0110

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-16.67%

0.1800

0.1500

-

-6.25%

0.0127

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

20.00%

0.0094
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-12.07%	0.5800	0.5100	-	-13.56%	0.0262
SingleSource/Benchmarks/Shootout-C++/reversefile	-10.34%	0.2900	0.2600	-	-7.14%	0.0166
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

12.50%

0.0187

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%	0.0064
SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

12.50%

0.0083

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-5.00%	0.0108

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

0.00%	0.0100

SingleSource/Benchmarks/Shootout-C++/ary2

-8.70%

0.2300

0.2100

-

-8.70%	0.0087

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

-8.16%

0.4900

0.4500

-

-8.16%

0.0194

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%

0.0049

SingleSource/Benchmarks/Misc/himenobmtxpa

-7.69%

0.1300

0.1200

-

-7.69%	0.0092

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-7.41%

0.2700

0.2500

-

-10.71%	0.0100
MultiSource/Benchmarks/Prolangs-C/bison/mybison	-6.73%	1.0400	0.9700	-	-3.96%	0.0158

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-5.45%

0.5500

0.5200

-

-3.70%	0.0192

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

5.88%

0.0046

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-57.14%

0.0700

0.0300

-

-25.00%

0.0087

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-20.00%

0.0102

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%	0.0030
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

-22.22%

0.0900

0.0700

-

-22.22%

0.0066

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049

MultiSource/Benchmarks/Olden/treeadd/treeadd

-14.29%

0.2100

0.1800

-

0.00%	0.0154

SingleSource/Benchmarks/Misc-C++/bigfib

-11.76%

0.3400

0.3000

-

-3.23%	0.0215

MultiSource/Benchmarks/Olden/health/health

-10.34%

0.2900

0.2600

-

8.33%	0.0135
MultiSource/Benchmarks/Olden/perimeter/perimeter	-8.70%	0.2300	0.2100	-	-12.50%	0.0108
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

-7.14%

0.1400

0.1300

-

-7.14%

0.0040

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.33%	0.0040

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

0.00%

0.0591

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.66s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153965	2012-04-03 20:01:37	0:14:26
Previous	153962	2012-04-03 18:38:42	0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	9	92
Performance Improvements	13	119
Existing Failures	8	8
Unchanged Tests	858	669
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/SignlessTypes/factor	100.00%	0.0200	0.0400	0.0046	33.33%	-
SingleSource/Benchmarks/Misc/perlin

50.00%

0.0400

0.0600

0.0050

20.00%

-

MultiSource/Benchmarks/Prolangs-C/agrep/agrep	11.70%	0.9400	1.0500	0.0140	10.53%	-
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame	4.62%	3.2500	3.4000	0.0316	3.98%	-
MultiSource/Benchmarks/FreeBench/pifft/pifft	4.17%	0.7200	0.7500	0.0090	5.63%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	9.17%	1.0900	1.1900	0.0249	9.17%	-
SingleSource/Benchmarks/Shootout-C++/sieve	8.86%	1.5800	1.7200	0.0361	3.61%	-
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	2.75%	1.0900	1.1200	0.0078	0.90%	-

SingleSource/Benchmarks/Misc/mandel

1.01%

0.9900

1.0000

0.0030

1.01%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)
SingleSource/Regression/C++/2003-05-14-expr_stmt	-100.00%	0.0100	0.0000	0.0030	0.00%	-

SingleSource/Regression/C/2004-03-15-IndirectGoto

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/UnitTests/DefaultInitDynArrays

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/Regression/C/PR1386	-50.00%	0.0200	0.0100	0.0030	-50.00%	-
SingleSource/Benchmarks/Shootout-C++/ary2	-13.64%	0.2200	0.1900	0.0080	-17.39%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

0.0000

-50.00%

-

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-15.62%	0.3200	0.2700	0.0100	-10.00%	-
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4	-5.26%	0.3800	0.3600	0.0054	-5.26%	-
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	-5.00%	0.2000	0.1900	0.0030	-9.52%	-
SingleSource/Benchmarks/Shootout-C++/methcall	-3.18%	4.7100	4.5600	0.0438	-8.80%	-
SingleSource/UnitTests/Vector/SSE/sse_stepfft	-2.33%	0.4300	0.4200	0.0030	5.00%	-
SingleSource/Benchmarks/Shootout/ary3	-1.11%	1.8000	1.7800	0.0070	-1.66%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc-C++/mandel-text

200.00%

0.0100

0.0300

-

50.00%

0.0081

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

-25.00%	0.0090
SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

50.00%

0.0078

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

0.00%

0.0064

MultiSource/Applications/aha/aha

100.00%

0.0500

0.1000

-

11.11%

0.0067

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%

0.0049

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

0.00%	0.0075
MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

-20.00%

0.0098

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

0.00%	0.0080

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

100.00%	0.0060
SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

0.00%

0.0049

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

-33.33%

0.0066

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

0.00%	0.0078

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

100.00%	0.0050
SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/Threads/tls

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0077
MultiSource/Benchmarks/Olden/mst/mst	83.33%	0.0600	0.1100	-	22.22%	0.0156

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

0.00%

0.0081

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

41.18%

0.1700

0.2400

-

-4.00%	0.0239

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

35.71%

0.1400

0.1900

-

18.75%	0.0141

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%	0.0075

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

0.00%	0.0110
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

0.00%

0.0075

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0064

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

100.00%	0.0067
SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

100.00%

0.0089

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

0.00%	0.0075
SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%

0.0046

SingleSource/UnitTests/SignlessTypes/factor

33.33%

0.0300

0.0400

-

100.00%

0.0046

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%

0.0049

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

28.57%

0.0700

0.0900

-

0.00%	0.0187
MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

28.57%

0.0111

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

5.88%	0.0205
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	26.67%	0.1500	0.1900	-	11.76%	0.0090

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

66.67%	0.0089

MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

11.11%

0.0119

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

0.00%	0.0135
SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

66.67%

0.0067

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%

0.0080

MultiSource/Benchmarks/Olden/tsp/tsp

22.22%

0.0900

0.1100

-

10.00%

0.0120

SingleSource/Benchmarks/Shootout-C++/ackermann

18.75%

0.1600

0.1900

-

26.67%	0.0147
MultiSource/Benchmarks/SciMark2-C/scimark2	17.39%	0.2300	0.2700	-	8.00%	0.0219

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

0.00%	0.0066
MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%

0.0050

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0040

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

16.67%

0.0600

0.0700

-

40.00%

0.0089

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%

0.0075

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

15.00%

0.2000

0.2300

-

21.05%	0.0191
MultiSource/Benchmarks/mediabench/gsm/toast/toast	13.40%	0.9700	1.1000	-	2.80%	0.0338

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

-3.64%	0.0191

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

5.88%	0.0078

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

0.00%

0.0117

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

11.11%

0.0080

MultiSource/Applications/spiff/spiff

10.53%

0.5700

0.6300

-

-4.55%	0.0277
MultiSource/Benchmarks/Prolangs-C/agrep/agrep	10.53%	0.9500	1.0500	-	11.70%	0.0140

MultiSource/Applications/hexxagon/hexxagon

10.26%

0.7800

0.8600

-

3.61%

0.0168
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	10.00%	0.4000	0.4400	-	-6.38%	0.0293

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%	0.0080
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	9.52%	0.4200	0.4600	-	9.52%	0.0357

MultiSource/Benchmarks/Olden/bh/bh

9.09%

0.2200

0.2400

-

0.00%	0.0133

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0080
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	8.89%	0.4500	0.4900	-	8.89%	0.0204

MultiSource/Applications/sgefa/sgefa

8.00%

0.2500

0.2700

-

12.50%

0.0140

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

7.69%

0.0092
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	7.14%	0.7000	0.7500	-	29.31%	0.0427
MultiSource/Benchmarks/FreeBench/pifft/pifft	5.63%	0.7100	0.7500	-	4.17%	0.0090

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

-5.00%

0.0064

SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

11.76%

0.0108

SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

0.00%

0.0130

MultiSource/Benchmarks/VersaBench/dbms/dbms

5.26%

0.5700

0.6000

-

-3.23%	0.0375
MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

5.26%

0.0173

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

100.00%

0.0100

0.0200

-

100.00%

0.0156

SingleSource/Benchmarks/Shootout-C++/ary2

33.33%

0.0300

0.0400

-

33.33%

0.0087

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%

0.0064

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

1.08%

0.0060

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%	0.0195

SingleSource/Benchmarks/Shootout/strcat

15.38%

0.1300

0.1500

-

25.00%	0.0122
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4	9.17%	1.0900	1.1900	-	9.17%	0.0249

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

1.37%	0.0312
SingleSource/Benchmarks/Shootout-C++/lists	7.10%	4.9300	5.2800	-	6.88%	0.1931

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

6.25%

0.0078

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%

0.0049

SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

0.00%	0.0090

SingleSource/Benchmarks/Shootout-C++/hash2

5.12%

2.5400

2.6700

-

-1.11%

0.0739

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/fp-convert

-100.00%

0.0100

0.0000

-

-100.00%

0.0063

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C++/fixups

-100.00%

0.0100

0.0000

-

0.00%

0.0070

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0077

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/Regression/C/2004-03-15-IndirectGoto

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0100

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C/PR491

-100.00%

0.0200

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2002-05-02-ManyArguments

-100.00%

0.0100

0.0000

-

0.00%

0.0094

SingleSource/UnitTests/2002-05-03-NotTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0080

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

-100.00%	0.0046
SingleSource/UnitTests/2002-12-13-MishaTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2003-05-02-DependentPHI

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2003-07-08-BitOpsTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%	0.0049
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout

-100.00%

0.0200

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0054

SingleSource/UnitTests/DefaultInitDynArrays

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/stmtexpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2003-05-07-VarArgs

-66.67%

0.0300

0.0100

-

-66.67%

0.0066

SingleSource/UnitTests/SignlessTypes/shr

-66.67%

0.0300

0.0100

-

-66.67%

0.0066
SingleSource/UnitTests/SignlessTypes/Large/cast	-60.00%	0.0500	0.0200	-	-50.00%	0.0078
MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-50.00%

0.0400

0.0200

-

-33.33%

0.0083

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-50.00%

0.0600

0.0300

-

-25.00%	0.0067
SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%	0.0050

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%	0.0066
SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

-50.00%

0.0030

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

-50.00%	0.0087
SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-42.86%

0.0700

0.0400

-

-42.86%

0.0094

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

-25.00%	0.0046
MultiSource/Benchmarks/Prolangs-C++/simul/simul

-40.00%

0.0500

0.0300

-

-25.00%

0.0075

SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-40.00%

0.0083

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-30.00%

0.1000

0.0700

-

0.00%	0.0142

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

50.00%	0.0083
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%

0.0087

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

50.00%	0.0102
SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

0.00%

0.0064

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

-25.00%	0.0060
SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

50.00%

0.0078

SingleSource/Benchmarks/Misc/flops

-25.00%

0.0800

0.0600

-

-14.29%

0.0060

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0081

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

-25.00%

0.0064

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

200.00%	0.0094

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%	0.0054
SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

-22.22%

0.0066

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

-20.00%

0.1500

0.1200

-

-29.41%	0.0150

SingleSource/Benchmarks/Shootout-C++/wc

-19.05%

0.2100

0.1700

-

0.00%	0.0149
SingleSource/Benchmarks/Shootout-C++/ary2

-17.39%

0.2300

0.1900

-

-13.64%

0.0080
SingleSource/Benchmarks/Shootout-C++/lists	-17.39%	0.2300	0.1900	-	-9.52%	0.0125
MultiSource/Benchmarks/FreeBench/mason/mason

-14.29%

0.0700

0.0600

-

0.00%

0.0089

SingleSource/Benchmarks/Shootout-C++/matrix

-14.29%

0.2100

0.1800

-

-10.00%	0.0110
SingleSource/Benchmarks/Shootout-C++/fibo	-11.76%	0.1700	0.1500	-	-6.25%	0.0094

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

23.08%	0.0137

MultiSource/Benchmarks/McCat/18-imp/imp

-10.71%

0.2800

0.2500

-

-10.71%	0.0140

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-15.00%	0.0083
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-10.34%	0.5800	0.5200	-	-14.75%	0.0338

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

-10.00%	0.0092

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

28.57%

0.0083

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

12.50%

0.0083

SingleSource/Benchmarks/Shootout-C++/sieve

-8.33%

0.2400

0.2200

-

-12.00%

0.0135

MultiSource/Benchmarks/Olden/em3d/em3d

-7.69%

0.1300

0.1200

-

9.09%

0.0135

MultiSource/Benchmarks/Ptrdist/bc/bc	-7.69%	0.9100	0.8400	-	-7.69%	0.0272

MultiSource/Applications/obsequi/Obsequi

-6.90%

0.8700

0.8100

-

-8.99%	0.0284

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-6.30%

1.2700

1.1900

-

2.59%	0.0408

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

-11.11%

0.0078
MultiSource/Benchmarks/Prolangs-C/bison/mybison	-5.77%	1.0400	0.9800	-	-4.85%	0.0232

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%

0.0066

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/Large/cast

-100.00%

0.0100

0.0000

-

-100.00%

0.0045

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

-

-50.00%

0.0000

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%	0.0102
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-25.00%

0.0400

0.0300

-

-25.00%

0.0049

MultiSource/Benchmarks/McCat/09-vor/vor

-18.18%

0.1100

0.0900

-

0.00%

0.0078

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

0.00%	0.0050
MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

20.00%

0.0110

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0110
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-10.00%	0.3000	0.2700	-	-15.62%	0.0100
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

-9.52%

0.2100

0.1900

-

-5.00%

0.0030

MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

11.76%

0.0142
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	-9.09%	0.2200	0.2000	-	-13.04%	0.0130

SingleSource/Benchmarks/Shootout-C++/methcall

-8.80%

5.0000

4.5600

-

-3.18%	0.0438

MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame

-8.33%

0.2400

0.2200

-

-4.35%

0.0070

MultiSource/Benchmarks/FreeBench/distray/distray

-7.14%

0.1400

0.1300

-

-7.14%

0.0045

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.52%

3.2200

3.0100

-

-0.33%

0.0040
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4	-5.26%	0.3800	0.3600	-	-5.26%	0.0054

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.46s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153966	2012-04-03 20:26:35	0:14:28
Previous

153965

2012-04-03 20:01:37

0:14:26

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	78
Performance Improvements	20	121
Existing Failures	8	8
Unchanged Tests	857	681
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C/loader/loader

27.27%

0.2200

0.2800

0.0154

21.74%

-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Stanford/Bubblesort

25.00%

0.0400

0.0500

0.0030

25.00%

-

MultiSource/Benchmarks/SciMark2-C/scimark2

1.73%

26.5400

27.0000

0.0100

1.28%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/2008-01-07-LongDouble

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/2003-05-14-AtExit

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/2003-09-18-BitFieldTest

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/2005-07-15-Bitfield-ABI

-100.00%

0.0100

0.0000

0.0030

0.00%

-

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

0.0000

-100.00%

-

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio	-75.00%	0.0400	0.0100	0.0078	-66.67%	-
SingleSource/Regression/C/sumarraymalloc	-66.67%	0.0300	0.0100	0.0030	-50.00%	-
MultiSource/Benchmarks/Olden/bisort/bisort	-60.00%	0.0500	0.0200	0.0089	-60.00%	-
SingleSource/UnitTests/initp1	-50.00%	0.0400	0.0200	0.0046	-33.33%	-
MultiSource/Benchmarks/SciMark2-C/scimark2	-40.74%	0.2700	0.1600	0.0210	-30.43%	-
MultiSource/Benchmarks/McCat/17-bintr/bintr	-33.33%	0.0600	0.0400	0.0070	-20.00%	-
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame	-7.06%	3.4000	3.1600	0.0427	-3.36%	-
MultiSource/Benchmarks/MallocBench/gs/gs	-5.02%	3.1900	3.0300	0.0502	-6.19%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-100.00%

0.0200

0.0000

0.0000

-100.00%

-

MultiSource/Benchmarks/Olden/mst/mst	-37.50%	0.0800	0.0500	0.0077	-37.50%	-
MultiSource/Benchmarks/McCat/08-main/main

-25.00%

0.0400

0.0300

0.0030

-25.00%

-

MultiSource/Applications/spiff/spiff	-9.19%	1.8500	1.6800	0.0436	-9.68%	-
SingleSource/Benchmarks/BenchmarkGame/Large/fasta	-4.65%	0.8600	0.8200	0.0120	-3.53%	-
MultiSource/Applications/sgefa/sgefa	-1.47%	0.6800	0.6700	0.0000	-1.47%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

200.00%	0.0066
SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0060

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

0.00%

0.0064

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

16.67%

0.0070

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%

0.0050

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

100.00%

0.0300

0.0600

-

100.00%	0.0112
SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

-33.33%

0.0092

SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

-33.33%

0.0050

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

0.00%	0.0064
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

100.00%

0.0078

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

-33.33%

0.0078

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0075

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-20.00%	0.0080

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

50.00%	0.0110

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

-18.18%	0.0170

MultiSource/Benchmarks/McCat/15-trie/trie

50.00%

0.0400

0.0600

-

50.00%	0.0122

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

41.18%

0.1700

0.2400

-

0.00%	0.0223
SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

33.33%

0.0064

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0060

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%	0.0067

MultiSource/Benchmarks/Ptrdist/ft/ft

30.00%

0.1000

0.1300

-

-13.33%	0.0081

MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

0.00%	0.0127
MultiSource/Benchmarks/Ptrdist/anagram/anagram	28.57%	0.0700	0.0900	-	12.50%	0.0054

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

0.00%

0.0100

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%

0.0066

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

22.22%	0.0199
MultiSource/Benchmarks/Prolangs-C/loader/loader	21.74%	0.2300	0.2800	-	27.27%	0.0154

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

-10.53%	0.0149
MultiSource/Benchmarks/mediabench/g721/g721encode/encode	20.00%	0.1500	0.1800	-	-5.26%	0.0110

MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1

18.18%

0.1100

0.1300

-

8.33%	0.0098

SingleSource/Benchmarks/Shootout-C++/objinst

17.65%

0.1700

0.2000

-

17.65%	0.0087

MultiSource/Benchmarks/FreeBench/neural/neural

16.67%

0.1200

0.1400

-

16.67%	0.0070

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

0.00%

0.0064

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

-12.50%

0.0110

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%	0.0046
SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

40.00%

0.0083

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

40.00%

0.0092

MultiSource/Applications/spiff/spiff

15.79%

0.5700

0.6600

-

4.76%	0.0228

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

14.29%

0.1400

0.1600

-

-11.11%	0.0201

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

0.00%	0.0185

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

12.50%

0.4000

0.4500

-

2.27%	0.0297
MultiSource/Applications/Burg/burg	11.90%	0.8400	0.9400	-	16.05%	0.0410

MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

11.76%	0.0092
MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

11.11%

0.0094

MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

-9.09%

0.0142

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

25.00%

0.0087

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

5.26%

0.0108

MultiSource/Benchmarks/MallocBench/cfrac/cfrac

10.34%

0.5800

0.6400

-

23.08%	0.0388

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

10.00%

0.2000

0.2200

-

-4.35%

0.0197

MultiSource/Benchmarks/Olden/bh/bh

9.09%

0.2200

0.2400

-

0.00%

0.0134

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0060

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

-1.16%	0.0168

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

8.89%

0.4500

0.4900

-

0.00%	0.0217

MultiSource/Benchmarks/VersaBench/dbms/dbms

7.02%

0.5700

0.6100

-

1.67%	0.0356
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	6.86%	1.0200	1.0900	-	1.87%	0.0476
SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

-5.56%

0.0078

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

-5.56%

0.0100

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%	0.0064

SingleSource/Benchmarks/Shootout-C++/random

5.56%

0.1800

0.1900

-

5.56%

0.0098

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%

0.0078

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0067

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%	0.0060
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

66.67%

0.0064

SingleSource/Benchmarks/Stanford/Bubblesort

25.00%

0.0400

0.0500

-

25.00%

0.0030

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

-0.60%	0.0195
MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

16.67%

0.0049

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%

0.0100

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

5.00%	0.0092

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

-6.67%	0.0133

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0050

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/fp-convert

-100.00%

0.0100

0.0000

-

0.00%	0.0087
SingleSource/Regression/C++/2003-08-20-EnumSizeProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C++/EH/ConditionalExpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0083

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

0.00%	0.0077

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Regression/C/2008-01-07-LongDouble

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2002-05-02-CastTest2

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

0.00%	0.0046

SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

0.00%	0.0080
SingleSource/UnitTests/2002-08-02-CastTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/2002-10-09-ArrayResolution

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

0.00%	0.0064

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/UnitTests/2002-12-13-MishaTest

-100.00%

0.0100

0.0000

-

0.00%	0.0075
SingleSource/UnitTests/2003-04-22-Switch

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2003-05-14-AtExit

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2003-05-26-Shorts

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2003-09-18-BitFieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

0.00%	0.0070
SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

0.00%	0.0046

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0000

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/SignlessTypes/Large/cast	-80.00%	0.0500	0.0100	-	-50.00%	0.0104
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

-66.67%

0.0300

0.0100

-

-75.00%

0.0078

SingleSource/UnitTests/2003-05-07-VarArgs

-66.67%

0.0300

0.0100

-

0.00%	0.0078
MultiSource/Benchmarks/Olden/bisort/bisort

-60.00%

0.0500

0.0200

-

-60.00%

0.0089

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%	0.0087
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio	-50.00%	0.0400	0.0200	-	-50.00%	0.0094
SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

-33.33%

0.0060

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-33.33%

0.0075

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

-50.00%

0.0089

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

0.00%	0.0040
SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/sumarraymalloc

-50.00%

0.0200

0.0100

-

-66.67%

0.0030

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0054

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%	0.0060
SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%

0.0078

MultiSource/Benchmarks/BitBench/five11/five11

-40.00%

0.0500

0.0300

-

-40.00%

0.0067

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%	0.0046

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-40.00%

0.0500

0.0300

-

0.00%	0.0090

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-40.00%

0.1000

0.0600

-

-14.29%

0.0136
MultiSource/Benchmarks/SciMark2-C/scimark2	-30.43%	0.2300	0.1600	-	-40.74%	0.0210

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

-28.57%	0.0090
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

-25.00%

0.0102

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0064

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

50.00%

0.0087

MultiSource/Benchmarks/Prolangs-C++/garage/garage

-25.00%

0.0400

0.0300

-

-25.00%

0.0049

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

0.00%	0.0054
SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

-25.00%

0.0092

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-40.00%

0.0080

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

0.00%	0.0080
SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

-25.00%

0.0070

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

0.00%	0.0066

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

0.00%

0.0087

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%

0.0054

MultiSource/Benchmarks/Olden/em3d/em3d	-23.08%	0.1300	0.1000	-	-16.67%	0.0135
SingleSource/Benchmarks/CoyoteBench/huffbench

-22.22%

0.0900

0.0700

-

-12.50%

0.0087

MultiSource/Benchmarks/McCat/17-bintr/bintr

-20.00%

0.0500

0.0400

-

-33.33%

0.0070

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

-11.11%

0.0075

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

33.33%

0.0087

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

-33.33%	0.0066

SingleSource/Benchmarks/Shootout-C++/wc

-19.05%

0.2100

0.1700

-

0.00%

0.0164
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-14.55%	0.5500	0.4700	-	-12.96%	0.0170

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-33.33%	0.0194

SingleSource/Benchmarks/Shootout-C++/fibo

-11.76%

0.1700

0.1500

-

0.00%	0.0108
SingleSource/Benchmarks/Shootout-C++/except

-10.53%

0.1900

0.1700

-

-5.56%

0.0066

MultiSource/Benchmarks/McCat/09-vor/vor

-8.70%

0.2300

0.2100

-

-12.50%

0.0166

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-8.66%

1.2700

1.1600

-

-2.52%	0.0265

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-14.29%

0.0092

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-6.74%

0.8900

0.8300

-

-10.75%	0.0392
SingleSource/Benchmarks/Shootout-C++/hello

-6.25%

0.1600

0.1500

-

-6.25%

0.0114
MultiSource/Benchmarks/MallocBench/gs/gs	-6.19%	3.2300	3.0300	-	-5.02%	0.0502

SingleSource/Benchmarks/Shootout-C++/hash

-6.06%

0.3300

0.3100

-

-3.13%	0.0125
MultiSource/Benchmarks/McCat/08-main/main	-5.26%	0.1900	0.1800	-	-10.00%	0.0170
MultiSource/Benchmarks/McCat/05-eks/eks

-5.00%

0.4000

0.3800

-

-2.56%

0.0205

SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction

-5.00%

0.4000

0.3800

-

-5.00%

0.0090

Performance Improvements - Execution Time

Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%	0.0049
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-100.00%

0.0200

0.0000

-

-100.00%

0.0000

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%

0.0102

MultiSource/Benchmarks/Olden/mst/mst

-37.50%

0.0800

0.0500

-

-37.50%

0.0077

MultiSource/Benchmarks/McCat/08-main/main

-25.00%

0.0400

0.0300

-

-25.00%

0.0030

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0094

MultiSource/Benchmarks/McCat/17-bintr/bintr

-10.00%

0.1000

0.0900

-

-10.00%

0.0040
MultiSource/Applications/spiff/spiff	-9.68%	1.8600	1.6800	-	-9.19%	0.0436

MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

0.00%	0.0142
MultiSource/Applications/oggenc/oggenc

-7.69%

0.1300

0.1200

-

-7.69%

0.0046

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

-6.67%

0.3000

0.2800

-

3.70%

0.0155

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%

0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.33%

0.0046

SingleSource/Benchmarks/Misc-C++/bigfib

-5.88%

0.3400

0.3200

-

-5.88%

0.0220
SingleSource/Benchmarks/Shootout-C++/methcall	-5.60%	5.0000	4.7200	-	3.51%	0.0576

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.41s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153967	2012-04-03 20:51:44	0:14:29
Previous

153966

2012-04-03 20:26:35

0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	10	94
Performance Improvements	14	104
Existing Failures	8	8
Unchanged Tests	856	682
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2006-01-23-UnionInit	200.00%	0.0100	0.0300	0.0070	0.00%	-
MultiSource/Benchmarks/Prolangs-C/football/football	4.62%	0.6500	0.6800	0.0102	3.03%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/mandel-2	13.27%	1.1300	1.2800	0.0049	14.29%	-
SingleSource/Benchmarks/Stanford/Puzzle

7.69%

0.1300

0.1400

0.0030

7.69%

-

SingleSource/Benchmarks/Misc/oourafft	5.18%	5.6000	5.8900	0.0268	5.37%	-
SingleSource/Benchmarks/Misc/richards_benchmark	3.66%	0.8200	0.8500	0.0054	3.66%	-
SingleSource/Benchmarks/CoyoteBench/almabench	3.28%	13.4000	13.8400	0.0580	3.36%	-
SingleSource/Benchmarks/McGill/chomp	1.89%	1.5900	1.6200	0.0070	0.00%	-
SingleSource/Benchmarks/Misc-C++/stepanov_container	1.41%	3.5400	3.5900	0.0111	1.13%	-
MultiSource/Applications/SPASS/SPASS	1.19%	9.2600	9.3700	0.0279	1.19%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/2011-03-28-Bitfield

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/bigstack	-100.00%	0.0300	0.0000	0.0046	-100.00%	-
SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/callargs

-50.00%

0.0200

0.0100

0.0030

0.00%

-

SingleSource/Benchmarks/McGill/queens	-25.00%	0.0400	0.0300	0.0000	0.00%	-
SingleSource/Benchmarks/Shootout-C++/hash2	-13.89%	0.3600	0.3100	0.0102	-11.43%	-
SingleSource/Benchmarks/Adobe-C++/functionobjects	-10.81%	0.3700	0.3300	0.0112	-8.33%	-
MultiSource/Applications/hexxagon/hexxagon	-5.88%	0.8500	0.8000	0.0127	2.56%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

0.0046

-50.00%

-

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail	-50.00%	0.0800	0.0400	0.0075	-42.86%	-
MultiSource/Benchmarks/Olden/perimeter/perimeter	-17.39%	0.2300	0.1900	0.0092	-17.39%	-
MultiSource/Applications/sgefa/sgefa	-1.49%	0.6700	0.6600	0.0030	-2.94%	-
MultiSource/Benchmarks/Olden/bh/bh	-1.29%	1.5500	1.5300	0.0050	-1.29%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

0.00%	0.0066
SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

50.00%

0.0066

MultiSource/Applications/aha/aha

100.00%

0.0500

0.1000

-

25.00%	0.0080

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

33.33%	0.0040

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

-14.29%	0.0070

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

33.33%	0.0094
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits

100.00%

0.0200

0.0400

-

100.00%

0.0092

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0060

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%

0.0102

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

-20.00%

0.0064

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%	0.0067

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%	0.0078

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

0.00%	0.0050
SingleSource/UnitTests/conditional-gnu-ext-cxx

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0078

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

52.94%

0.1700

0.2600

-

8.33%	0.0233

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

0.00%	0.0110

SingleSource/Benchmarks/Stanford/Oscar

50.00%

0.0400

0.0600

-

20.00%	0.0040

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

44.44%

0.0900

0.1300

-

18.18%

0.0195

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

33.33%

0.0075

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

0.00%	0.0060
SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0075

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%

0.0049
SingleSource/UnitTests/initp1	33.33%	0.0300	0.0400	-	100.00%	0.0067
MultiSource/Benchmarks/McCat/04-bisect/bisect

33.33%

0.0900

0.1200

-

20.00%

0.0090

MultiSource/Benchmarks/Ptrdist/ft/ft

30.00%

0.1000

0.1300

-

0.00%	0.0092
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

12.50%

0.0133

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

28.57%

0.1400

0.1800

-

5.88%

0.0143

MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

0.00%

0.0141

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

0.00%

0.0100

SingleSource/Benchmarks/Dhrystone/dry

25.00%

0.0400

0.0500

-

66.67%

0.0092

MultiSource/Benchmarks/Olden/health/health

22.22%

0.0900

0.1100

-

22.22%

0.0092

MultiSource/Benchmarks/McCat/08-main/main

21.05%

0.1900

0.2300

-

27.78%	0.0168

SingleSource/Benchmarks/Shootout-C++/ackermann

18.75%

0.1600

0.1900

-

18.75%	0.0148
MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

8.33%

0.0125
MultiSource/Benchmarks/Olden/bh/bh	18.18%	0.2200	0.2600	-	8.33%	0.0133

MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

5.26%

0.0092

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

0.00%	0.0104

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%	0.0098
SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%

0.0070
MultiSource/Benchmarks/Olden/em3d/em3d	15.38%	0.1300	0.1500	-	50.00%	0.0149

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

14.29%

0.1400

0.1600

-

0.00%	0.0176
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

12.50%

0.1600

0.1800

-

12.50%

0.0156

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

11.90%

0.4200

0.4700

-

11.90%	0.0199

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

-5.00%	0.0100

SingleSource/Benchmarks/Misc-C++/Large/ray

11.54%

0.2600

0.2900

-

11.54%	0.0142

MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

0.00%	0.0114

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

0.00%	0.0094
SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

11.11%

0.0080

MultiSource/Applications/spiff/spiff

10.53%

0.5700

0.6300

-

-4.55%

0.0233
MultiSource/Benchmarks/VersaBench/dbms/dbms	10.53%	0.5700	0.6300	-	3.28%	0.0354

MultiSource/Benchmarks/Olden/voronoi/voronoi

10.00%

0.2000

0.2200

-

4.76%	0.0110

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0054

MultiSource/Benchmarks/McCat/09-vor/vor

8.70%

0.2300

0.2500

-

19.05%	0.0180

MultiSource/Benchmarks/MallocBench/cfrac/cfrac

8.62%

0.5800

0.6300

-

-1.56%	0.0422
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	7.89%	3.4200	3.6900	-	3.36%	0.0405
MultiSource/Benchmarks/Prolangs-C/agrep/agrep	7.37%	0.9500	1.0200	-	5.15%	0.0290
MultiSource/Benchmarks/Prolangs-C/simulator/simulator	7.14%	0.5600	0.6000	-	9.09%	0.0226

SingleSource/Benchmarks/Shootout-C++/reversefile

6.90%

0.2900

0.3100

-

10.71%	0.0148

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

6.67%

0.1500

0.1600

-

-11.11%	0.0094

SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

3.23%

0.0117

MultiSource/Applications/lambda-0_1_3/lambda

6.38%

0.4700

0.5000

-

-5.66%	0.0178

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

13.33%	0.0098

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

0.00%	0.0078
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

5.56%

0.0195

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

11.76%

0.0104

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

300.00%

0.0100

0.0400

-

300.00%	0.0135

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/Benchmarks/Shootout-C++/moments

50.00%

0.0400

0.0600

-

50.00%

0.0098

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%	0.0046
SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%

0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%	0.0199

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%	0.0046
SingleSource/Benchmarks/Misc/mandel-2	14.29%	1.1200	1.2800	-	13.27%	0.0049
SingleSource/Benchmarks/Stanford/Puzzle

7.69%

0.1300

0.1400

-

7.69%

0.0030

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

2.38%	0.0046

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

4.23%	0.0228
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	6.67%	0.3000	0.3200	-	14.29%	0.0174

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%	0.0049

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

5.50%

1.0900

1.1500

-

5.50%	0.0308
SingleSource/Benchmarks/Misc/oourafft	5.37%	5.5900	5.8900	-	5.18%	0.0268

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0049

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/NP/np

-100.00%

0.0200

0.0000

-

-100.00%

0.0078

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/2011-03-28-Bitfield

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/EH/ctor_dtor_count

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/fixups

-100.00%

0.0100

0.0000

-

-100.00%

0.0077

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

0.00%

0.0075

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0100

0.0000

-

-100.00%

0.0078
SingleSource/Regression/C/bigstack	-100.00%	0.0400	0.0000	-	-100.00%	0.0046

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/2003-04-22-Switch

-100.00%

0.0200

0.0000

-

0.00%	0.0064
SingleSource/UnitTests/2003-05-12-MinIntProblem

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2003-05-14-AtExit

-100.00%

0.0100

0.0000

-

0.00%	0.0067
SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2006-02-04-DivRem

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/DefaultInitDynArrays

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-50.00%

0.0060

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-60.00%

0.0500

0.0200

-

-33.33%

0.0046
MultiSource/Benchmarks/FreeBench/mason/mason	-57.14%	0.0700	0.0300	-	-57.14%	0.0102
SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C/test_indvars

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

0.00%	0.0075

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-50.00%

0.0400

0.0200

-

-33.33%

0.0087

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%	0.0060

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0054

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-42.86%

0.0700

0.0400

-

-42.86%

0.0114

SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-25.00%	0.0087

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

200.00%	0.0135
SingleSource/Benchmarks/Misc/fbench

-33.33%

0.0600

0.0400

-

-20.00%

0.0080

SingleSource/Benchmarks/Shootout/lists

-33.33%

0.0600

0.0400

-

-33.33%

0.0078

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%	0.0090

MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

-50.00%	0.0134
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0083

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

0.00%	0.0090

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%	0.0078
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

50.00%

0.0100

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

50.00%

0.0063

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

0.00%	0.0080

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

0.00%

0.0067

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%	0.0063
MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

33.33%

0.0078

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

100.00%	0.0120
MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-20.00%

0.0070

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

33.33%

0.0102

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

0.00%	0.0078

SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

0.00%	0.0067

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

0.00%	0.0187
SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0075
SingleSource/Benchmarks/Shootout-C++/hash2	-11.43%	0.3500	0.3100	-	-13.89%	0.0102
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-10.00%	0.1000	0.0900	-	50.00%	0.0136
SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

-10.00%

0.0075

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-9.52%	0.0117
SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

11.76%

0.0172
SingleSource/Benchmarks/Shootout-C++/ary2	-8.70%	0.2300	0.2100	-	-4.55%	0.0102
SingleSource/Benchmarks/Shootout-C++/lists	-8.70%	0.2300	0.2100	-	-4.55%	0.0158
SingleSource/Benchmarks/Adobe-C++/functionobjects	-8.33%	0.3600	0.3300	-	-10.81%	0.0112

MultiSource/Applications/sgefa/sgefa

-8.00%

0.2500

0.2300

-

-4.17%	0.0158

SingleSource/Benchmarks/Shootout-C++/wordfreq

-7.69%

0.2600

0.2400

-

-4.00%	0.0127

MultiSource/Benchmarks/Prolangs-C/bison/mybison

-6.73%

1.0400

0.9700

-

-5.83%	0.0246

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-6.30%

1.2700

1.1900

-

2.59%

0.0293

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

-6.25%

0.4800

0.4500

-

-6.25%	0.0226
MultiSource/Applications/hbd/hbd	-5.56%	1.0800	1.0200	-	-2.86%	0.0437
SingleSource/Benchmarks/Adobe-C++/loop_unroll	-5.28%	2.6500	2.5100	-	-1.95%	0.0143

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

5.88%	0.0078

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

-5.26%	0.0089
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	-5.00%	0.4000	0.3800	-	-15.56%	0.0297

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0050

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

-

-50.00%

0.0046

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%

0.0092
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail	-42.86%	0.0700	0.0400	-	-50.00%	0.0075

MultiSource/Benchmarks/McCat/08-main/main

-25.00%

0.0400

0.0300

-

0.00%	0.0040
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-25.00%

0.0400

0.0300

-

-40.00%

0.0064

MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan

-20.00%

0.0500

0.0400

-

-20.00%

0.0045

MultiSource/Benchmarks/Olden/treeadd/treeadd

-19.05%

0.2100

0.1700

-

-10.53%	0.0133

MultiSource/Benchmarks/Olden/perimeter/perimeter

-17.39%

0.2300

0.1900

-

-17.39%	0.0092

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0100

SingleSource/Benchmarks/Misc-C++/bigfib

-11.76%

0.3400

0.3000

-

-6.25%	0.0211
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

-7.14%

0.1400

0.1300

-

-7.14%

0.0045

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

-6.25%

0.1600

0.1500

-

-6.25%

0.0078

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%	0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%	0.0046

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

-0.21%

0.0583

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.57s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153970	2012-04-03 21:57:18	0:14:29
Previous

153967

2012-04-03 20:51:44

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	6	100
Performance Improvements	12	103
Existing Failures	8	8
Unchanged Tests	862	677
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/EH/throw_rethrow_test	200.00%	0.0100	0.0300	0.0063	200.00%	-
SingleSource/Regression/C/badidx

200.00%

0.0100

0.0300

0.0050

200.00%

-

SingleSource/Benchmarks/Shootout/random

100.00%

0.0200

0.0400

0.0049

33.33%

-

MultiSource/Benchmarks/VersaBench/8b10b/8b10b	60.00%	0.0500	0.0800	0.0104	33.33%	-
SingleSource/Benchmarks/Misc/richards_benchmark	40.00%	0.0500	0.0700	0.0054	40.00%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/mandel

1.01%

0.9900

1.0000

0.0030

1.01%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/ackermann	-100.00%	0.0200	0.0000	0.0054	-100.00%	-
SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

MultiSource/Benchmarks/Prolangs-C++/family/family	-50.00%	0.0400	0.0200	0.0046	0.00%	-
MultiSource/Benchmarks/Prolangs-C++/garage/garage	-50.00%	0.0400	0.0200	0.0066	-50.00%	-
SingleSource/Regression/C++/pointer_method	-50.00%	0.0200	0.0100	0.0000	0.00%	-
MultiSource/Benchmarks/Prolangs-C++/objects/objects	-42.86%	0.0700	0.0400	0.0104	-33.33%	-
MultiSource/Benchmarks/Olden/power/power	-30.00%	0.1000	0.0700	0.0094	-12.50%	-
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-11.54%	0.2600	0.2300	0.0066	-11.54%	-
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5	-9.52%	0.2100	0.1900	0.0064	-9.52%	-
SingleSource/Benchmarks/Shootout-C++/spellcheck	-9.09%	0.3300	0.3000	0.0075	-6.25%	-
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes	-8.33%	0.2400	0.2200	0.0045	0.00%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc-C++/Large/sphereflake

-1.64%

2.4400

2.4000

0.0064

-1.23%

-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

0.00%	0.0064
SingleSource/Regression/C++/EH/throw_rethrow_test	200.00%	0.0100	0.0300	-	200.00%	0.0063
SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

200.00%

0.0083

SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

50.00%

0.0075

SingleSource/Regression/C/badidx

200.00%

0.0100

0.0300

-

200.00%

0.0050

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%	0.0064

MultiSource/Applications/aha/aha

100.00%

0.0500

0.1000

-

0.00%	0.0090
SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

33.33%

0.0078

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

0.00%

0.0054

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%

0.0102

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

100.00%

0.0064

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0054

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%	0.0064

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%	0.0066
SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

100.00%

0.0087

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

100.00%

0.0063

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%	0.0060
SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/Threads/tls

100.00%

0.0100

0.0200

-

100.00%

0.0054

SingleSource/UnitTests/conditional-gnu-ext-cxx

100.00%

0.0100

0.0200

-

0.00%	0.0075
SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0067

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

-16.67%	0.0070

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

66.67%

0.0120

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

66.67%

0.0300

0.0500

-

66.67%

0.0098

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

3.85%

0.0205

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

0.00%

0.0110

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

50.00%	0.0190

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

15.38%	0.0092

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

44.44%

0.0900

0.1300

-

0.00%	0.0205
SingleSource/Benchmarks/Misc/richards_benchmark

40.00%

0.0500

0.0700

-

40.00%

0.0054

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

35.71%

0.1400

0.1900

-

18.75%

0.0183

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

33.33%

0.0600

0.0800

-

60.00%

0.0104

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

33.33%

0.0040

SingleSource/Benchmarks/Shootout/random

33.33%

0.0300

0.0400

-

100.00%

0.0049

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

100.00%

0.0080

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

0.00%	0.0078

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%	0.0049
SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

33.33%

0.0067

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%	0.0067
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch	30.00%	0.1000	0.1300	-	18.18%	0.0092

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

28.57%

0.1400

0.1800

-

0.00%	0.0135

MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

0.00%

0.0154

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

25.00%

0.0400

0.0500

-

66.67%

0.0083

MultiSource/Benchmarks/McCat/04-bisect/bisect

22.22%

0.0900

0.1100

-

-8.33%	0.0110

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

0.00%	0.0125
SingleSource/Benchmarks/Shootout-C++/objinst

17.65%

0.1700

0.2000

-

5.26%

0.0100

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

16.67%

0.0063

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

16.67%

0.0049

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0040

SingleSource/Benchmarks/BenchmarkGame/n-body

16.67%

0.0600

0.0700

-

40.00%

0.0087

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%	0.0075

MultiSource/Applications/spiff/spiff

15.79%

0.5700

0.6600

-

4.76%

0.0236

MultiSource/Benchmarks/Olden/em3d/em3d

15.38%

0.1300

0.1500

-

0.00%	0.0162
SingleSource/Benchmarks/Shootout-C++/ary

15.00%

0.2000

0.2300

-

9.52%

0.0075

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

6.00%	0.0211

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

-5.26%	0.0158

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

5.88%	0.0078
MultiSource/Benchmarks/Prolangs-C++/office/office

11.76%

0.1700

0.1900

-

-5.00%

0.0090

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

-9.09%

0.0087

MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

0.00%

0.0114

SingleSource/Benchmarks/Shootout-C++/heapsort	11.11%	0.1800	0.2000	-	11.11%	0.0114
SingleSource/Benchmarks/Shootout-C++/random

11.11%

0.1800

0.2000

-

11.11%

0.0094

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%	0.0066

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

6.45%	0.0092
SingleSource/Benchmarks/Shootout-C++/moments

10.00%

0.3000

0.3300

-

3.13%

0.0117

MultiSource/Benchmarks/mediabench/gsm/toast/toast

9.28%

0.9700

1.0600

-

6.00%	0.0354

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

8.89%

0.4500

0.4900

-

11.36%	0.0205
MultiSource/Benchmarks/SciMark2-C/scimark2	8.70%	0.2300	0.2500	-	13.64%	0.0283

MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des

8.00%

0.2500

0.2700

-

8.00%	0.0066

SingleSource/Benchmarks/Misc-C++/Large/sphereflake

8.00%

0.2500

0.2700

-

3.85%

0.0183

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

8.00%	0.0083

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

7.50%

0.4000

0.4300

-

13.16%	0.0258

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

3.75%	0.0185

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

6.25%	0.0077

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

0.00%

0.0078

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

5.56%

0.0118

MultiSource/Applications/hbd/hbd

5.56%

1.0800

1.1400

-

11.76%	0.0509

MultiSource/Benchmarks/VersaBench/dbms/dbms

5.26%

0.5700

0.6000

-

-4.76%	0.0244

MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

-13.04%

0.0195

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%	0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0040

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

66.67%

0.0075

SingleSource/Benchmarks/Shootout-C++/moments

25.00%

0.0400

0.0500

-

-16.67%	0.0104

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

-0.60%

0.0049

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0046

SingleSource/Benchmarks/Shootout/strcat

15.38%

0.1300

0.1500

-

15.38%	0.0100
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%

0.0087

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%	0.0040

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

0.00%	0.0050
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

13.33%

0.0083

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0046

SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

5.26%

0.0102

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/primes/primes

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/Benchmarks/Shootout/ackermann

-100.00%

0.0200

0.0000

-

-100.00%

0.0054

SingleSource/Benchmarks/Shootout/sieve

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C++/pointer_member

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/2003-05-12-MinIntProblem

-100.00%

0.0100

0.0000

-

0.00%	0.0060

SingleSource/UnitTests/2003-05-14-AtExit

-100.00%

0.0100

0.0000

-

0.00%

0.0080

SingleSource/UnitTests/2003-07-10-SignConversions

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2003-10-29-ScalarReplBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0077

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Benchmarks/Misc/flops-3

-66.67%

0.0300

0.0100

-

-50.00%

0.0045

SingleSource/Benchmarks/Misc/lowercase

-66.67%

0.0300

0.0100

-

-66.67%

0.0066

SingleSource/Benchmarks/Stanford/Perm

-66.67%

0.0300

0.0100

-

-50.00%

0.0087

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-50.00%

0.0400

0.0200

-

-33.33%

0.0090

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%

0.0083

MultiSource/Benchmarks/Prolangs-C++/garage/garage

-50.00%

0.0400

0.0200

-

-50.00%

0.0066

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-66.67%

0.0083

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Benchmarks/Shootout/heapsort

-50.00%

0.0400

0.0200

-

-33.33%

0.0066

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-07-08-BitOpsTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0060

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

-50.00%

0.0081

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0040

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

MultiSource/Benchmarks/BitBench/five11/five11

-40.00%

0.0500

0.0300

-

-25.00%

0.0075

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

0.00%	0.0128
MultiSource/Benchmarks/Prolangs-C++/objects/objects

-33.33%

0.0600

0.0400

-

-42.86%

0.0104

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

-20.00%

0.0092
SingleSource/Benchmarks/CoyoteBench/lpbench	-30.00%	0.1000	0.0700	-	-12.50%	0.0080

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

66.67%

0.0125

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

0.00%

0.0090

SingleSource/Benchmarks/Misc/ffbench

-28.57%

0.0700

0.0500

-

-16.67%

0.0075

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-25.00%

0.0075

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

-25.00%

0.0080

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0064

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

-25.00%

0.0081

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

0.00%

0.0081

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%

0.0054

SingleSource/Benchmarks/Stanford/Puzzle

-25.00%

0.0800

0.0600

-

-14.29%

0.0064

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

0.00%

0.0119

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-20.00%

0.0500

0.0400

-

100.00%

0.0060

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

0.00%	0.0070
SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

33.33%

0.0090

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-16.67%

0.1800

0.1500

-

-11.76%	0.0140

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

0.00%

0.0185

SingleSource/Benchmarks/Shootout-C++/matrix

-14.29%

0.2100

0.1800

-

-5.26%	0.0110
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean	-11.54%	0.2600	0.2300	-	-11.54%	0.0066

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

0.00%	0.0143
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5

-9.52%

0.2100

0.1900

-

-9.52%

0.0064

MultiSource/Benchmarks/Prolangs-C/loader/loader

-8.70%

0.2300

0.2100

-

-12.50%

0.0201

SingleSource/Benchmarks/Shootout-C++/ary2

-8.70%

0.2300

0.2100

-

0.00%	0.0102

SingleSource/Benchmarks/Shootout-C++/lists

-8.70%

0.2300

0.2100

-

0.00%	0.0155

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

-8.16%

0.4900

0.4500

-

-10.00%	0.0145

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-7.69%	0.0092
SingleSource/Benchmarks/Misc/himenobmtxpa

-7.69%

0.1300

0.1200

-

-7.69%

0.0070

SingleSource/Benchmarks/Shootout-C++/wordfreq

-7.69%

0.2600

0.2400

-

0.00%	0.0127

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-7.41%

0.2700

0.2500

-

-3.85%	0.0090
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-7.27%	0.5500	0.5100	-	-3.77%	0.0212

MultiSource/Benchmarks/McCat/18-imp/imp

-7.14%

0.2800

0.2600

-

-7.14%	0.0142

MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl

-7.14%

0.7000

0.6500

-

-9.72%	0.0474

SingleSource/Benchmarks/Shootout-C++/spellcheck

-6.25%

0.3200

0.3000

-

-9.09%	0.0075

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%	0.0078

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

-5.00%

0.2000

0.1900

-

-9.52%

0.0150

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

-100.00%

0.0100

0.0000

-

-100.00%

0.0156

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0049

MultiSource/Applications/JM/ldecod/ldecod

-57.14%

0.0700

0.0300

-

-25.00%

0.0092

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-50.00%

0.0200

0.0100

-

-50.00%

0.0060

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-28.57%

0.0108

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

-14.29%

0.0080

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0098

MultiSource/Benchmarks/Olden/treeadd/treeadd

-14.29%

0.2100

0.1800

-

5.88%	0.0098
MultiSource/Benchmarks/Olden/perimeter/perimeter

-13.04%

0.2300

0.2000

-

5.26%

0.0135

MultiSource/Benchmarks/Olden/health/health

-10.34%

0.2900

0.2600

-

-7.14%	0.0166

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0040

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0046

MultiSource/Applications/spiff/spiff

-5.91%

1.8600

1.7500

-

-4.89%	0.0575

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.00%

0.0593

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.51s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153972	2012-04-03 22:22:05	0:14:29
Previous

153970

2012-04-03 21:57:18

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	9	98
Performance Improvements	11	106
Existing Failures	8	8
Unchanged Tests	860	676
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/03-testtrie/testtrie	28.57%	0.0700	0.0900	0.0063	50.00%	-
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset	2.64%	10.5900	10.8700	0.0828	2.35%	-
MultiSource/Applications/JM/lencod/lencod	1.17%	12.0000	12.1400	0.0461	1.59%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Olden/treeadd/treeadd	16.67%	0.1800	0.2100	0.0094	0.00%	-
MultiSource/Applications/viterbi/viterbi	6.50%	2.0000	2.1300	0.0102	6.50%	-
MultiSource/Benchmarks/Prolangs-C++/primes/primes	3.33%	0.3000	0.3100	0.0030	3.33%	-
MultiSource/Applications/aha/aha	3.16%	2.5300	2.6100	0.0150	1.95%	-
SingleSource/Benchmarks/Misc-C++/stepanov_container	1.69%	3.5500	3.6100	0.0145	1.69%	-
SingleSource/Benchmarks/Misc/fbench	1.14%	1.7500	1.7700	0.0049	1.72%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/pointer_method

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Regression/C/uint64_to_float

-50.00%

0.0400

0.0200

0.0049

-33.33%

-

SingleSource/Benchmarks/CoyoteBench/almabench	-33.33%	0.0600	0.0400	0.0064	-20.00%	-
MultiSource/Benchmarks/McCat/05-eks/eks	-25.00%	0.4000	0.3000	0.0186	-25.00%	-
MultiSource/Applications/oggenc/oggenc	-1.29%	3.8800	3.8300	0.0094	-4.49%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

MultiSource/Benchmarks/FreeBench/distray/distray	-14.29%	0.1400	0.1200	0.0054	-14.29%	-

SingleSource/Benchmarks/BenchmarkGame/recursive

-2.17%

0.9200

0.9000

0.0050

-2.17%

-

MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5

-1.12%

1.7800

1.7600

0.0046

-0.56%

-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

200.00%

0.0080

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0054

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%	0.0087
MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

33.33%

0.0089

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

0.00%	0.0067
SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

-33.33%

0.0060

SingleSource/Benchmarks/Stanford/Towers

100.00%

0.0200

0.0400

-

0.00%	0.0066
SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

33.33%

0.0075

SingleSource/Regression/C++/EH/ctor_dtor_count

100.00%

0.0100

0.0200

-

0.00%

0.0060

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0083

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

-33.33%	0.0083
SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

0.00%

0.0063

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0087

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%	0.0064
SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%	0.0049
MultiSource/Benchmarks/BitBench/uudecode/uudecode

66.67%

0.0300

0.0500

-

66.67%

0.0078

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

0.00%	0.0120

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

66.67%

0.0300

0.0500

-

0.00%	0.0110

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-20.00%

0.0090

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

50.00%

0.0600

0.0900

-

28.57%	0.0063

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

41.18%

0.1700

0.2400

-

-11.11%	0.0199
MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

16.67%

0.0080

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

57.14%	0.0118

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

35.71%

0.1400

0.1900

-

0.00%	0.0173

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

-11.11%	0.0117

MultiSource/Benchmarks/Olden/mst/mst

33.33%

0.0600

0.0800

-

-11.11%

0.0190

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

33.33%

0.0300

0.0400

-

-20.00%

0.0070

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

33.33%

0.0040

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%	0.0046

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%	0.0081

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%	0.0067

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

33.33%

0.0900

0.1200

-

-7.69%

0.0214

MultiSource/Benchmarks/Ptrdist/ft/ft

30.00%

0.1000

0.1300

-

-13.33%	0.0092

MultiSource/Applications/viterbi/viterbi

27.27%

0.1100

0.1400

-

7.69%

0.0102

MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

11.11%

0.0110

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

25.00%

0.0400

0.0500

-

150.00%	0.0090
MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

5.26%

0.0090

MultiSource/Applications/lambda-0_1_3/lambda

17.02%

0.4700

0.5500

-

3.77%	0.0179

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%	0.0050

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%

0.0066

MultiSource/Applications/spiff/spiff

14.04%

0.5700

0.6500

-

-1.52%	0.0238

MultiSource/Benchmarks/Olden/bh/bh

13.64%

0.2200

0.2500

-

8.70%	0.0157

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

13.33%	0.0110
MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

-9.09%

0.0117

SingleSource/Benchmarks/Shootout-C++/random

11.11%

0.1800

0.2000

-

0.00%

0.0114

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_stepfft

11.11%

0.0900

0.1000

-

11.11%

0.0066

MultiSource/Benchmarks/McCat/08-main/main

10.53%

0.1900

0.2100

-

5.00%

0.0183

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

8.93%

0.5600

0.6100

-

5.17%	0.0221

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

8.89%

0.4500

0.4900

-

0.00%	0.0226
MultiSource/Benchmarks/Prolangs-C/loader/loader

8.70%

0.2300

0.2500

-

19.05%

0.0214

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

8.33%	0.0089

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

0.00%	0.0083
MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

-6.67%

0.0180

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

3.70%	0.0142
SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

16.67%

0.0064
MultiSource/Applications/hexxagon/hexxagon	7.69%	0.7800	0.8400	-	1.20%	0.0189

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

7.50%

0.4000

0.4300

-

0.00%	0.0257
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg	7.31%	3.4200	3.6700	-	2.23%	0.0473

MultiSource/Benchmarks/nbench/nbench

7.14%

0.8400

0.9000

-

3.45%	0.0148

MultiSource/Benchmarks/VersaBench/dbms/dbms

7.02%

0.5700

0.6100

-

1.67%

0.0197

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

-3.03%

0.0087

SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

-3.03%	0.0090

MultiSource/Benchmarks/Prolangs-C/agrep/agrep

6.32%

0.9500

1.0100

-

3.06%

0.0308

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

6.25%

0.1600

0.1700

-

6.25%

0.0143

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%	0.0077
SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

-5.56%

0.0158

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

0.00%

0.0083

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

-5.56%	0.0078
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

5.56%

0.0180

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

5.56%

0.1800

0.1900

-

0.00%

0.0060

SingleSource/Benchmarks/Shootout-C++/strcat

5.56%

0.1800

0.1900

-

11.76%

0.0110

SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

0.00%	0.0122
MultiSource/Benchmarks/Ptrdist/bc/bc	5.49%	0.9100	0.9600	-	9.09%	0.0305

MultiSource/Benchmarks/MallocBench/cfrac/cfrac

5.17%

0.5800

0.6100

-

1.67%

0.0428

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

300.00%

0.0100

0.0400

-

0.00%	0.0156
MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

100.00%

0.0049

MultiSource/Benchmarks/MallocBench/gs/gs

33.33%

0.0300

0.0400

-

33.33%

0.0040

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0046

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

29.17%

0.7200

0.9300

-

-1.06%

0.0040

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

0.00%	0.0075

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

0.00%	0.0050

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

5.00%

0.0090

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

5.71%	0.0196
MultiSource/Applications/viterbi/viterbi	6.50%	2.0000	2.1300	-	6.50%	0.0102

MultiSource/Benchmarks/nbench/nbench

6.15%

16.9200

17.9600

-

5.83%

0.9244

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C++/global_type

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/pointer_method

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/Regression/C/globalrefs

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

0.00%	0.0049

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/2003-07-10-SignConversions

-100.00%

0.0200

0.0000

-

0.00%	0.0075

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

0.00%	0.0080
SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0083

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-75.00%

0.0400

0.0100

-

-66.67%

0.0080

SingleSource/Regression/C/PR640

-66.67%

0.0300

0.0100

-

-50.00%

0.0046

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-60.00%

0.0500

0.0200

-

-50.00%	0.0064
MultiSource/Benchmarks/McCat/12-IOtest/iotest

-57.14%

0.0700

0.0300

-

-40.00%

0.0090

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

-50.00%

0.0070

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

0.00%	0.0087
SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

-50.00%

0.0083

SingleSource/Benchmarks/Misc/salsa20

-50.00%

0.0400

0.0200

-

-33.33%

0.0081

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Benchmarks/Shootout/heapsort

-50.00%

0.0400

0.0200

-

0.00%	0.0078
SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Benchmarks/Shootout/strcat

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%	0.0040
SingleSource/Regression/C++/global_ctor

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C/2004-08-12-InlinerAndAllocas

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/test_indvars

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0087

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

0.00%	0.0078

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

0.00%	0.0078
SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0054

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-50.00%

0.0200

0.0100

-

0.00%

0.0040

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

0.00%	0.0080
SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-36.36%

0.1100

0.0700

-

-30.00%	0.0130

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%	0.0092

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-30.00%

0.1000

0.0700

-

-22.22%	0.0128

SingleSource/Benchmarks/CoyoteBench/lpbench

-30.00%

0.1000

0.0700

-

0.00%	0.0078

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%	0.0125
MultiSource/Benchmarks/McCat/05-eks/eks	-25.00%	0.4000	0.3000	-	-25.00%	0.0186

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%	0.0067
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

-25.00%

0.0083

MultiSource/Benchmarks/Prolangs-C++/garage/garage

-25.00%

0.0400

0.0300

-

50.00%

0.0094

SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

-25.00%

0.0060

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%

0.0054

SingleSource/Benchmarks/CoyoteBench/huffbench

-22.22%

0.0900

0.0700

-

-12.50%

0.0094

MultiSource/Benchmarks/NPB-serial/is/is

-20.00%

0.0500

0.0400

-

-20.00%

0.0064

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

-20.00%	0.0120

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-20.00%	0.0090
SingleSource/Benchmarks/CoyoteBench/almabench

-20.00%

0.0500

0.0400

-

-33.33%

0.0064

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%	0.0090
SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

33.33%

0.0128

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

-14.29%

0.0117

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

20.00%	0.0083

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

-12.50%	0.0102

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-10.53%	0.0087

SingleSource/Benchmarks/Shootout-C++/reversefile

-10.34%

0.2900

0.2600

-

-13.33%	0.0175
MultiSource/Benchmarks/McCat/09-vor/vor

-8.70%

0.2300

0.2100

-

-12.50%

0.0185

SingleSource/Benchmarks/Shootout-C++/sieve

-8.33%

0.2400

0.2200

-

-4.35%	0.0127
MultiSource/Applications/Burg/burg	-8.33%	0.8400	0.7700	-	-3.75%	0.0496
MultiSource/Benchmarks/sim/sim

-7.69%

0.2600

0.2400

-

-7.69%

0.0092

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%

0.0050

MultiSource/Benchmarks/McCat/18-imp/imp

-7.14%

0.2800

0.2600

-

0.00%	0.0134
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	-7.14%	0.4200	0.3900	-	-9.30%	0.0245
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl

-6.06%

0.3300

0.3100

-

-8.82%

0.0087

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

-5.88%	0.0078
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-5.51%	1.2700	1.2000	-	-0.83%	0.0265

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

-5.00%

0.2000

0.1900

-

0.00%	0.0162
MultiSource/Benchmarks/Olden/voronoi/voronoi

-5.00%

0.2000

0.1900

-

-9.52%

0.0102

SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction

-5.00%

0.4000

0.3800

-

-5.00%

0.0110

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Benchmarks/Shootout-C++/strcat

-25.00%

0.0800

0.0600

-

-25.00%	0.0098

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-14.71%	0.0232
MultiSource/Applications/JM/ldecod/ldecod

-14.29%

0.0700

0.0600

-

100.00%

0.0102
MultiSource/Benchmarks/FreeBench/distray/distray	-14.29%	0.1400	0.1200	-	-14.29%	0.0054

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

20.00%	0.0108

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0100

MultiSource/Benchmarks/Olden/health/health

-13.79%

0.2900

0.2500

-

-3.85%

0.0158

SingleSource/Benchmarks/Shootout-C++/hash

-10.64%

0.4700

0.4200

-

-8.70%	0.0122

SingleSource/Benchmarks/Shootout-C++/methcall

-8.80%

5.0000

4.5600

-

-3.18%

0.0593

SingleSource/Benchmarks/Shootout/strcat

-7.69%

0.1300

0.1200

-

-20.00%	0.0102

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

-7.14%

0.1400

0.1300

-

-7.14%

0.0054

SingleSource/Benchmarks/Misc-C++/Large/ray

-5.90%

3.2200

3.0300

-

0.33%

0.0046

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.49s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current

153975

2012-04-03 22:47:02

0:14:29

Previous

153972

2012-04-03 22:22:05

0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	4	95
Performance Improvements	10	97
Existing Failures	8	8
Unchanged Tests	866	688
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/Threads/tls	200.00%	0.0100	0.0300	0.0054	200.00%	-
SingleSource/Benchmarks/Misc/flops-1	100.00%	0.0200	0.0400	0.0046	100.00%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/mandel-2	48.21%	1.1200	1.6600	0.0466	48.21%	-
MultiSource/Benchmarks/Ptrdist/ft/ft	7.32%	0.8200	0.8800	0.0122	7.32%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/Regression/C/PR1386

-100.00%

0.0200

0.0000

0.0050

-100.00%

-

SingleSource/UnitTests/Vector/SSE/sse_shift	-75.00%	0.0400	0.0100	0.0067	-66.67%	-
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-13.98%	0.9300	0.8000	0.0368	-10.11%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/ary2	-100.00%	0.0300	0.0000	0.0083	-100.00%	-
SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

0.0030

-50.00%

-

MultiSource/Benchmarks/mediabench/g721/g721encode/encode	-20.00%	0.0500	0.0400	0.0030	-20.00%	-
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	-10.81%	0.7400	0.6600	0.0196	-4.35%	-
SingleSource/Benchmarks/McGill/misr	-5.26%	0.1900	0.1800	0.0030	-5.26%	-
MultiSource/Benchmarks/llubenchmark/llu	-3.08%	5.8500	5.6700	0.0372	-2.58%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

100.00%	0.0063

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

0.00%	0.0080

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

0.00%	0.0060
SingleSource/Regression/C++/fixups

200.00%

0.0100

0.0300

-

50.00%

0.0083

SingleSource/UnitTests/Threads/tls

200.00%

0.0100

0.0300

-

200.00%

0.0054

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

25.00%

0.0083

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

100.00%

0.0070

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

100.00%

0.0092

SingleSource/Benchmarks/Misc/flops-1

100.00%

0.0200

0.0400

-

100.00%

0.0046

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

100.00%

0.0092

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

-33.33%

0.0087

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

100.00%

0.0083

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

0.00%

0.0070

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0087

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%	0.0046
SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0078

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

100.00%

0.0066

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

25.00%	0.0090

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%	0.0090

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

12.50%	0.0207

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

12.50%	0.0117

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

12.50%	0.0190

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

15.38%

0.0098

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

40.00%

0.0094

MultiSource/Benchmarks/Olden/power/power

37.50%

0.0800

0.1100

-

0.00%	0.0118

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

35.71%

0.1400

0.1900

-

0.00%

0.0167

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

-11.11%

0.0083

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-20.00%

0.0110

SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

100.00%

0.0077

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%

0.0066

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

100.00%

0.0067

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

28.57%

0.1400

0.1800

-

20.00%	0.0125

MultiSource/Applications/viterbi/viterbi

27.27%

0.1100

0.1400

-

0.00%	0.0110

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

25.00%

0.0400

0.0500

-

0.00%	0.0102
SingleSource/Benchmarks/Shootout/heapsort

25.00%

0.0400

0.0500

-

150.00%

0.0087

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

25.00%	0.0060
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

-8.33%

0.0215

MultiSource/Benchmarks/McCat/08-main/main

21.05%

0.1900

0.2300

-

9.52%	0.0150

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

20.00%

0.1500

0.1800

-

5.88%	0.0108

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

18.75%

0.1600

0.1900

-

11.76%

0.0117

MultiSource/Benchmarks/Ptrdist/ks/ks

18.18%

0.1100

0.1300

-

18.18%

0.0094

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%

0.0049

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

16.67%

0.0120

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0046

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

16.67%

0.0100

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%

0.0066

MultiSource/Applications/spiff/spiff	15.79%	0.5700	0.6600	-	1.54%	0.0224
MultiSource/Benchmarks/VersaBench/dbms/dbms	14.04%	0.5700	0.6500	-	6.56%	0.0197

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

5.88%	0.0155

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

5.88%

0.0080

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

11.11%

0.0090

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0050

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%

0.0090

MultiSource/Benchmarks/mediabench/gsm/toast/toast

9.28%

0.9700

1.0600

-

8.16%	0.0374

MultiSource/Benchmarks/Olden/bh/bh

9.09%

0.2200

0.2400

-

-4.00%	0.0154

MultiSource/Benchmarks/VersaBench/bmm/bmm

9.09%

0.2200

0.2400

-

9.09%	0.0080

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

8.89%

0.4500

0.4900

-

0.00%

0.0238
MultiSource/Applications/lambda-0_1_3/lambda	8.51%	0.4700	0.5100	-	-7.27%	0.0173

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%	0.0083

MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

0.00%	0.0169

SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%	0.0064

MultiSource/Applications/Burg/burg

7.14%

0.8400

0.9000

-

16.88%	0.0549

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

7.14%

0.5600

0.6000

-

-1.64%

0.0221

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%

0.0077

MultiSource/Benchmarks/nbench/nbench

5.95%

0.8400

0.8900

-

-1.11%	0.0172

MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

5.88%

1.0200

1.0800

-

6.93%	0.0420

SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

0.00%

0.0125

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%	0.0046
SingleSource/Benchmarks/Shootout-C++/moments	75.00%	0.0400	0.0700	-	75.00%	0.0104
SingleSource/Benchmarks/Misc/mandel-2	48.21%	1.1200	1.6600	-	48.21%	0.0466
SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%

0.0070

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%	0.0046

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0064

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

29.17%

0.7200

0.9300

-

0.00%

0.0046

SingleSource/Benchmarks/Adobe-C++/loop_unroll	20.14%	1.3900	1.6700	-	0.00%	0.0050
MultiSource/Benchmarks/McCat/18-imp/imp	16.67%	0.0600	0.0700	-	0.00%	0.0040

SingleSource/Benchmarks/Shootout-C++/lists	13.39%	4.9300	5.5900	-	9.61%	0.2030
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%

0.0083

SingleSource/Benchmarks/Shootout-C++/hash2

8.27%

2.5400

2.7500

-

4.17%	0.0770
SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

16.67%

0.0102
MultiSource/Benchmarks/Ptrdist/ft/ft	7.32%	0.8200	0.8800	-	7.32%	0.0122

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%	0.0049
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

6.25%

0.0087

SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

-4.76%

0.0090

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

-100.00%

0.0067

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/Regression/C/2004-02-03-AggregateCopy

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2008-01-07-LongDouble

-100.00%

0.0200

0.0000

-

-100.00%

0.0060

SingleSource/Regression/C/PR1386

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

-100.00%

0.0100

0.0000

-

-100.00%

0.0063

SingleSource/UnitTests/2005-11-29-LongSwitch

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2006-02-04-DivRem

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/Threads/2010-12-08-tls	-100.00%	0.0100	0.0000	-	0.00%	0.0046
SingleSource/UnitTests/block-copied-in-cxxobj-1	-100.00%	0.0100	0.0000	-	-100.00%	0.0050

SingleSource/UnitTests/byval-alignment

-100.00%

0.0200

0.0000

-

-100.00%

0.0054

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Benchmarks/Misc/lowercase

-66.67%

0.0300

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/SignlessTypes/factor

-66.67%

0.0300

0.0100

-

-50.00%

0.0064

SingleSource/UnitTests/Vector/SSE/sse_shift

-66.67%

0.0300

0.0100

-

-75.00%

0.0067

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-60.00%

0.0500

0.0200

-

0.00%	0.0075
SingleSource/UnitTests/SignlessTypes/Large/cast

-60.00%

0.0500

0.0200

-

-50.00%

0.0128

MultiSource/Benchmarks/FreeBench/mason/mason

-57.14%

0.0700

0.0300

-

-40.00%

0.0119

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

-

-50.00%

0.0104

MultiSource/Benchmarks/Olden/treeadd/treeadd

-50.00%

0.0400

0.0200

-

-50.00%

0.0064

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-50.00%

0.0400

0.0200

-

-33.33%

0.0083

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

0.00%	0.0070

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Benchmarks/Misc/salsa20

-50.00%

0.0400

0.0200

-

0.00%	0.0092

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

0.00%	0.0083
SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

0.00%	0.0066

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

0.00%	0.0083

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%	0.0049

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%	0.0080
MultiSource/Benchmarks/McCat/12-IOtest/iotest

-42.86%

0.0700

0.0400

-

33.33%

0.0110

SingleSource/UnitTests/Vector/SSE/sse_isamax

-37.50%

0.0800

0.0500

-

-37.50%

0.0066

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-33.33%

0.0119

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%

0.0092

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

-25.00%

0.0054

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

50.00%

0.0089

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%

0.0054

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

-30.00%	0.0080

MultiSource/Benchmarks/NPB-serial/is/is

-20.00%

0.0500

0.0400

-

0.00%	0.0070

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

0.00%	0.0090

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-20.00%

0.1000

0.0800

-

14.29%

0.0128

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0090

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount	-16.67%	0.1800	0.1500	-	-21.05%	0.0175

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-16.67%

0.1800

0.1500

-

-11.76%

0.0134

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

0.00%	0.0117

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

0.00%	0.0075
SingleSource/Benchmarks/Shootout-C++/wc

-14.29%

0.2100

0.1800

-

-10.00%

0.0128

SingleSource/Benchmarks/Shootout-C++/lists

-13.04%

0.2300

0.2000

-

-16.67%

0.0155

SingleSource/Benchmarks/Shootout-C++/fibo

-11.76%

0.1700

0.1500

-

-11.76%	0.0102
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-10.11%	0.8900	0.8000	-	-13.98%	0.0368
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-10.00%

0.1000

0.0900

-

-10.00%

0.0133

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

28.57%

0.0083

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-9.09%

0.5500

0.5000

-

-7.41%	0.0225

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

-4.76%	0.0090
SingleSource/Benchmarks/Misc-C++/Large/sphereflake

-8.00%

0.2500

0.2300

-

-4.17%

0.0194

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-7.69%

0.0094

MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl

-7.14%

0.7000

0.6500

-

-8.45%	0.0487

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-6.30%

1.2700

1.1900

-

-0.83%	0.0237

SingleSource/Benchmarks/Shootout-C++/spellcheck

-6.25%

0.3200

0.3000

-

-6.25%	0.0094

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

0.00%	0.0087

MultiSource/Benchmarks/Olden/voronoi/voronoi

-5.00%

0.2000

0.1900

-

0.00%

0.0125

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout-C++/ary2

-100.00%

0.0300

0.0000

-

-100.00%

0.0083

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

-

-50.00%

0.0030

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-33.33%	0.0112

MultiSource/Benchmarks/Olden/mst/mst

-37.50%

0.0800

0.0500

-

-37.50%

0.0090

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0066

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-25.00%

0.0400

0.0300

-

-40.00%

0.0078

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

-20.00%

0.0500

0.0400

-

-20.00%

0.0030

MultiSource/Benchmarks/Olden/treeadd/treeadd

-19.05%

0.2100

0.1700

-

-19.05%	0.0111

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

0.00%

0.0104

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

0.00%

0.0100

MultiSource/Benchmarks/Olden/health/health

-13.79%

0.2900

0.2500

-

0.00%	0.0150

SingleSource/Benchmarks/Misc-C++/bigfib

-11.76%

0.3400

0.3000

-

3.45%	0.0232

SingleSource/Benchmarks/Shootout-C++/hash

-10.64%

0.4700

0.4200

-

0.00%	0.0149
SingleSource/Benchmarks/Shootout-C++/methcall	-8.00%	5.0000	4.6000	-	0.88%	0.0677

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%	0.0046

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

-0.33%	0.0054
SingleSource/Benchmarks/McGill/misr

-5.26%

0.1900

0.1800

-

-5.26%

0.0030

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.42s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153979	2012-04-03 23:51:10	0:14:28
Previous	153976	2012-04-03 23:12:01	0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	90
Performance Improvements	16	103
Existing Failures	8	8
Unchanged Tests	861	687
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Execution Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/BitBench/five11/five11	6.56%	1.8300	1.9500	0.0081	6.56%	-
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow	3.03%	0.3300	0.3400	0.0000	3.03%	-
SingleSource/Benchmarks/Dhrystone/dry	1.00%	2.0000	2.0200	0.0040	1.00%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/ackermann

-100.00%

0.0200

0.0000

0.0064

-100.00%

-

SingleSource/UnitTests/Vector/build	-100.00%	0.0200	0.0000	0.0050	0.00%	-
SingleSource/Regression/C++/EH/exception_spec_test	-66.67%	0.0300	0.0100	0.0046	-50.00%	-
SingleSource/Benchmarks/BenchmarkGame/puzzle	-50.00%	0.0400	0.0200	0.0050	-50.00%	-
SingleSource/Benchmarks/Misc-C++/Large/ray	-14.81%	0.2700	0.2300	0.0110	-11.54%	-
MultiSource/Benchmarks/sim/sim	-11.54%	0.2600	0.2300	0.0100	-11.54%	-
SingleSource/Benchmarks/Shootout-C++/moments	-9.38%	0.3200	0.2900	0.0092	-3.33%	-
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl	-9.09%	0.3300	0.3000	0.0104	-9.09%	-
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc	-4.52%	7.0800	6.7600	0.0581	-3.43%	-
MultiSource/Benchmarks/mafft/pairlocalalign	-1.43%	6.9800	6.8800	0.0332	0.88%	-
MultiSource/Applications/oggenc/oggenc	-1.30%	3.8600	3.8100	0.0127	-4.99%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/strcat	-44.44%	0.0900	0.0500	0.0092	-37.50%	-
MultiSource/Benchmarks/FreeBench/pifft/pifft	-10.00%	0.1000	0.0900	0.0030	-10.00%	-
SingleSource/Benchmarks/Shootout-C++/lists1	-10.00%	0.2000	0.1800	0.0060	-5.26%	-
SingleSource/UnitTests/Vector/SSE/sse_expandfft	-6.06%	0.3300	0.3100	0.0046	-6.06%	-
SingleSource/Benchmarks/Shootout-C++/ary3	-1.11%	1.8000	1.7800	0.0060	-0.56%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0080

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%

0.0075

MultiSource/Applications/aha/aha

100.00%

0.0500

0.1000

-

42.86%	0.0102

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

33.33%	0.0075

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

-20.00%	0.0078

SingleSource/Benchmarks/BenchmarkGame/fannkuch

100.00%

0.0200

0.0400

-

0.00%

0.0049

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0064

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%	0.0080

SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

-50.00%	0.0075
SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0094

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0087

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

100.00%

0.0070

SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%	0.0040

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%	0.0083
SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%

0.0077

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%	0.0075

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0090

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

0.00%

0.0050

SingleSource/UnitTests/SignlessTypes/cast2

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%	0.0064

MultiSource/Benchmarks/Olden/mst/mst

66.67%

0.0600

0.1000

-

42.86%	0.0173

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

-16.67%	0.0080
SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

25.00%

0.0049

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

-3.57%	0.0167

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

7.14%	0.0100

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

42.86%

0.1400

0.2000

-

25.00%	0.0114

SingleSource/Benchmarks/Shootout/matrix

40.00%

0.0500

0.0700

-

40.00%

0.0098

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

10.00%	0.0078
MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

33.33%

0.0081

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

33.33%	0.0087

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

0.00%	0.0098

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

0.00%	0.0100
SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

-20.00%

0.0060

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%	0.0066

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

33.33%

0.0900

0.1200

-

0.00%	0.0209

MultiSource/Benchmarks/Olden/health/health

33.33%

0.0900

0.1200

-

0.00%

0.0108

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

-14.29%	0.0158

MultiSource/Applications/viterbi/viterbi

27.27%

0.1100

0.1400

-

16.67%	0.0104
MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

11.11%

0.0118

SingleSource/Benchmarks/Dhrystone/dry

25.00%

0.0400

0.0500

-

66.67%

0.0070
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch	20.00%	0.1000	0.1200	-	9.09%	0.0134

MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

17.65%	0.0111

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

16.67%

0.0112

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%	0.0050

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%	0.0066

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

13.33%

0.0127
MultiSource/Applications/Burg/burg	13.10%	0.8400	0.9500	-	11.76%	0.0559

MultiSource/Benchmarks/McCat/09-vor/vor

13.04%

0.2300

0.2600

-

4.00%	0.0190
SingleSource/Benchmarks/Shootout-C++/hello

12.50%

0.1600

0.1800

-

0.00%

0.0080

MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

-9.09%

0.0118

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

0.00%

0.0063

SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

5.26%

0.0092

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0049

MultiSource/Applications/hexxagon/hexxagon

10.26%

0.7800

0.8600

-

3.61%

0.0215

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

10.00%	0.0102

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%

0.0080

MultiSource/Applications/spiff/spiff

8.77%

0.5700

0.6200

-

-3.13%	0.0151

MultiSource/Applications/lambda-0_1_3/lambda

8.51%

0.4700

0.5100

-

-5.56%	0.0174

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%

0.0075
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2	8.33%	0.4800	0.5200	-	4.00%	0.0223

SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

-3.57%	0.0104
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

0.00%

0.0075

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

7.14%

0.5600

0.6000

-

11.11%	0.0256

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

6.25%

0.1600

0.1700

-

21.43%	0.0127

SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

0.00%

0.0063

SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

-10.53%

0.0150

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

300.00%

0.0100

0.0400

-

0.00%

0.0178

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/Benchmarks/Stanford/Treesort

40.00%

0.0500

0.0700

-

16.67%

0.0064

MultiSource/Benchmarks/MallocBench/gs/gs

33.33%

0.0300

0.0400

-

33.33%

0.0045

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

300.00%	0.0092

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0049

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%

0.0049
SingleSource/Benchmarks/Shootout/strcat	23.08%	0.1300	0.1600	-	6.67%	0.0108
SingleSource/Benchmarks/Adobe-C++/loop_unroll	20.86%	1.3900	1.6800	-	0.00%	0.0050

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/hash2

8.27%

2.5400

2.7500

-

1.85%	0.0471
MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

-

16.67%

0.0054

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

4.23%	0.0255

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%

0.0050
MultiSource/Benchmarks/BitBench/five11/five11	6.56%	1.8300	1.9500	-	6.56%	0.0081
MultiSource/Benchmarks/nbench/nbench	6.38%	16.9200	18.0000	-	0.11%	0.4352

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

13.33%

0.0077

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0092

SingleSource/Benchmarks/Shootout/ackermann

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

0.00%

0.0066

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

0.00%

0.0040

SingleSource/UnitTests/2004-02-02-NegativeZero

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2005-07-17-INT-To-FP

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-100.00%

0.0200

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/SignlessTypes/factor

-66.67%

0.0300

0.0100

-

-50.00%

0.0080

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

-

0.00%	0.0094
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-50.00%

0.0400

0.0200

-

-33.33%

0.0050

SingleSource/Benchmarks/BenchmarkGame/puzzle

-50.00%

0.0400

0.0200

-

-50.00%

0.0050

SingleSource/Benchmarks/BenchmarkGame/recursive

-50.00%

0.0200

0.0100

-

-50.00%	0.0064
SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%

0.0089

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/Regression/C++/EH/exception_spec_test

-50.00%

0.0200

0.0100

-

-66.67%

0.0046

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0060

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/PR491

-50.00%

0.0200

0.0100

-

-50.00%	0.0064
SingleSource/Regression/C/bigstack

-50.00%

0.0400

0.0200

-

-50.00%

0.0119

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0081

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/FloatPrecision

-50.00%

0.0200

0.0100

-

-50.00%	0.0066
SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%

0.0075

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-42.86%

0.0700

0.0400

-

0.00%	0.0122

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

50.00%	0.0089
SingleSource/Benchmarks/BenchmarkGame/n-body

-33.33%

0.0600

0.0400

-

-33.33%

0.0078
SingleSource/Benchmarks/CoyoteBench/huffbench	-33.33%	0.0900	0.0600	-	-14.29%	0.0089
SingleSource/Benchmarks/McGill/exptree

-33.33%

0.0600

0.0400

-

-33.33%

0.0098

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%

0.0122

SingleSource/Benchmarks/Misc/ffbench

-28.57%

0.0700

0.0500

-

-28.57%	0.0064
MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

-25.00%

0.0075

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%

0.0075

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

0.00%

0.0078

MultiSource/Benchmarks/Prolangs-C++/garage/garage

-25.00%

0.0400

0.0300

-

-25.00%

0.0087

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

0.00%

0.0094

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

-25.00%	0.0040

SingleSource/Benchmarks/Stanford/Puzzle

-25.00%

0.0800

0.0600

-

0.00%	0.0078

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

0.00%

0.0080

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

-22.22%	0.0092

MultiSource/Benchmarks/Olden/perimeter/perimeter

-20.00%

0.0500

0.0400

-

-42.86%	0.0094

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

-20.00%	0.0100

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0087

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-18.18%

0.1100

0.0900

-

-10.00%	0.0142

MultiSource/Benchmarks/Olden/em3d/em3d

-15.38%

0.1300

0.1100

-

0.00%	0.0174

MultiSource/Benchmarks/Olden/voronoi/voronoi

-15.00%

0.2000

0.1700

-

-15.00%

0.0120

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

0.00%

0.0114

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

-13.33%

0.1500

0.1300

-

0.00%

0.0145
SingleSource/Benchmarks/Misc-C++/Large/sphereflake	-12.00%	0.2500	0.2200	-	-12.00%	0.0201
MultiSource/Benchmarks/sim/sim

-11.54%

0.2600

0.2300

-

-11.54%

0.0100
SingleSource/Benchmarks/Misc-C++/Large/ray	-11.54%	0.2600	0.2300	-	-14.81%	0.0110
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode	-11.24%	0.8900	0.7900	-	-13.19%	0.0402
MultiSource/Benchmarks/Prolangs-C/bison/mybison	-9.62%	1.0400	0.9400	-	-10.48%	0.0265
SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-9.52%

0.0102

SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

-5.00%	0.0127
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl	-9.09%	0.3300	0.3000	-	-9.09%	0.0104
MultiSource/Benchmarks/Prolangs-C/archie-client/archie	-8.89%	0.4500	0.4100	-	-16.33%	0.0257
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm	-8.82%	1.0200	0.9300	-	-7.92%	0.0450

MultiSource/Benchmarks/SciMark2-C/scimark2

-8.70%

0.2300

0.2100

-

-16.00%	0.0282
SingleSource/Benchmarks/Shootout-C++/ary2	-8.70%	0.2300	0.2100	-	-4.55%	0.0111

SingleSource/Benchmarks/Shootout-C++/sieve

-8.33%

0.2400

0.2200

-

-8.33%	0.0098

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%	0.0050

SingleSource/Benchmarks/Shootout-C++/wordfreq

-7.69%

0.2600

0.2400

-

0.00%

0.0090
MultiSource/Benchmarks/McCat/05-eks/eks	-7.50%	0.4000	0.3700	-	-5.13%	0.0298

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-7.27%

0.5500

0.5100

-

2.00%	0.0215

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-7.09%

1.2700

1.1800

-

-4.07%	0.0253

SingleSource/Benchmarks/Shootout-C++/nestedloop

-5.88%

0.1700

0.1600

-

-5.88%	0.0083

MultiSource/Benchmarks/McCat/08-main/main

-5.26%

0.1900

0.1800

-

-14.29%	0.0164

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

5.88%	0.0075
SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

0.00%

0.0098

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout-C++/ary2

-66.67%

0.0300

0.0100

-

-75.00%

0.0120

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

0.00%	0.0075

SingleSource/Benchmarks/Shootout-C++/strcat

-37.50%

0.0800

0.0500

-

-44.44%	0.0092

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-16.67%	0.0075

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-25.00%

0.0400

0.0300

-

-25.00%	0.0083

MultiSource/Benchmarks/Olden/treeadd/treeadd

-23.81%

0.2100

0.1600

-

-27.27%	0.0162

MultiSource/Benchmarks/McCat/09-vor/vor

-18.18%

0.1100

0.0900

-

-10.00%	0.0063

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

-14.29%	0.0111
MultiSource/Benchmarks/FreeBench/pifft/pifft

-10.00%

0.1000

0.0900

-

-10.00%

0.0030
SingleSource/Benchmarks/Shootout-C++/methcall	-9.00%	5.0000	4.5500	-	-3.40%	0.0631

MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

-6.90%	0.0175

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

-2.22%	0.0149

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.33%	0.0060
SingleSource/UnitTests/Vector/SSE/sse_expandfft	-6.06%	0.3300	0.3100	-	-6.06%	0.0046

MultiSource/Applications/spiff/spiff

-5.91%

1.8600

1.7500

-

-2.23%	0.0519
SingleSource/Benchmarks/Shootout-C++/lists1

-5.26%

0.1900

0.1800

-

-10.00%

0.0060

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.49s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153982	2012-04-04 00:49:20	0:14:29
Previous	153980	2012-04-04 00:15:58	0:14:27

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	5	83
Performance Improvements	10	99
Existing Failures	8	8
Unchanged Tests	865	698
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time

Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/nestedloop	11.76%	0.1700	0.1900	0.0075	11.76%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Applications/JM/ldecod/ldecod	40.00%	0.0500	0.0700	0.0075	0.00%	-
MultiSource/Benchmarks/Ptrdist/ft/ft	22.22%	0.8100	0.9900	0.0220	20.73%	-

SingleSource/Benchmarks/Stanford/FloatMM

2.44%

0.4100

0.4200

0.0030

0.00%

-

MultiSource/Applications/minisat/minisat

1.39%

6.4600

6.5500

0.0119

2.18%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/mandel-2	-75.00%	0.0400	0.0100	0.0030	-66.67%	-
SingleSource/UnitTests/2003-07-09-SignedArgs	-66.67%	0.0300	0.0100	0.0046	-66.67%	-
SingleSource/Regression/C++/pointer_method2

-50.00%

0.0200

0.0100

0.0030

0.00%

-

SingleSource/UnitTests/printargs

-50.00%

0.0200

0.0100

0.0030

0.00%

-

MultiSource/Benchmarks/VersaBench/beamformer/beamformer	-40.00%	0.1000	0.0600	0.0083	-33.33%	-
SingleSource/Benchmarks/Shootout-C++/objinst	-15.79%	0.1900	0.1600	0.0092	-5.88%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/ary

-66.67%

0.0300

0.0100

0.0049

-66.67%

-

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

0.0030

-50.00%

-

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

-20.00%

0.0500

0.0400

0.0030

-20.00%

-

MultiSource/Benchmarks/Ptrdist/bc/bc

-6.25%

0.4800

0.4500

0.0092

-10.00%

-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

0.00%	0.0090

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

33.33%	0.0077

SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0066

SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

0.00%

0.0092

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0098

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/Regression/C/2003-05-21-UnionBitfields

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0077

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0090

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/DefaultInitDynArrays

100.00%

0.0100

0.0200

-

100.00%

0.0075

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

100.00%	0.0040

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

0.00%	0.0049

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

66.67%	0.0098

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

66.67%	0.0066

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-11.11%	0.0104

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

0.00%	0.0092

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

12.50%

0.0136

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

-6.25%	0.0102
MultiSource/Benchmarks/Prolangs-C/compiler/compiler	47.06%	0.1700	0.2500	-	-7.41%	0.0145

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

44.44%

0.0900

0.1300

-

0.00%

0.0122

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

-8.33%	0.0098

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%	0.0064

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

-11.11%	0.0102
SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

33.33%

0.0070

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

33.33%

0.0078

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

0.00%

0.0046

MultiSource/Benchmarks/Olden/health/health

33.33%

0.0900

0.1200

-

0.00%

0.0120

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

28.57%

0.1400

0.1800

-

-10.00%	0.0162

MultiSource/Benchmarks/Ptrdist/anagram/anagram

28.57%

0.0700

0.0900

-

28.57%	0.0064
MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

25.00%

0.0054

MultiSource/Benchmarks/McCat/15-trie/trie

25.00%

0.0400

0.0500

-

66.67%

0.0089

MultiSource/Benchmarks/Olden/power/power

25.00%

0.0800

0.1000

-

11.11%

0.0110

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

66.67%

0.0080

MultiSource/Benchmarks/McCat/04-bisect/bisect

22.22%

0.0900

0.1100

-

22.22%	0.0100
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

21.43%

0.1400

0.1700

-

-10.53%

0.0147
MultiSource/Benchmarks/Olden/voronoi/voronoi	20.00%	0.2000	0.2400	-	9.09%	0.0147

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

18.75%

0.1600

0.1900

-

5.56%	0.0133

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

-7.14%	0.0089

MultiSource/Benchmarks/Prolangs-C++/objects/objects

16.67%

0.0600

0.0700

-

-12.50%	0.0117
SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%

0.0114

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

0.00%	0.0160

SingleSource/Benchmarks/Misc/oourafft

12.50%

0.1600

0.1800

-

20.00%	0.0075

MultiSource/Applications/spiff/spiff

12.28%

0.5700

0.6400

-

-3.03%	0.0149

MultiSource/Benchmarks/VersaBench/dbms/dbms

12.28%

0.5700

0.6400

-

-3.03%

0.0305
SingleSource/Benchmarks/Shootout-C++/lists1	12.00%	0.2500	0.2800	-	3.70%	0.0108
SingleSource/Benchmarks/Shootout-C++/nestedloop

11.76%

0.1700

0.1900

-

11.76%

0.0075

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

-4.76%	0.0080

SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

11.11%	0.0060

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

0.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/shapes/shapes

9.09%

0.2200

0.2400

-

0.00%

0.0078

MultiSource/Benchmarks/VersaBench/bmm/bmm

9.09%

0.2200

0.2400

-

4.35%	0.0092

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

0.00%

0.0064

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

0.00%	0.0158

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

7.14%

0.5600

0.6000

-

3.45%	0.0224

SingleSource/Benchmarks/CoyoteBench/fftbench

6.67%

0.3000

0.3200

-

6.67%	0.0108

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

-6.74%	0.0262
SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

6.25%

0.0092

SingleSource/Regression/C++/ofstream_ctor

6.25%

0.1600

0.1700

-

-10.53%

0.0108

MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

5.88%

1.0200

1.0800

-

11.34%	0.0516

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

11.76%	0.0148

MultiSource/Applications/hbd/hbd

5.56%

1.0800

1.1400

-

-4.20%	0.0506

MultiSource/Benchmarks/mediabench/gsm/toast/toast

5.15%

0.9700

1.0200

-

-5.56%

0.0429

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

400.00%

0.0100

0.0500

-

150.00%

0.0151

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0046

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%	0.0092

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0040

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

-1.05%	0.0060
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0083
MultiSource/Benchmarks/Ptrdist/ft/ft	20.73%	0.8200	0.9900	-	22.22%	0.0220

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

-1.18%

0.0064

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0040

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

0.00%

0.0049

SingleSource/Benchmarks/Shootout-C++/lists	10.14%	4.9300	5.4300	-	10.14%	0.2100

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

6.67%

0.0049

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0050

SingleSource/Benchmarks/Shootout-C++/lists1

5.26%

0.1900

0.2000

-

-9.09%

0.0104

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/ackermann

-100.00%

0.0200

0.0000

-

-100.00%

0.0081

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2003-06-16-InvalidInitializer

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/2002-08-02-CastTest2

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2003-07-08-BitOpsTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/2005-05-13-SDivTwo

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

-

0.00%

0.0060

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/stmtexpr

-100.00%

0.0200

0.0000

-

-100.00%

0.0060

SingleSource/Benchmarks/Misc/mandel-2

-66.67%

0.0300

0.0100

-

-75.00%

0.0030

SingleSource/UnitTests/2003-07-09-SignedArgs

-66.67%

0.0300

0.0100

-

-66.67%

0.0046

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-50.00%

0.0400

0.0200

-

-33.33%

0.0077

SingleSource/Benchmarks/BenchmarkGame/fannkuch

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%

0.0080

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/UnitTests/2002-08-19-CodegenBug

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%

0.0070

SingleSource/UnitTests/2003-05-02-DependentPHI

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/Vector/SSE/sse_isamax	-50.00%	0.0800	0.0400	-	-20.00%	0.0087
SingleSource/UnitTests/Vector/multiplies

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

0.00%

0.0064

MultiSource/Benchmarks/FreeBench/mason/mason

-42.86%

0.0700

0.0400

-

-20.00%

0.0118

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%	0.0075
MultiSource/Benchmarks/VersaBench/beamformer/beamformer	-33.33%	0.0900	0.0600	-	-40.00%	0.0083
SingleSource/Benchmarks/McGill/misr

-33.33%

0.0600

0.0400

-

0.00%

0.0066

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%

0.0060

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-40.00%	0.0092
SingleSource/Benchmarks/BenchmarkGame/puzzle

-25.00%

0.0400

0.0300

-

50.00%

0.0078

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

-25.00%

0.0077

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

0.00%

0.0083

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

-25.00%

0.0090

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

-25.00%

0.0100

MultiSource/Benchmarks/Olden/bisort/bisort

-20.00%

0.0500

0.0400

-

0.00%

0.0098

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

33.33%	0.0077
SingleSource/Benchmarks/Misc/perlin

-20.00%

0.0500

0.0400

-

-20.00%

0.0083

SingleSource/Benchmarks/Misc/richards_benchmark

-20.00%

0.0500

0.0400

-

-20.00%

0.0066

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-14.29%

0.0110

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

0.00%

0.0126

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0075
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-14.29%	0.7000	0.6000	-	-18.92%	0.0484

MultiSource/Benchmarks/SciMark2-C/scimark2

-13.04%

0.2300

0.2000

-

-4.76%

0.0293

MultiSource/Benchmarks/McCat/05-eks/eks

-12.50%

0.4000

0.3500

-

-14.63%	0.0300

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

6.67%	0.0125
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

28.57%

0.0134

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

0.00%	0.0098
SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

-10.00%

0.0066

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

0.00%	0.0092

SingleSource/Benchmarks/Shootout-C++/ary2

-8.70%

0.2300

0.2100

-

-12.50%	0.0127

SingleSource/Benchmarks/Shootout-C++/lists

-8.70%

0.2300

0.2100

-

-8.70%	0.0143

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-8.66%

1.2700

1.1600

-

0.00%	0.0219
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-8.62%	0.5800	0.5300	-	-15.87%	0.0348

SingleSource/Benchmarks/Shootout-C++/sieve

-8.33%

0.2400

0.2200

-

-12.00%	0.0111
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-7.69%

0.2600

0.2400

-

-7.69%

0.0090

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

0.00%

0.0050

SingleSource/Benchmarks/Misc/himenobmtxpa

-7.69%

0.1300

0.1200

-

-14.29%	0.0064
SingleSource/Benchmarks/Misc/ReedSolomon

-6.25%

0.1600

0.1500

-

0.00%

0.0066

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

-6.25%

0.4800

0.4500

-

-8.16%	0.0189
SingleSource/Benchmarks/Shootout-C++/objinst	-5.88%	0.1700	0.1600	-	-15.79%	0.0092

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-5.62%

0.8900

0.8400

-

-6.67%	0.0492

SingleSource/Benchmarks/Shootout-C++/except

-5.26%

0.1900

0.1800

-

0.00%	0.0063

SingleSource/Benchmarks/Shootout-C++/methcall

-5.26%

0.1900

0.1800

-

5.88%

0.0098

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/Benchmarks/Shootout-C++/ary

-66.67%

0.0300

0.0100

-

-66.67%

0.0049

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-50.00%

0.0030

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

-

0.00%

0.0046

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-16.67%

0.0030

MultiSource/Benchmarks/McCat/08-main/main

-25.00%

0.0400

0.0300

-

-25.00%

0.0040

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0066

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

-20.00%

0.0500

0.0400

-

-20.00%

0.0030

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

0.00%

0.0046

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

0.00%

0.0110

MultiSource/Benchmarks/Olden/treeadd/treeadd

-14.29%

0.2100

0.1800

-

5.88%

0.0185
MultiSource/Benchmarks/Ptrdist/bc/bc	-10.00%	0.5000	0.4500	-	-6.25%	0.0092
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame

-8.33%

0.2400

0.2200

-

-8.33%

0.0064

SingleSource/Benchmarks/Shootout/strcat

-7.69%

0.1300

0.1200

-

-14.29%	0.0126

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

-4.35%	0.0149
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

-6.25%

0.1600

0.1500

-

-6.25%

0.0075

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%	0.0054

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.00%

0.0717

MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4

-5.26%

0.3800

0.3600

-

-2.70%	0.0080

SingleSource/Benchmarks/McGill/misr

-5.26%

0.1900

0.1800

-

-18.18%

0.0098

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.42s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153990	2012-04-04 02:05:50	0:14:29
Previous	153989	2012-04-04 01:40:56	0:14:29

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	4	80
Performance Improvements	9	109
Existing Failures	8	8
Unchanged Tests	867	691
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/BitBench/uuencode/uuencode	66.67%	0.0300	0.0500	0.0064	0.00%	-
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	11.76%	0.5100	0.5700	0.0156	3.64%	-
SingleSource/Benchmarks/Shootout-C++/except	11.11%	0.1800	0.2000	0.0060	5.26%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Dhrystone/dry

3.48%

2.0100

2.0800

0.0066

4.00%

-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Misc/flops-3	-100.00%	0.0300	0.0000	0.0054	-100.00%	-
SingleSource/Regression/C++/BuiltinTypeInfo

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/UnitTests/2006-12-07-Compare64BitConstant

-100.00%

0.0200

0.0000

0.0049

0.00%

-

SingleSource/UnitTests/SignlessTypes/shr

-66.67%

0.0300

0.0100

0.0049

-66.67%

-

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia	-33.33%	0.0900	0.0600	0.0067	0.00%	-
SingleSource/Benchmarks/Misc/flops	-25.00%	0.0800	0.0600	0.0064	-25.00%	-
SingleSource/Benchmarks/Shootout-C++/hello	-11.76%	0.1700	0.1500	0.0070	-6.25%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/18-imp/imp	-14.29%	0.0700	0.0600	0.0030	0.00%	-
SingleSource/Benchmarks/Shootout-C++/heapsort	-1.66%	2.4100	2.3700	0.0104	-0.84%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

200.00%

0.0100

0.0300

-

50.00%	0.0094
SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

0.00%

0.0049

SingleSource/Benchmarks/Misc-C++/mandel-text

200.00%

0.0100

0.0300

-

200.00%

0.0078

SingleSource/Benchmarks/Misc/fp-convert

200.00%

0.0100

0.0300

-

50.00%

0.0030

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

50.00%

0.0104

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

50.00%	0.0064
MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

25.00%

0.0063

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

100.00%

0.0300

0.0600

-

20.00%	0.0092

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

100.00%

0.0060

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

100.00%

0.0080

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

0.00%	0.0067
SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0083

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/Threads/tls

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0040

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

66.67%

0.0300

0.0500

-

150.00%	0.0100

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-11.11%

0.0098

MultiSource/Benchmarks/Olden/mst/mst

50.00%

0.0600

0.0900

-

50.00%	0.0126

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

47.06%

0.1700

0.2500

-

-10.71%	0.0128

MultiSource/Benchmarks/Ptrdist/ft/ft

40.00%

0.1000

0.1400

-

16.67%	0.0134

MultiSource/Applications/viterbi/viterbi

36.36%

0.1100

0.1500

-

50.00%	0.0122

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-33.33%	0.0090
SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

0.00%

0.0083

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

100.00%	0.0090
SingleSource/Benchmarks/Misc/mandel-2

33.33%

0.0300

0.0400

-

100.00%

0.0112

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%	0.0066

SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

33.33%	0.0049
SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

0.00%

0.0104

MultiSource/Benchmarks/MiBench/security-sha/security-sha

28.57%

0.0700

0.0900

-

12.50%	0.0092
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

-10.00%

0.0140

MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

-9.09%	0.0098
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

25.00%

0.0400

0.0500

-

66.67%

0.0102

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

-5.56%	0.0145

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

20.00%

0.1500

0.1800

-

-5.26%	0.0135

MultiSource/Applications/lambda-0_1_3/lambda

17.02%

0.4700

0.5500

-

0.00%	0.0169
MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

16.67%

0.0119
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk	12.20%	0.4100	0.4600	-	12.20%	0.0219

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

18.75%	0.0122
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

11.11%

0.0900

0.1000

-

0.00%

0.0114

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

-9.09%

0.0100

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

5.26%	0.0092
MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

0.00%

0.0122

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

3.13%	0.0119

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%

0.0066

MultiSource/Applications/spiff/spiff

8.77%

0.5700

0.6200

-

-7.46%	0.0262
MultiSource/Benchmarks/McCat/09-vor/vor

8.70%

0.2300

0.2500

-

19.05%

0.0207

MultiSource/Applications/sgefa/sgefa

8.00%

0.2500

0.2700

-

8.00%

0.0170

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

7.69%	0.0155

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

-6.67%	0.0090
SingleSource/Benchmarks/Misc/himenobmtxpa

7.69%

0.1300

0.1400

-

0.00%

0.0087

MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk

6.67%

0.1500

0.1600

-

14.29%	0.0122

SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

0.00%	0.0137

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

6.67%

0.4500

0.4800

-

11.63%	0.0276

MultiSource/Applications/hexxagon/hexxagon

6.41%

0.7800

0.8300

-

-2.35%	0.0253

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

6.25%

0.1600

0.1700

-

0.00%	0.0155

MultiSource/Benchmarks/mediabench/gsm/toast/toast

6.19%

0.9700

1.0300

-

1.98%	0.0350

MultiSource/Applications/Burg/burg

5.95%

0.8400

0.8900

-

5.95%	0.0495
SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

5.56%

0.0078

SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

11.11%

0.0060

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

200.00%

0.0100

0.0300

-

200.00%

0.0173

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/moments

50.00%

0.0400

0.0600

-

50.00%

0.0102

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0090

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

33.33%	0.0040

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

0.00%	0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%	0.0066
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32	13.64%	0.2200	0.2500	-	0.00%	0.0125

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%	0.0050

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

10.53%	0.0108

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

-6.67%	0.0174
SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

0.00%

0.0049

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

7.25%

0.6900

0.7400

-

0.00%	0.0259

MultiSource/Benchmarks/nbench/nbench

6.38%

16.9200

18.0000

-

5.88%

0.5645

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

0.00%

0.0050

Performance Improvements - Compile Time

Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/flops-3

-100.00%

0.0300

0.0000

-

-100.00%

0.0054

SingleSource/Regression/C++/BuiltinTypeInfo

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/EH/ctor_dtor_count

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/Regression/C++/EH/simple_throw

-100.00%

0.0100

0.0000

-

-100.00%

0.0080

SingleSource/Regression/C++/short_circuit_dtor

-100.00%

0.0100

0.0000

-

0.00%

0.0067

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C/2004-03-15-IndirectGoto

-100.00%

0.0200

0.0000

-

0.00%

0.0066

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest3

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/2002-05-19-DivTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2002-10-09-ArrayResolution

-100.00%

0.0100

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0077

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

0.00%	0.0049
SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

-

-100.00%	0.0070
SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/SignlessTypes/cast2

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

0.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0054

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/ms_struct-bitfield-init

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/ms_struct_pack_layout-1

-100.00%

0.0100

0.0000

-

-100.00%	0.0049
SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-66.67%

0.0080

SingleSource/Benchmarks/Stanford/Perm

-66.67%

0.0300

0.0100

-

-50.00%

0.0060

SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-50.00%

0.0092

SingleSource/UnitTests/SignlessTypes/shr

-66.67%

0.0300

0.0100

-

-66.67%

0.0049

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-50.00%

0.0400

0.0200

-

0.00%

0.0108

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-50.00%

0.0400

0.0200

-

0.00%

0.0070

MultiSource/Benchmarks/Olden/treeadd/treeadd

-50.00%

0.0400

0.0200

-

0.00%

0.0102

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

0.00%

0.0080

SingleSource/Benchmarks/Shootout/ary3

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/Benchmarks/Shootout/heapsort

-50.00%

0.0400

0.0200

-

-60.00%

0.0102

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

0.00%	0.0066
SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0077

SingleSource/Regression/C/PR1386

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

0.00%

0.0080

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%

0.0081

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%	0.0064
SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/Benchmarks/Misc/perlin

-40.00%

0.0500

0.0300

-

-25.00%

0.0083

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

0.00%

0.0092

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-28.57%

0.0700

0.0500

-

-16.67%

0.0077

MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

0.00%

0.0054

MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

200.00%	0.0102
MultiSource/Benchmarks/Prolangs-C++/garage/garage

-25.00%

0.0400

0.0300

-

-40.00%

0.0078

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

-25.00%

0.0092

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

0.00%	0.0078
SingleSource/Benchmarks/Misc/flops

-25.00%

0.0800

0.0600

-

-25.00%

0.0064

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

0.00%

0.0054

SingleSource/Regression/C/bigstack

-25.00%

0.0400

0.0300

-

0.00%

0.0118

SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls

-25.00%

0.0400

0.0300

-

0.00%	0.0066
MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

-20.00%

0.0089

MultiSource/Benchmarks/NPB-serial/is/is

-20.00%

0.0500

0.0400

-

0.00%

0.0070

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

33.33%

0.0054

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

-20.00%

0.0117

SingleSource/Benchmarks/Misc-C++/oopack_v1p8

-18.18%

0.1100

0.0900

-

12.50%

0.0089
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	-16.67%	0.4200	0.3500	-	-10.26%	0.0289

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

50.00%

0.0092

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0075

SingleSource/Benchmarks/Shootout-C++/ary2

-13.04%

0.2300

0.2000

-

0.00%	0.0110

SingleSource/Benchmarks/Misc/ReedSolomon

-12.50%

0.1600

0.1400

-

-6.67%	0.0081
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

-11.11%

0.1800

0.1600

-

-20.00%

0.0201

SingleSource/Benchmarks/Shootout-C++/strcat

-11.11%

0.1800

0.1600

-

-5.88%	0.0077

SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

6.25%	0.0094
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell	-10.24%	1.2700	1.1400	-	-3.39%	0.0237
MultiSource/Benchmarks/McCat/05-eks/eks

-10.00%

0.4000

0.3600

-

-7.69%

0.0327

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

12.50%	0.0090

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

-10.00%

0.0046
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-10.00%	0.7000	0.6300	-	-7.35%	0.0388

SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

0.00%	0.0092

SingleSource/Benchmarks/Shootout-C++/ary3

-9.09%

0.2200

0.2000

-

0.00%

0.0075

SingleSource/Benchmarks/Shootout-C++/sieve

-8.33%

0.2400

0.2200

-

-4.35%	0.0098

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-6.82%

0.4400

0.4100

-

-2.38%	0.0187
SingleSource/Benchmarks/Misc/oourafft	-6.25%	0.1600	0.1500	-	-11.76%	0.0078

SingleSource/Benchmarks/Shootout-C++/hello

-6.25%

0.1600

0.1500

-

-11.76%	0.0070
SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

-11.11%

0.0102

MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode

-5.62%

0.8900

0.8400

-

0.00%	0.0458
MultiSource/Benchmarks/VersaBench/dbms/dbms	-5.26%	0.5700	0.5400	-	-15.62%	0.0324

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

-5.00%

0.2000

0.1900

-

-5.00%	0.0122

MultiSource/Benchmarks/Olden/voronoi/voronoi

-5.00%

0.2000

0.1900

-

-13.64%

0.0191

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/JM/ldecod/ldecod	-42.86%	0.0700	0.0400	-	0.00%	0.0111

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%	0.0067

MultiSource/Benchmarks/Olden/mst/mst

-25.00%

0.0800

0.0600

-

-14.29%

0.0090

MultiSource/Benchmarks/Olden/treeadd/treeadd

-19.05%

0.2100

0.1700

-

6.25%	0.0192

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-6.45%	0.0261

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

20.00%	0.0060

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%	0.0102
MultiSource/Applications/oggenc/oggenc	-7.69%	0.1300	0.1200	-	-7.69%	0.0054

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

-6.25%

0.1600

0.1500

-

-16.67%	0.0098

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

-0.66%	0.0075

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

3.29%	0.0695

MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4

-5.26%

0.3800

0.3600

-

-5.26%

0.0066

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.50s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153998	2012-04-04 05:46:50	0:14:30
Previous	153997	2012-04-04 05:21:56	0:14:28

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	3	88
Performance Improvements	16	108
Existing Failures	8	8
Unchanged Tests	861	684
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/09-vor/vor

21.74%

0.2300

0.2800

0.0180

21.74%

-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/sieve	8.12%	1.6000	1.7300	0.0225	4.22%	-
SingleSource/Benchmarks/Shootout/ary3	1.12%	1.7900	1.8100	0.0064	0.00%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0200

0.0000

0.0049

-100.00%

-

SingleSource/UnitTests/AtomicOps

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm	-60.00%	0.0500	0.0200	0.0070	-50.00%	-
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm	-50.00%	0.0400	0.0200	0.0040	-50.00%	-
SingleSource/Regression/C/matrixTranspose

-50.00%

0.0200

0.0100

0.0030

0.00%

-

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1	-15.79%	0.1900	0.1600	0.0102	-11.11%	-
SingleSource/Benchmarks/Shootout-C++/except	-10.53%	0.1900	0.1700	0.0064	-10.53%	-
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame	-4.76%	3.3600	3.2000	0.0265	-2.14%	-
MultiSource/Benchmarks/FreeBench/pifft/pifft	-4.23%	0.7100	0.6800	0.0080	-4.23%	-
MultiSource/Applications/lua/lua	-3.50%	3.1400	3.0300	0.0320	-1.94%	-
MultiSource/Applications/JM/lencod/lencod	-1.40%	12.1400	11.9700	0.0403	0.17%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

0.0000

-100.00%

-

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath	-10.00%	0.3000	0.2700	0.0102	-10.00%	-

MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

-5.00%

0.2000

0.1900

0.0030

-9.52%

-

MultiSource/Benchmarks/Olden/bisort/bisort

-4.08%

0.4900

0.4700

0.0063

-6.00%

-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc/fp-convert

200.00%

0.0100

0.0300

-

0.00%	0.0060

SingleSource/Benchmarks/Stanford/Quicksort

200.00%

0.0100

0.0300

-

200.00%	0.0111

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

50.00%

0.0040

SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

50.00%

0.0066

MultiSource/Benchmarks/Prolangs-C++/family/family

100.00%

0.0200

0.0400

-

33.33%

0.0063

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

100.00%

0.0054

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

100.00%

0.0075

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

100.00%	0.0090
SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

0.00%

0.0100

SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

100.00%

0.0100

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0064

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

100.00%

0.0078

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0030

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0054

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/UnitTests/Threads/tls

100.00%

0.0100

0.0200

-

0.00%	0.0075
SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0040

MultiSource/Applications/aha/aha

80.00%

0.0500

0.0900

-

-10.00%	0.0092
MultiSource/Benchmarks/BitBench/uudecode/uudecode

66.67%

0.0300

0.0500

-

25.00%

0.0087

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

52.94%

0.1700

0.2600

-

13.04%	0.0140

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

50.00%

0.0600

0.0900

-

28.57%

0.0094

MultiSource/Benchmarks/Olden/perimeter/perimeter

40.00%

0.0500

0.0700

-

0.00%

0.0100

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

10.00%	0.0156

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

35.71%

0.1400

0.1900

-

26.67%	0.0210

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

35.71%

0.1400

0.1900

-

-5.00%	0.0127

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

0.00%

0.0117

MultiSource/Benchmarks/Olden/mst/mst

33.33%

0.0600

0.0800

-

-27.27%	0.0140

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

33.33%

0.0300

0.0400

-

-42.86%	0.0100

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

0.00%	0.0081

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

-20.00%	0.0064

SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%	0.0080
SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%

0.0075

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

100.00%	0.0067
SingleSource/Benchmarks/Stanford/Queens

33.33%

0.0300

0.0400

-

100.00%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

33.33%	0.0067
SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

33.33%

0.0054

MultiSource/Benchmarks/Olden/health/health

33.33%

0.0900

0.1200

-

0.00%

0.0077

MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

28.57%

0.0108

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

25.00%

0.0075

MultiSource/Benchmarks/Olden/treeadd/treeadd

25.00%

0.0400

0.0500

-

25.00%

0.0127

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%	0.0092
MultiSource/Benchmarks/McCat/09-vor/vor	21.74%	0.2300	0.2800	-	21.74%	0.0180
MultiSource/Benchmarks/McCat/08-main/main	21.05%	0.1900	0.2300	-	15.00%	0.0176
MultiSource/Benchmarks/Ptrdist/ft/ft	20.00%	0.1000	0.1200	-	-7.69%	0.0140

MultiSource/Applications/viterbi/viterbi

18.18%

0.1100

0.1300

-

-7.14%

0.0166

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

16.67%

0.0050

SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

0.00%

0.0050

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

15.38%

0.1300

0.1500

-

7.14%

0.0070
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig	15.00%	0.4000	0.4600	-	12.20%	0.0246

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

-10.53%	0.0160

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

-1.85%	0.0120

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

-10.00%	0.0164

SingleSource/Benchmarks/Shootout-C++/objinst

11.76%

0.1700

0.1900

-

5.56%	0.0108
MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

0.00%

0.0175

SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

17.65%	0.0102

SingleSource/UnitTests/Vector/SSE/sse_expandfft

11.11%

0.0900

0.1000

-

25.00%	0.0063

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%	0.0070

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

4.94%	0.0256

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

8.33%	0.0066
MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

-6.67%

0.0194

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

7.69%

0.0098

SingleSource/Benchmarks/Shootout-C++/moments

6.67%

0.3000

0.3200

-

0.00%

0.0119

MultiSource/Benchmarks/Prolangs-C/agrep/agrep

6.32%

0.9500

1.0100

-

5.21%	0.0214

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

6.25%

0.0054

MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg

5.85%

3.4200

3.6200

-

0.00%	0.0654
MultiSource/Applications/spiff/spiff

5.26%

0.5700

0.6000

-

-4.76%

0.0281

MultiSource/Benchmarks/mediabench/gsm/toast/toast

5.15%

0.9700

1.0200

-

-2.86%

0.0326

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

300.00%

0.0100

0.0400

-

33.33%

0.0111

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/UnitTests/SignlessTypes/Large/cast

100.00%

0.0100

0.0200

-

100.00%

0.0060

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

33.33%

0.0049

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%	0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

-1.05%	0.0060

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.14%

1.3900

1.6700

-

0.00%	0.0067

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0046

SingleSource/Benchmarks/Shootout-C++/lists1

10.53%

0.1900

0.2100

-

23.53%	0.0136

SingleSource/Benchmarks/Shootout/strcat

7.69%

0.1300

0.1400

-

0.00%	0.0154

SingleSource/UnitTests/Vector/SSE/sse_stepfft

7.50%

0.4000

0.4300

-

2.38%	0.0049

SingleSource/Benchmarks/Shootout/nestedloop

6.67%

0.1500

0.1600

-

0.00%	0.0050

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

13.33%

0.0094

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%

0.0050

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Misc-C++/mandel-text

-100.00%

0.0100

0.0000

-

-100.00%

0.0092

SingleSource/Benchmarks/Misc/flops-7

-100.00%

0.0300

0.0000

-

-100.00%

0.0070

SingleSource/Benchmarks/Misc/pi

-100.00%

0.0200

0.0000

-

-100.00%

0.0070

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/2011-03-28-Bitfield

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C++/EH/dead_try_block

-100.00%

0.0200

0.0000

-

-100.00%

0.0080

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

0.00%

0.0081

SingleSource/Regression/C++/short_circuit_dtor

-100.00%

0.0100

0.0000

-

-100.00%	0.0078
SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/2003-05-22-VarSizeArray

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

-100.00%

0.0100

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C/ConstructorDestructorAttributes

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/Regression/C/PR1386

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/PR491

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2003-07-08-BitOpsTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0087

SingleSource/UnitTests/2003-07-10-SignConversions

-100.00%

0.0200

0.0000

-

0.00%

0.0078

SingleSource/UnitTests/2003-09-18-BitFieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2008-04-18-LoopBug

-100.00%

0.0100

0.0000

-

-100.00%	0.0049
SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-100.00%

0.0200

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/AtomicOps

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/SignlessTypes/cast-bug

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/Vector/sumarray-dbl

-100.00%

0.0100

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/byval-alignment

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/Benchmarks/Stanford/Perm

-66.67%

0.0300

0.0100

-

-66.67%	0.0054
SingleSource/Regression/C/sumarray

-66.67%

0.0300

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/SignlessTypes/div

-66.67%

0.0300

0.0100

-

-66.67%	0.0100
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-50.00%

0.0400

0.0200

-

-60.00%

0.0070

MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-50.00%

0.0400

0.0200

-

-50.00%

0.0040

SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

-50.00%	0.0083
SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0050

SingleSource/Regression/C/sumarray2d

-50.00%

0.0200

0.0100

-

-66.67%

0.0067

SingleSource/UnitTests/2003-05-26-Shorts

-50.00%

0.0200

0.0100

-

-50.00%	0.0066

SingleSource/UnitTests/2003-07-09-LoadShorts

-50.00%

0.0200

0.0100

-

-50.00%	0.0040
SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0054

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0040

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

-50.00%

0.0090

SingleSource/UnitTests/stmtexpr

-50.00%

0.0200

0.0100

-

-50.00%	0.0075
SingleSource/UnitTests/vla

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

MultiSource/Benchmarks/BitBench/five11/five11

-40.00%

0.0500

0.0300

-

-25.00%

0.0075

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

-40.00%	0.0090
SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

0.00%

0.0075

SingleSource/Benchmarks/McGill/exptree

-33.33%

0.0600

0.0400

-

-42.86%	0.0087
SingleSource/Benchmarks/Shootout/lists

-33.33%

0.0600

0.0400

-

-20.00%

0.0050

MultiSource/Benchmarks/FreeBench/mason/mason

-28.57%

0.0700

0.0500

-

-16.67%	0.0075

MultiSource/Benchmarks/FreeBench/distray/distray

-25.00%

0.0800

0.0600

-

-33.33%	0.0119

MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

-40.00%	0.0119

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

0.00%

0.0087

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%

0.0046

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-25.00%

0.0400

0.0300

-

0.00%	0.0089
SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

0.00%

0.0066

SingleSource/Benchmarks/Misc/salsa20

-25.00%

0.0400

0.0300

-

-40.00%

0.0098

SingleSource/Benchmarks/Shootout/heapsort

-25.00%

0.0400

0.0300

-

50.00%	0.0092

SingleSource/UnitTests/Vector/SSE/sse_isamax

-25.00%

0.0800

0.0600

-

20.00%	0.0100
MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

-20.00%

0.0075

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-20.00%

0.1000

0.0800

-

-11.11%	0.0137

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

-11.11%	0.0060

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%	0.0054

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

-20.00%

0.0087

MultiSource/Benchmarks/SciMark2-C/scimark2

-17.39%

0.2300

0.1900

-

-9.52%

0.0147

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-14.29%

0.0700

0.0600

-

-14.29%	0.0080
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-14.29%

0.0700

0.0600

-

0.00%

0.0063

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

-11.11%

0.1800

0.1600

-

-15.79%

0.0102

SingleSource/Benchmarks/Shootout-C++/random

-11.11%

0.1800

0.1600

-

-11.11%

0.0110

MultiSource/Benchmarks/McCat/18-imp/imp

-10.71%

0.2800

0.2500

-

-3.85%	0.0161
SingleSource/Benchmarks/Shootout-C++/except

-10.53%

0.1900

0.1700

-

-10.53%

0.0064

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-9.52%

0.4200

0.3800

-

-24.00%	0.0408
SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

0.00%

0.0104
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl	-8.57%	0.7000	0.6400	-	-4.48%	0.0470
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des

-8.00%

0.2500

0.2300

-

-14.81%

0.0128
MultiSource/Benchmarks/MallocBench/gs/gs	-7.12%	3.2300	3.0000	-	-3.54%	0.0455

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-7.09%

1.2700

1.1800

-

-1.67%	0.0282
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-6.90%	0.5800	0.5400	-	-6.90%	0.0394

SingleSource/Benchmarks/Misc/ReedSolomon

-6.25%

0.1600

0.1500

-

7.14%	0.0094
MultiSource/Benchmarks/Prolangs-C/assembler/assembler	-6.12%	0.4900	0.4600	-	-8.00%	0.0241

MultiSource/Benchmarks/Prolangs-C/bison/mybison

-5.77%

1.0400

0.9800

-

-6.67%	0.0289

MultiSource/Applications/obsequi/Obsequi

-5.75%

0.8700

0.8200

-

-2.38%	0.0224
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	-5.45%	0.5500	0.5200	-	-5.45%	0.0218

MultiSource/Benchmarks/McCat/05-eks/eks

-5.00%

0.4000

0.3800

-

2.70%	0.0220

MultiSource/Benchmarks/Olden/voronoi/voronoi

-5.00%

0.2000

0.1900

-

-9.52%

0.0150

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0046

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0000

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-50.00%

0.0045

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

MultiSource/Applications/JM/ldecod/ldecod

-42.86%

0.0700

0.0400

-

-42.86%	0.0114

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-28.57%	0.0080
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

-25.00%

0.0400

0.0300

-

-40.00%

0.0060

MultiSource/Benchmarks/Olden/treeadd/treeadd

-23.81%

0.2100

0.1600

-

-23.81%	0.0137

SingleSource/Benchmarks/Misc-C++/bigfib

-14.71%

0.3400

0.2900

-

-6.45%

0.0173

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

-10.00%

0.3000

0.2700

-

-10.00%	0.0102
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm

-9.52%

0.2100

0.1900

-

-5.00%

0.0030

MultiSource/Benchmarks/Olden/health/health

-6.90%

0.2900

0.2700

-

3.85%	0.0173

MultiSource/Applications/spiff/spiff

-6.45%

1.8600

1.7400

-

-2.79%	0.0323

SingleSource/Benchmarks/Shootout-C++/hash

-6.38%

0.4700

0.4400

-

0.00%	0.0127
SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%

0.0049

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

-1.31%	0.0127
MultiSource/Benchmarks/Olden/bisort/bisort	-6.00%	0.5000	0.4700	-	-4.08%	0.0063

SingleSource/Benchmarks/Shootout-C++/methcall

-5.80%

5.0000

4.7100

-

0.00%

0.0445

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.42s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	153999	2012-04-04 06:37:04	0:14:32
Previous

153998

2012-04-04 05:46:50

0:14:30

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions

7

101

Performance Improvements	16	108
Existing Failures	8	8

Unchanged Tests	857	671
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

11.90%

0.4200

0.4700

0.0189

6.82%

-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout-C++/moments	100.00%	0.0400	0.0800	0.0078	100.00%	-
MultiSource/Benchmarks/nbench/nbench	12.11%	17.1000	19.1700	0.6257	13.30%	-
MultiSource/Applications/spiff/spiff	8.62%	1.7400	1.8900	0.0323	1.61%	-
MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

0.0030

7.69%

-

MultiSource/Benchmarks/SciMark2-C/scimark2	1.73%	26.5900	27.0500	0.0178	1.46%	-
SingleSource/Benchmarks/Misc/pi	1.69%	0.5900	0.6000	0.0000	0.00%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

SingleSource/UnitTests/FloatPrecision

-100.00%

0.0200

0.0000

0.0046

-100.00%

-

SingleSource/UnitTests/StructModifyTest

-100.00%

0.0100

0.0000

0.0000

0.00%

-

MultiSource/Benchmarks/Prolangs-C++/family/family	-75.00%	0.0400	0.0100	0.0063	-50.00%	-
SingleSource/UnitTests/SignlessTypes/factor	-66.67%	0.0300	0.0100	0.0040	-66.67%	-
MultiSource/Benchmarks/McCat/12-IOtest/iotest	-50.00%	0.0600	0.0300	0.0080	-57.14%	-
SingleSource/Regression/C/bigstack

-50.00%

0.0400

0.0200

0.0050

-50.00%

-

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2	-20.00%	0.1500	0.1200	0.0077	-7.69%	-
SingleSource/Benchmarks/Shootout-C++/hash	-15.15%	0.3300	0.2800	0.0090	-15.15%	-
MultiSource/Applications/Burg/burg	-9.09%	0.8800	0.8000	0.0201	-4.76%	-
MultiSource/Applications/JM/ldecod/ldecod	-1.86%	5.3800	5.2800	0.0225	0.76%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-14.29%	0.0700	0.0600	0.0030	-14.29%	-
MultiSource/Benchmarks/McCat/12-IOtest/iotest	-3.70%	0.2700	0.2600	0.0030	0.00%	-
MultiSource/Benchmarks/Prolangs-C++/primes/primes	-3.33%	0.3000	0.2900	0.0030	-3.33%	-
SingleSource/Benchmarks/Shootout-C++/methcall	-3.18%	4.7100	4.5600	0.0445	-8.80%	-
SingleSource/Benchmarks/Misc-C++/mandel-text	-1.33%	1.5000	1.4800	0.0050	-1.33%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0066

SingleSource/Benchmarks/Misc-C++/mandel-text

200.00%

0.0100

0.0300

-

0.00%

0.0098

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%	0.0046

MultiSource/Benchmarks/llubenchmark/llu

150.00%

0.0200

0.0500

-

25.00%

0.0087

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

25.00%

0.0094

MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%	0.0046

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

0.00%	0.0070

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

-33.33%	0.0064
SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

-33.33%

0.0102

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

100.00%

0.0083

SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0083

SingleSource/Regression/C/2003-05-22-VarSizeArray

100.00%

0.0100

0.0200

-

0.00%

0.0078

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

-33.33%	0.0075
SingleSource/Regression/C/badidx

100.00%

0.0100

0.0200

-

100.00%

0.0050

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%	0.0067

SingleSource/UnitTests/2002-10-09-ArrayResolution

100.00%

0.0100

0.0200

-

0.00%	0.0078
SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0040

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0030

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/2003-05-14-AtExit	100.00%	0.0100	0.0200	-	0.00%	0.0054
SingleSource/UnitTests/2003-07-06-IntOverflow	100.00%	0.0100	0.0200	-	0.00%	0.0067

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

100.00%

0.0046

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/ms_struct_pack_layout	100.00%	0.0100	0.0200	-	0.00%	0.0040
SingleSource/UnitTests/printargs	100.00%	0.0100	0.0200	-	0.00%	0.0040

MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

66.67%

0.0300

0.0500

-

25.00%

0.0066

SingleSource/Benchmarks/Dhrystone/fldry

66.67%

0.0300

0.0500

-

25.00%

0.0049

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

-11.11%

0.0092

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

58.82%

0.1700

0.2700

-

3.85%	0.0135

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

50.00%

0.0600

0.0900

-

12.50%	0.0110

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

25.00%	0.0128

MultiSource/Benchmarks/Olden/perimeter/perimeter

40.00%

0.0500

0.0700

-

0.00%

0.0108

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

0.00%	0.0150
MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

-20.00%

0.0094

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

33.33%

0.0100

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

33.33%

0.0300

0.0400

-

0.00%	0.0110
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

100.00%

0.0108

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%

0.0078

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%	0.0066
SingleSource/Benchmarks/Stanford/RealMM

33.33%

0.0300

0.0400

-

100.00%

0.0070

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

33.33%

0.0066

SingleSource/UnitTests/initp1

33.33%

0.0300

0.0400

-

0.00%	0.0046
MultiSource/Benchmarks/Ptrdist/anagram/anagram

28.57%

0.0700

0.0900

-

12.50%

0.0102

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

-5.26%	0.0127

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

26.67%

0.1500

0.1900

-

11.76%

0.0158

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

0.00%	0.0078
SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

66.67%

0.0098

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%

0.0080

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

22.22%

0.0150

MultiSource/Benchmarks/Olden/health/health

22.22%

0.0900

0.1100

-

-8.33%

0.0077

MultiSource/Benchmarks/Olden/voronoi/voronoi

20.00%

0.2000

0.2400

-

26.32%	0.0168

MultiSource/Benchmarks/Prolangs-C++/office/office

17.65%

0.1700

0.2000

-

11.11%	0.0080

MultiSource/Benchmarks/Prolangs-C++/life/life

16.67%

0.0600

0.0700

-

0.00%	0.0049
MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

16.67%

0.0046

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

75.00%	0.0104
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2	14.29%	0.1400	0.1600	-	-15.79%	0.0201

MultiSource/Applications/lambda-0_1_3/lambda

12.77%

0.4700

0.5300

-

0.00%	0.0120

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

0.00%	0.0161

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

11.90%

0.4200

0.4700

-

23.68%	0.0408
MultiSource/Benchmarks/Olden/tsp/tsp

11.11%

0.0900

0.1000

-

11.11%

0.0127

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

25.00%	0.0137

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

11.11%	0.0120

SingleSource/Benchmarks/Shootout-C++/random

11.11%

0.1800

0.2000

-

25.00%	0.0125

SingleSource/Benchmarks/Shootout-C++/sumcol

11.11%

0.1800

0.2000

-

11.11%

0.0087

SingleSource/Benchmarks/Shootout-C++/moments

10.00%

0.3000

0.3300

-

3.13%

0.0110

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

10.00%

0.4000

0.4400

-

-4.35%	0.0224

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

0.00%

0.0075

MultiSource/Benchmarks/VersaBench/bmm/bmm

9.09%

0.2200

0.2400

-

14.29%	0.0100

MultiSource/Applications/spiff/spiff

8.77%

0.5700

0.6200

-

3.33%	0.0317

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

8.33%

0.4800

0.5200

-

13.04%	0.0275

MultiSource/Benchmarks/Olden/em3d/em3d

7.69%

0.1300

0.1400

-

0.00%	0.0173

MultiSource/Applications/hexxagon/hexxagon

7.69%

0.7800

0.8400

-

-1.18%	0.0204

MultiSource/Benchmarks/VersaBench/dbms/dbms

7.02%

0.5700

0.6100

-

3.39%	0.0327

SingleSource/Benchmarks/Shootout-C++/reversefile

6.90%

0.2900

0.3100

-

6.90%	0.0092

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

6.82%

0.4400

0.4700

-

11.90%	0.0189

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

6.67%

0.4500

0.4800

-

2.13%	0.0279
SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

6.25%

0.0092

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

11.76%

0.0210

MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

-13.04%

0.0206

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

400.00%

0.0100

0.0500

-

25.00%

0.0120

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/moments	100.00%	0.0400	0.0800	-	100.00%	0.0078

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%

0.0050

SingleSource/Benchmarks/Stanford/Quicksort

33.33%

0.0300

0.0400

-

0.00%

0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

29.17%

0.7200

0.9300

-

-1.06%

0.0054

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.60%

0.0046

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0046

MultiSource/Benchmarks/nbench/nbench	13.30%	16.9200	19.1700	-	12.11%	0.6257

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

11.11%

0.0900

0.1000

-

11.11%

0.0080

MultiSource/Applications/oggenc/oggenc

7.69%

0.1300

0.1400

-

7.69%	0.0030

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

0.00%	0.0100

SingleSource/Benchmarks/Shootout-C++/hash2

5.91%

2.5400

2.6900

-

1.13%	0.1353
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc	5.80%	0.6900	0.7300	-	2.82%	0.0189
SingleSource/Benchmarks/Shootout-C++/lists	5.68%	4.9300	5.2100	-	5.68%	0.1494

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/sieve

-100.00%

0.0200

0.0000

-

-100.00%

0.0054

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

0.00%

0.0064

SingleSource/Regression/C/2003-05-14-initialize-string

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-06-16-VolatileError

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

-100.00%

0.0100

0.0000

-

0.00%	0.0077
SingleSource/Regression/C/pointer_arithmetic

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2003-07-10-SignConversions

-100.00%

0.0200

0.0000

-

0.00%

0.0087

SingleSource/UnitTests/2006-12-01-float_varg

-100.00%

0.0100

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2007-03-02-VaCopy

-100.00%

0.0200

0.0000

-

-100.00%

0.0054

SingleSource/UnitTests/2007-04-25-weak

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/2009-04-16-BitfieldInitialization

-100.00%

0.0200

0.0000

-

0.00%	0.0066
SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/FloatPrecision

-100.00%

0.0200

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/Vector/multiplies

-100.00%

0.0200

0.0000

-

-100.00%

0.0104

SingleSource/UnitTests/Vector/sumarray

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

0.00%	0.0046
SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/block-copied-in-cxxobj-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0050

SingleSource/UnitTests/conditional-gnu-ext-cxx

-100.00%

0.0100

0.0000

-

-100.00%

0.0054

SingleSource/Benchmarks/Stanford/Perm

-66.67%

0.0300

0.0100

-

0.00%	0.0054
SingleSource/Regression/C/PR640

-66.67%

0.0300

0.0100

-

-66.67%

0.0078

SingleSource/Regression/C/sumarray

-66.67%

0.0300

0.0100

-

0.00%	0.0066
SingleSource/UnitTests/SignlessTypes/factor

-66.67%

0.0300

0.0100

-

-66.67%

0.0040

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-57.14%

0.0700

0.0300

-

-50.00%	0.0080
MultiSource/Benchmarks/Prolangs-C++/family/family

-50.00%

0.0200

0.0100

-

-75.00%

0.0063

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-50.00%

0.0400

0.0200

-

-33.33%

0.0089

SingleSource/Benchmarks/Misc/pi

-50.00%

0.0200

0.0100

-

0.00%

0.0077

SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

0.00%

0.0087

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

0.00%	0.0049
SingleSource/Regression/C/2003-05-22-LocalTypeTest

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/Regression/C/2003-05-23-TransparentUnion

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

0.00%	0.0078

SingleSource/Regression/C/2008-01-07-LongDouble

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C/bigstack

-50.00%

0.0400

0.0200

-

-50.00%

0.0050

SingleSource/Regression/C/globalrefs

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2005-05-12-Int64ToFP

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0049

SingleSource/UnitTests/2007-01-04-KNR-Args

-50.00%

0.0200

0.0100

-

0.00%	0.0064
SingleSource/UnitTests/TestLoop

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/Vector/divides

-50.00%

0.0200

0.0100

-

0.00%

0.0040

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

0.00%	0.0090

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%	0.0090
MultiSource/Benchmarks/Olden/bisort/bisort

-40.00%

0.0500

0.0300

-

-40.00%

0.0130

SingleSource/UnitTests/SignlessTypes/Large/cast

-40.00%

0.0500

0.0300

-

-25.00%

0.0049

SingleSource/UnitTests/Vector/SSE/sse_isamax

-37.50%

0.0800

0.0500

-

-16.67%	0.0098
MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-20.00%

0.0098

SingleSource/Benchmarks/BenchmarkGame/n-body

-33.33%

0.0600

0.0400

-

-33.33%

0.0102

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-33.33%

0.0900

0.0600

-

-25.00%

0.0080

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-28.57%

0.0700

0.0500

-

-16.67%

0.0063

MultiSource/Benchmarks/McCat/15-trie/trie

-25.00%

0.0400

0.0300

-

0.00%

0.0119

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%

0.0046

MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm

-25.00%

0.0400

0.0300

-

50.00%

0.0087

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-40.00%

0.0127

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

-25.00%

0.0400

0.0300

-

-25.00%

0.0080

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

-25.00%

0.0081

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

-25.00%	0.0098

SingleSource/Benchmarks/Misc/dt

-25.00%

0.0400

0.0300

-

0.00%

0.0064

SingleSource/Benchmarks/Stanford/FloatMM

-25.00%

0.0400

0.0300

-

-25.00%	0.0063
MultiSource/Benchmarks/SciMark2-C/scimark2	-21.74%	0.2300	0.1800	-	-5.26%	0.0169

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

33.33%	0.0081
MultiSource/Benchmarks/McCat/17-bintr/bintr

-20.00%

0.0500

0.0400

-

-20.00%

0.0063

MultiSource/Benchmarks/NPB-serial/is/is

-20.00%

0.0500

0.0400

-

-33.33%	0.0063

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

0.00%

0.0064

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0054

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-16.67%

0.1800

0.1500

-

-11.76%

0.0155
SingleSource/Benchmarks/Shootout-C++/hash	-15.15%	0.3300	0.2800	-	-15.15%	0.0090
MultiSource/Benchmarks/FreeBench/mason/mason

-14.29%

0.0700

0.0600

-

20.00%

0.0075

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%

0.0066

SingleSource/Benchmarks/Shootout-C++/wordfreq

-11.54%

0.2600

0.2300

-

-11.54%

0.0110

MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl

-11.43%

0.7000

0.6200

-

-3.13%	0.0439

SingleSource/Benchmarks/Shootout-C++/except

-10.53%

0.1900

0.1700

-

0.00%	0.0080

SingleSource/UnitTests/SignlessTypes/rem

-10.00%

0.1000

0.0900

-

-10.00%

0.0090

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-9.09%

0.5500

0.5000

-

-3.85%	0.0200
SingleSource/Benchmarks/Shootout-C++/ary2	-8.70%	0.2300	0.2100	-	-4.55%	0.0117

SingleSource/Benchmarks/Shootout-C++/lists

-8.70%

0.2300

0.2100

-

-8.70%

0.0119

MultiSource/Benchmarks/Prolangs-C/assembler/assembler

-8.16%

0.4900

0.4500

-

-2.17%	0.0226
MultiSource/Applications/sgefa/sgefa

-8.00%

0.2500

0.2300

-

-4.17%

0.0145

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

-7.69%

0.1300

0.1200

-

-20.00%	0.0077

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-7.41%

0.2700

0.2500

-

-7.41%	0.0060

MultiSource/Applications/obsequi/Obsequi

-6.90%

0.8700

0.8100

-

-1.22%	0.0269

SingleSource/Benchmarks/Misc/ReedSolomon

-6.25%

0.1600

0.1500

-

0.00%	0.0094

SingleSource/Benchmarks/Shootout-C++/hello

-6.25%

0.1600

0.1500

-

-11.76%

0.0060

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/Benchmarks/Stanford/Towers

-50.00%

0.0200

0.0100

-

0.00%	0.0046

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

25.00%

0.0118

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

0.00%	0.0078

SingleSource/Benchmarks/Misc-C++/bigfib

-20.59%

0.3400

0.2700

-

-6.90%	0.0173
SingleSource/Benchmarks/Shootout/strcat	-15.38%	0.1300	0.1100	-	-21.43%	0.0154
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-14.29%

0.0700

0.0600

-

-14.29%

0.0030

MultiSource/Benchmarks/Olden/treeadd/treeadd

-9.52%

0.2100

0.1900

-

18.75%	0.0147
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-9.09%

0.2200

0.2000

-

-4.76%

0.0135

SingleSource/Benchmarks/Shootout-C++/methcall

-8.80%

5.0000

4.5600

-

-3.18%

0.0445

MultiSource/Benchmarks/Olden/perimeter/perimeter

-8.70%

0.2300

0.2100

-

-8.70%

0.0125

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%	0.0049

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%	0.0127

SingleSource/Benchmarks/Shootout-C++/lists1

-5.26%

0.1900

0.1800

-

-14.29%

0.0120

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.49s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	154000	2012-04-04 07:02:05	0:14:27
Previous

153999

2012-04-04 06:37:04

0:14:32

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	5	81
Performance Improvements	11	100
Existing Failures	8	8
Unchanged Tests	864	699
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/Vector/divides	100.00%	0.0100	0.0200	0.0030	0.00%	-
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	18.75%	0.1600	0.1900	0.0080	18.75%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/primes/primes	6.90%	0.2900	0.3100	0.0040	3.33%	-
SingleSource/Benchmarks/Misc/whetstone	1.47%	1.3600	1.3800	0.0049	1.47%	-
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk	1.09%	4.6000	4.6500	0.0117	0.65%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/Shootout/nestedloop

-100.00%

0.0200

0.0000

0.0060

-100.00%

-

SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/Regression/C/2003-05-21-UnionBitfields	-66.67%	0.0300	0.0100	0.0049	0.00%	-
SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

0.0030

-50.00%

-

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

0.0030

-50.00%

-

MultiSource/Benchmarks/McCat/01-qbsort/qbsort	-37.50%	0.0800	0.0500	0.0081	-28.57%	-
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-15.79%	0.5700	0.4800	0.0347	-17.24%	-
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow	-9.52%	0.2100	0.1900	0.0049	-9.52%	-
MultiSource/Applications/JM/ldecod/ldecod	-1.52%	5.2800	5.2000	0.0290	-0.76%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

0.0030

-100.00%

-

MultiSource/Applications/sgefa/sgefa	-1.47%	0.6800	0.6700	0.0030	-1.47%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C/DuffsDevice

200.00%

0.0100

0.0300

-

50.00%

0.0070

SingleSource/Benchmarks/Shootout/hash

150.00%

0.0200

0.0500

-

0.00%	0.0094

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

0.00%

0.0063

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

-20.00%	0.0094
SingleSource/Benchmarks/BenchmarkGame/partialsums

100.00%

0.0100

0.0200

-

-33.33%

0.0067

SingleSource/Benchmarks/Stanford/Quicksort

100.00%

0.0100

0.0200

-

0.00%	0.0092

SingleSource/Benchmarks/Stanford/Treesort

100.00%

0.0200

0.0400

-

33.33%	0.0104

SingleSource/Regression/C++/EH/simple_throw

100.00%

0.0100

0.0200

-

0.00%	0.0083
SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

100.00%

0.0054

SingleSource/Regression/C++/short_circuit_dtor

100.00%

0.0100

0.0200

-

0.00%

0.0087

SingleSource/Regression/C/ConstructorDestructorAttributes

100.00%

0.0100

0.0200

-

0.00%

0.0067

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

0.00%	0.0040

SingleSource/UnitTests/2002-08-02-CastTest

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

0.00%

0.0000

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2003-05-14-AtExit	100.00%	0.0100	0.0200	-	0.00%	0.0054
SingleSource/UnitTests/2003-07-06-IntOverflow	100.00%	0.0100	0.0200	-	0.00%	0.0067

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0080

SingleSource/UnitTests/ms_struct-bitfield-init

100.00%

0.0100

0.0200

-

100.00%

0.0064

SingleSource/UnitTests/ms_struct_pack_layout

100.00%

0.0100

0.0200

-

0.00%

0.0030

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0030

MultiSource/Benchmarks/Ptrdist/ft/ft

70.00%

0.1000

0.1700

-

13.33%

0.0128

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

66.67%

0.0300

0.0500

-

25.00%

0.0111

SingleSource/Benchmarks/McGill/queens

66.67%

0.0300

0.0500

-

66.67%

0.0066

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

52.94%

0.1700

0.2600

-

-3.70%	0.0137

MultiSource/Applications/aha/aha

40.00%

0.0500

0.0700

-

-12.50%	0.0092
SingleSource/Benchmarks/CoyoteBench/almabench

40.00%

0.0500

0.0700

-

40.00%

0.0060

MultiSource/Benchmarks/Fhourstones/fhourstones

37.50%

0.0800

0.1100

-

0.00%

0.0150

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

35.71%

0.1400

0.1900

-

18.75%	0.0206

MultiSource/Benchmarks/BitBench/uudecode/uudecode

33.33%

0.0300

0.0400

-

0.00%	0.0094

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

-11.11%	0.0110

MultiSource/Benchmarks/Prolangs-C++/objects/objects

33.33%

0.0600

0.0800

-

0.00%	0.0104
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput

33.33%

0.0300

0.0400

-

-20.00%

0.0066

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

0.00%	0.0110
SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

-20.00%

0.0049

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

0.00%

0.0066

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

0.00%	0.0067
SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

100.00%

0.0067

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

28.57%

0.1400

0.1800

-

0.00%

0.0120

MultiSource/Benchmarks/BitBench/drop3/drop3

25.00%

0.0400

0.0500

-

0.00%

0.0078

MultiSource/Benchmarks/McCat/15-trie/trie

25.00%

0.0400

0.0500

-

66.67%

0.0112

MultiSource/Benchmarks/Prolangs-C++/garage/garage

25.00%

0.0400

0.0500

-

25.00%

0.0060

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

0.00%

0.0080

MultiSource/Applications/spiff/spiff

19.30%

0.5700

0.6800

-

9.68%	0.0326

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

18.75%

0.1600

0.1900

-

18.75%	0.0080

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

16.67%

0.0600

0.0700

-

40.00%	0.0108
MultiSource/Benchmarks/Olden/mst/mst

16.67%

0.0600

0.0700

-

16.67%

0.0151

MultiSource/Benchmarks/Prolangs-C++/trees/trees

16.67%

0.0600

0.0700

-

0.00%	0.0049

SingleSource/Benchmarks/McGill/exptree

16.67%

0.0600

0.0700

-

0.00%	0.0104
SingleSource/Benchmarks/Misc/whetstone

16.67%

0.0600

0.0700

-

16.67%

0.0050

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

15.38%

0.1300

0.1500

-

25.00%	0.0094

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

13.33%

0.1500

0.1700

-

-10.53%

0.0150
MultiSource/Benchmarks/SciMark2-C/scimark2	13.04%	0.2300	0.2600	-	44.44%	0.0196

MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig

12.50%

0.4000

0.4500

-

2.27%

0.0223

SingleSource/Benchmarks/Shootout-C++/ackermann

12.50%

0.1600

0.1800

-

5.88%

0.0092

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

0.00%

0.0158

MultiSource/Benchmarks/Olden/health/health

11.11%

0.0900

0.1000

-

-9.09%

0.0070

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

0.00%	0.0137
SingleSource/Benchmarks/Shootout-C++/heapsort

11.11%

0.1800

0.2000

-

11.11%

0.0111

MultiSource/Benchmarks/Prolangs-C/archie-client/archie

11.11%

0.4500

0.5000

-

4.17%	0.0293

MultiSource/Applications/lambda-0_1_3/lambda

10.64%

0.4700

0.5200

-

-1.89%	0.0120

MultiSource/Benchmarks/VersaBench/dbms/dbms

10.53%

0.5700

0.6300

-

3.28%

0.0303

MultiSource/Benchmarks/Olden/voronoi/voronoi

10.00%

0.2000

0.2200

-

-8.33%	0.0168

MultiSource/Applications/hexxagon/hexxagon

8.97%

0.7800

0.8500

-

1.19%	0.0202

MultiSource/Benchmarks/FreeBench/neural/neural

8.33%

0.1200

0.1300

-

18.18%	0.0075
SingleSource/Benchmarks/Shootout-C++/lists1

8.00%

0.2500

0.2700

-

8.00%

0.0112

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

12.00%	0.0102
MultiSource/Benchmarks/mediabench/gsm/toast/toast	7.22%	0.9700	1.0400	-	2.97%	0.0291
SingleSource/Benchmarks/Misc/oourafft

6.25%

0.1600

0.1700

-

6.25%

0.0119

SingleSource/Benchmarks/Shootout-C++/except

5.26%

0.1900

0.2000

-

17.65%

0.0092

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/BitBench/uuencode/uuencode

100.00%

0.0100

0.0200

-

0.00%

0.0040

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael	33.33%	0.0300	0.0400	-	0.00%	0.0050
SingleSource/Benchmarks/Stanford/Quicksort	33.33%	0.0300	0.0400	-	0.00%	0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

30.56%

0.7200

0.9400

-

1.08%

0.0063

MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo

25.00%

0.0400

0.0500

-

25.00%

0.0063

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

22.22%

0.0900

0.1100

-

10.00%

0.0080

SingleSource/Benchmarks/Adobe-C++/loop_unroll

20.86%

1.3900

1.6800

-

0.00%

0.0049

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0046

SingleSource/Benchmarks/Shootout-C++/lists1

15.79%

0.1900

0.2200

-

22.22%	0.0125

MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset

6.25%

0.1600

0.1700

-

0.00%

0.0098

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout/ary3

-100.00%

0.0200

0.0000

-

-100.00%

0.0092

SingleSource/Benchmarks/Shootout/nestedloop

-100.00%

0.0200

0.0000

-

-100.00%

0.0060

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/Regression/C++/2003-06-08-VirtualFunctions

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/2003-06-13-Crasher

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/Regression/C++/EH/throw_rethrow_test

-100.00%

0.0100

0.0000

-

0.00%

0.0064

SingleSource/Regression/C/2003-05-22-LocalTypeTest

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/Regression/C/2003-05-23-TransparentUnion

-100.00%

0.0200

0.0000

-

-100.00%

0.0075

SingleSource/UnitTests/2002-04-17-PrintfChar

-100.00%

0.0100

0.0000

-

0.00%	0.0040
SingleSource/UnitTests/2002-10-12-StructureArgs

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2002-10-13-BadLoad

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2003-05-02-DependentPHI

-100.00%

0.0200

0.0000

-

-100.00%

0.0087

SingleSource/UnitTests/2008-07-13-InlineSetjmp

-100.00%

0.0200

0.0000

-

-100.00%

0.0067

SingleSource/UnitTests/2009-12-07-StructReturn

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/DefaultInitDynArrays

-100.00%

0.0100

0.0000

-

-100.00%

0.0060

SingleSource/UnitTests/Threads/2010-12-08-tls

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/Threads/tls

-100.00%

0.0100

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/block-byref-test

-100.00%

0.0100

0.0000

-

0.00%

0.0049

SingleSource/UnitTests/byval-alignment

-100.00%

0.0200

0.0000

-

-100.00%

0.0064

MultiSource/Benchmarks/VersaBench/8b10b/8b10b	-66.67%	0.0600	0.0200	-	-50.00%	0.0100

SingleSource/Regression/C/PR640

-66.67%

0.0300

0.0100

-

0.00%	0.0087

MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio

-50.00%

0.0400

0.0200

-

0.00%	0.0087

SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

0.00%	0.0050
SingleSource/Benchmarks/Shootout/sieve

-50.00%

0.0200

0.0100

-

0.00%

0.0075

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

-33.33%

0.0054

SingleSource/Regression/C++/2003-09-29-NonPODsByValue

-50.00%

0.0200

0.0100

-

0.00%

0.0083

SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn

-50.00%

0.0200

0.0100

-

-50.00%

0.0064

SingleSource/Regression/C++/EH/ConditionalExpr

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C++/EH/simple_rethrow

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0083

SingleSource/Regression/C/2004-03-15-IndirectGoto

-50.00%

0.0200

0.0100

-

0.00%

0.0078

SingleSource/UnitTests/2002-05-02-CastTest

-50.00%

0.0200

0.0100

-

-66.67%

0.0081

SingleSource/UnitTests/2002-05-02-CastTest2

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2002-05-03-NotTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0040

SingleSource/UnitTests/2002-05-19-DivTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0090

SingleSource/UnitTests/2003-04-22-Switch

-50.00%

0.0200

0.0100

-

0.00%	0.0067
SingleSource/UnitTests/2003-05-31-CastToBool

-50.00%

0.0200

0.0100

-

-50.00%

0.0030

SingleSource/UnitTests/2003-07-10-SignConversions

-50.00%

0.0200

0.0100

-

0.00%

0.0089

SingleSource/UnitTests/2003-08-05-CastFPToUint

-50.00%

0.0200

0.0100

-

-50.00%

0.0030

SingleSource/UnitTests/2003-08-20-FoldBug

-50.00%

0.0200

0.0100

-

0.00%	0.0046
SingleSource/UnitTests/2003-10-13-SwitchTest

-50.00%

0.0200

0.0100

-

-50.00%

0.0050

SingleSource/UnitTests/2006-01-29-SimpleIndirectCall

-50.00%

0.0200

0.0100

-

-50.00%

0.0080

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0060

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

-50.00%

0.0066

SingleSource/UnitTests/ms_struct-bitfield-init-1

-50.00%

0.0200

0.0100

-

0.00%

0.0090

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-42.86%

0.0700

0.0400

-

-20.00%

0.0060

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-40.00%

0.0500

0.0300

-

0.00%

0.0090

SingleSource/Benchmarks/Misc/mandel

-40.00%

0.0500

0.0300

-

-25.00%

0.0040

MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-30.00%

0.1000

0.0700

-

-30.00%	0.0142

MultiSource/Benchmarks/McCat/01-qbsort/qbsort

-28.57%

0.0700

0.0500

-

-37.50%	0.0081
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0083

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

0.00%

0.0046

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

0.00%	0.0127

SingleSource/Benchmarks/BenchmarkGame/Large/fasta

-25.00%

0.0400

0.0300

-

0.00%	0.0066

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

0.00%	0.0098

MultiSource/Benchmarks/Olden/em3d/em3d

-23.08%

0.1300

0.1000

-

-28.57%	0.0176

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

16.67%	0.0104
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo	-21.43%	0.4200	0.3300	-	-29.79%	0.0450

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%	0.0080
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

-20.00%

0.1000

0.0800

-

-20.00%

0.0169

SingleSource/Benchmarks/CoyoteBench/lpbench

-20.00%

0.1000

0.0800

-

0.00%

0.0066

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

33.33%

0.0060
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk	-20.00%	0.1500	0.1200	-	-20.00%	0.0150

MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft

-18.18%

0.1100

0.0900

-

-10.00%

0.0066
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-17.24%	0.5800	0.4800	-	-15.79%	0.0347
SingleSource/Benchmarks/Shootout-C++/strcat

-16.67%

0.1800

0.1500

-

-11.76%

0.0098

MultiSource/Benchmarks/FreeBench/mason/mason

-14.29%

0.0700

0.0600

-

0.00%	0.0066

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

0.00%	0.0066
SingleSource/Benchmarks/Shootout-C++/methcall

-10.53%

0.1900

0.1700

-

-10.53%

0.0135

MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow

-9.52%

0.2100

0.1900

-

-9.52%

0.0049

SingleSource/Benchmarks/Shootout-C++/matrix

-9.52%

0.2100

0.1900

-

-5.00%	0.0089
SingleSource/Benchmarks/Shootout-C++/wc

-9.52%

0.2100

0.1900

-

-5.00%

0.0092

MultiSource/Applications/sgefa/sgefa

-8.00%

0.2500

0.2300

-

0.00%	0.0154
SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%

0.0064

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-7.27%

0.5500

0.5100

-

2.00%

0.0215

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-6.82%

0.4400

0.4100

-

-12.77%	0.0244

SingleSource/Benchmarks/Shootout-C++/hash

-6.06%

0.3300

0.3100

-

10.71%	0.0158

SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

-11.11%

0.0133
SingleSource/Benchmarks/Shootout-C++/hash2	-5.71%	0.3500	0.3300	-	-2.94%	0.0125

MultiSource/Benchmarks/McCat/08-main/main

-5.26%

0.1900

0.1800

-

-10.00%	0.0205

MultiSource/Benchmarks/McCat/05-eks/eks

-5.00%

0.4000

0.3800

-

-2.56%

0.0175

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Benchmarks/Prolangs-C++/city/city

-100.00%

0.0100

0.0000

-

0.00%

0.0046

MultiSource/Benchmarks/Prolangs-C++/employ/employ

-100.00%

0.0100

0.0000

-

-100.00%

0.0030

MultiSource/Benchmarks/Olden/treeadd/treeadd

-28.57%

0.2100

0.1500

-

-21.05%	0.0151
SingleSource/Benchmarks/Shootout-C++/strcat

-25.00%

0.0800

0.0600

-

-14.29%

0.0125
MultiSource/Benchmarks/McCat/09-vor/vor	-18.18%	0.1100	0.0900	-	-10.00%	0.0127

SingleSource/Benchmarks/Misc-C++/bigfib

-17.65%

0.3400

0.2800

-

3.70%	0.0173
MultiSource/Applications/JM/ldecod/ldecod

-14.29%

0.0700

0.0600

-

20.00%

0.0098

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-14.29%

0.0700

0.0600

-

20.00%

0.0078

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%

0.0070

SingleSource/Benchmarks/Shootout-C++/hash

-8.51%

0.4700

0.4300

-

-8.51%	0.0136
MultiSource/Applications/spiff/spiff	-6.99%	1.8600	1.7300	-	-8.47%	0.0516

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.52%

3.2200

3.0100

-

-0.33%

0.0127

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

0.00%

0.0050

SingleSource/Benchmarks/Shootout-C++/methcall

-6.00%

5.0000

4.7000

-

3.07%	0.0588

MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4

-5.26%

0.3800

0.3600

-

-2.70%

0.0060

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

---

Report Time: 0.55s

[llvm-tes...@cs.uiuc.edu]

llvmsuitebot1__clang_DEV__x86_64 test results

Run	Order	Start Time	Duration

Current	154002	2012-04-04 08:37:02	0:14:28
Previous	154001	2012-04-04 07:26:58	0:14:32

Baseline

153780

2012-03-30 22:20:19

0:14:25

---

Tests Summary

Status Group	#	# (B)

Performance Regressions	11	91
Performance Improvements	15	98
Existing Failures	8	8
Unchanged Tests	854	691
Total Tests	888	888

Run-Over-Run Changes Detail

Performance Regressions - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Regression/C++/EH/exception_spec_test	33.33%	0.0300	0.0400	0.0030	100.00%	-
MultiSource/Benchmarks/FreeBench/analyzer/analyzer	25.00%	0.1600	0.2000	0.0094	25.00%	-
SingleSource/UnitTests/Vector/SSE/sse_expandfft	22.22%	0.0900	0.1100	0.0064	22.22%	-
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	16.67%	0.1800	0.2100	0.0089	50.00%	-
MultiSource/Benchmarks/Prolangs-C++/employ/employ	12.00%	0.2500	0.2800	0.0077	3.70%	-
SingleSource/Benchmarks/Adobe-C++/stepanov_vector	3.92%	0.5100	0.5300	0.0070	1.92%	-
MultiSource/Applications/SIBsim4/SIBsim4	3.88%	1.0300	1.0700	0.0126	1.90%	-
MultiSource/Applications/ClamAV/clamscan	1.68%	11.9300	12.1300	0.0496	3.06%	-

Performance Regressions - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/Benchmarks/BenchmarkGame/nsieve-bits	18.75%	0.8000	0.9500	0.0054	20.25%	-
SingleSource/Benchmarks/Shootout-C++/lists	12.96%	4.9400	5.5800	0.0831	13.18%	-
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes	1.66%	2.4100	2.4500	0.0030	1.24%	-

Performance Improvements - Compile Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

SingleSource/UnitTests/2002-05-02-CastTest2

-100.00%

0.0200

0.0000

0.0040

-100.00%

-

SingleSource/UnitTests/StructModifyTest

-100.00%

0.0100

0.0000

0.0030

0.00%

-

SingleSource/Benchmarks/Shootout/methcall

-66.67%

0.0300

0.0100

0.0046

-66.67%

-

MultiSource/Benchmarks/Olden/mst/mst	-50.00%	0.0800	0.0400	0.0141	-33.33%	-
SingleSource/Regression/C/casts	-50.00%	0.0200	0.0100	0.0030	-66.67%	-
SingleSource/UnitTests/ms_struct_pack_layout

-50.00%

0.0200

0.0100

0.0030

0.00%

-

MultiSource/Benchmarks/Prolangs-C++/life/life	-28.57%	0.0700	0.0500	0.0046	-16.67%	-
SingleSource/Benchmarks/Misc/whetstone

-28.57%

0.0700

0.0500

0.0049

-16.67%

-

MultiSource/Benchmarks/Prolangs-C++/office/office	-21.05%	0.1900	0.1500	0.0092	-11.76%	-
MultiSource/Benchmarks/Prolangs-C/agrep/agrep	-10.00%	1.0000	0.9000	0.0211	-5.26%	-

Performance Improvements - Execution Time	Δ	Previous	Current	σ	Δ (B)	σ (B)

MultiSource/Benchmarks/BitBench/uuencode/uuencode

-50.00%

0.0200

0.0100

0.0030

0.00%

-

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

0.0030

-25.00%

-

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-3.70%

0.2700

0.2600

0.0030

0.00%

-

SingleSource/UnitTests/Vector/SSE/sse_expandfft	-3.03%	0.3300	0.3200	0.0030	-3.03%	-
SingleSource/Benchmarks/Shootout/fib2	-1.12%	2.6900	2.6600	0.0098	-0.75%	-

Existing Failures - Execution Time
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle

Run-Over-Baseline Changes Detail

Performance Regressions - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Stanford/Quicksort

300.00%

0.0100

0.0400

-

0.00%

0.0092

SingleSource/Benchmarks/BenchmarkGame/partialsums

200.00%

0.0100

0.0300

-

50.00%

0.0064

SingleSource/Regression/C/2003-05-21-UnionBitfields

200.00%

0.0100

0.0300

-

0.00%

0.0066

MultiSource/Benchmarks/Prolangs-C/allroots/allroots

133.33%

0.0300

0.0700

-

40.00%	0.0110
MultiSource/Benchmarks/Prolangs-C++/primes/primes

100.00%

0.0100

0.0200

-

0.00%

0.0064

MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc

100.00%

0.0100

0.0200

-

0.00%

0.0054

MultiSource/Benchmarks/llubenchmark/llu

100.00%

0.0200

0.0400

-

0.00%	0.0094
SingleSource/Benchmarks/Misc-C++/mandel-text

100.00%

0.0100

0.0200

-

100.00%

0.0108

SingleSource/Benchmarks/Misc/fp-convert

100.00%

0.0100

0.0200

-

100.00%

0.0083

SingleSource/Benchmarks/Shootout/hash

100.00%

0.0200

0.0400

-

0.00%

0.0066

SingleSource/Regression/C++/EH/exception_spec_test

100.00%

0.0200

0.0400

-

33.33%

0.0030

SingleSource/Regression/C++/EH/throw_rethrow_test

100.00%

0.0100

0.0200

-

0.00%

0.0030

SingleSource/Regression/C++/fixups

100.00%

0.0100

0.0200

-

0.00%	0.0049
SingleSource/Regression/C++/pointer_method

100.00%

0.0100

0.0200

-

100.00%

0.0049

SingleSource/Regression/C/DuffsDevice

100.00%

0.0100

0.0200

-

0.00%

0.0070

SingleSource/Regression/C/matrixTranspose

100.00%

0.0100

0.0200

-

100.00%	0.0040
SingleSource/UnitTests/2002-05-02-ManyArguments

100.00%

0.0100

0.0200

-

100.00%

0.0066

SingleSource/UnitTests/2002-10-12-StructureArgs

100.00%

0.0100

0.0200

-

100.00%

0.0067

SingleSource/UnitTests/2002-10-12-StructureArgsSimple

100.00%

0.0100

0.0200

-

100.00%

0.0030

SingleSource/UnitTests/2002-12-13-MishaTest

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2003-05-12-MinIntProblem

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2003-05-14-AtExit

100.00%

0.0100

0.0200

-

0.00%

0.0045

SingleSource/UnitTests/2003-07-06-IntOverflow

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2003-09-18-BitFieldTest

100.00%

0.0100

0.0200

-

0.00%

0.0066

SingleSource/UnitTests/2003-10-29-ScalarReplBug

100.00%

0.0100

0.0200

-

0.00%

0.0046

SingleSource/UnitTests/2005-05-13-SDivTwo

100.00%

0.0100

0.0200

-

100.00%

0.0054

SingleSource/UnitTests/2005-07-17-INT-To-FP

100.00%

0.0100

0.0200

-

0.00%

0.0049

SingleSource/UnitTests/2006-12-01-float_varg

100.00%

0.0100

0.0200

-

0.00%

0.0081

SingleSource/UnitTests/Vector/sumarray-dbl

100.00%

0.0100

0.0200

-

0.00%

0.0075

SingleSource/UnitTests/conditional-gnu-ext-cxx

100.00%

0.0100

0.0200

-

0.00%

0.0070

SingleSource/UnitTests/printargs

100.00%

0.0100

0.0200

-

0.00%

0.0030

MultiSource/Applications/aha/aha

60.00%

0.0500

0.0800

-

0.00%	0.0094

MultiSource/Benchmarks/Ptrdist/ft/ft

50.00%

0.1000

0.1500

-

0.00%	0.0147

MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes

50.00%

0.1400

0.2100

-

16.67%	0.0089

MultiSource/Benchmarks/Prolangs-C/compiler/compiler

41.18%

0.1700

0.2400

-

-7.69%	0.0117
MultiSource/Benchmarks/McCat/17-bintr/bintr

40.00%

0.0500

0.0700

-

0.00%

0.0094

MultiSource/Benchmarks/Olden/perimeter/perimeter

40.00%

0.0500

0.0700

-

75.00%	0.0120

MultiSource/Benchmarks/McCat/03-testtrie/testtrie

33.33%

0.0600

0.0800

-

14.29%	0.0100

MultiSource/Benchmarks/MiBench/network-patricia/network-patricia

33.33%

0.0600

0.0800

-

0.00%	0.0100

MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio

33.33%

0.0300

0.0400

-

-20.00%	0.0110

SingleSource/Benchmarks/Dhrystone/fldry

33.33%

0.0300

0.0400

-

0.00%	0.0046
SingleSource/Benchmarks/McGill/queens

33.33%

0.0300

0.0400

-

0.00%

0.0054

SingleSource/Benchmarks/Shootout/objinst

33.33%

0.0300

0.0400

-

0.00%

0.0080

SingleSource/Benchmarks/Stanford/IntMM

33.33%

0.0300

0.0400

-

33.33%	0.0066

SingleSource/Regression/C/uint64_to_float

33.33%

0.0300

0.0400

-

100.00%	0.0080

SingleSource/UnitTests/Vector/SSE/sse_shift

33.33%

0.0300

0.0400

-

33.33%	0.0066
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk

28.57%

0.0700

0.0900

-

12.50%

0.0094

MultiSource/Applications/viterbi/viterbi

27.27%

0.1100

0.1400

-

7.69%	0.0162

MultiSource/Benchmarks/Fhourstones/fhourstones

25.00%

0.0800

0.1000

-

11.11%	0.0156

MultiSource/Benchmarks/FreeBench/analyzer/analyzer

25.00%

0.1600

0.2000

-

25.00%	0.0094
SingleSource/Benchmarks/Misc/salsa20

25.00%

0.0400

0.0500

-

25.00%

0.0111

SingleSource/Benchmarks/Stanford/Oscar

25.00%

0.0400

0.0500

-

25.00%	0.0060

MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath

22.22%

0.0900

0.1100

-

-21.43%	0.0186

MultiSource/Benchmarks/Olden/health/health

22.22%

0.0900

0.1100

-

-8.33%

0.0083

SingleSource/UnitTests/Vector/SSE/sse_expandfft

22.22%

0.0900

0.1100

-

22.22%

0.0064

MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2

21.43%

0.1400

0.1700

-

-19.05%	0.0236

MultiSource/Benchmarks/mediabench/g721/g721encode/encode

20.00%

0.1500

0.1800

-

12.50%	0.0147

MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch

20.00%

0.1000

0.1200

-

33.33%	0.0176
MultiSource/Benchmarks/Ptrdist/ks/ks

18.18%

0.1100

0.1300

-

-7.14%

0.0094

MultiSource/Benchmarks/FreeBench/neural/neural

16.67%

0.1200

0.1400

-

16.67%

0.0075

SingleSource/Regression/C++/ofstream_ctor

12.50%

0.1600

0.1800

-

-5.26%	0.0143

MultiSource/Benchmarks/McCat/04-bisect/bisect

11.11%

0.0900

0.1000

-

0.00%

0.0120

MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1

11.11%

0.1800

0.2000

-

5.26%	0.0126

MultiSource/Benchmarks/VersaBench/beamformer/beamformer

11.11%

0.0900

0.1000

-

0.00%	0.0098

SingleSource/Benchmarks/CoyoteBench/fftbench

10.00%

0.3000

0.3300

-

0.00%	0.0127

SingleSource/Benchmarks/Shootout-C++/ary

10.00%

0.2000

0.2200

-

4.76%	0.0087

SingleSource/Benchmarks/Misc-C++/Large/ray

7.69%

0.2600

0.2800

-

7.69%	0.0111

SingleSource/Benchmarks/Misc-C++/stepanov_v1p2

7.69%

0.1300

0.1400

-

16.67%	0.0108

MultiSource/Applications/hexxagon/hexxagon

7.69%

0.7800

0.8400

-

-1.18%

0.0205
MultiSource/Applications/hbd/hbd	7.41%	1.0800	1.1600	-	10.48%	0.0371

MultiSource/Benchmarks/mediabench/gsm/toast/toast

7.22%

0.9700

1.0400

-

-1.89%	0.0297

SingleSource/Benchmarks/Shootout-C++/ackermann

6.25%

0.1600

0.1700

-

-5.56%	0.0098

SingleSource/Benchmarks/Shootout-C++/hello

6.25%

0.1600

0.1700

-

13.33%	0.0060

MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg

5.85%

3.4200

3.6200

-

0.28%	0.0608

MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount

5.56%

0.1800

0.1900

-

-5.00%	0.0163

SingleSource/Benchmarks/Shootout-C++/heapsort

5.56%

0.1800

0.1900

-

-5.00%	0.0122

SingleSource/Benchmarks/Shootout-C++/sumcol

5.56%

0.1800

0.1900

-

0.00%

0.0078

MultiSource/Benchmarks/Prolangs-C/simulator/simulator

5.36%

0.5600

0.5900

-

-3.28%	0.0254

MultiSource/Applications/spiff/spiff

5.26%

0.5700

0.6000

-

-4.76%

0.0220

MultiSource/Benchmarks/McCat/08-main/main

5.26%

0.1900

0.2000

-

-4.76%

0.0172

Performance Regressions - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

MultiSource/Applications/kimwitu++/kc

100.00%

0.0100

0.0200

-

100.00%

0.0128

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

33.33%

0.0300

0.0400

-

0.00%

0.0046

MultiSource/Benchmarks/Ptrdist/yacr2/yacr2

29.17%

0.7200

0.9300

-

0.00%	0.0070

SingleSource/Benchmarks/Shootout/strcat

23.08%

0.1300

0.1600

-

14.29%	0.0119
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits	20.25%	0.7900	0.9500	-	18.75%	0.0054
SingleSource/Benchmarks/Adobe-C++/loop_unroll	20.14%	1.3900	1.6700	-	0.00%	0.0049

MultiSource/Benchmarks/McCat/18-imp/imp

16.67%

0.0600

0.0700

-

0.00%

0.0040

SingleSource/Benchmarks/Shootout-C++/lists1

15.79%

0.1900

0.2200

-

4.76%	0.0155

SingleSource/Benchmarks/Shootout-C++/lists

13.18%

4.9300

5.5800

-

12.96%	0.0831

MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4

7.34%

1.0900

1.1700

-

8.33%	0.0289

MultiSource/Benchmarks/FreeBench/mason/mason

5.26%

0.1900

0.2000

-

5.26%

0.0046

Performance Improvements - Compile Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Regression/C++/2003-06-08-BaseType

-100.00%

0.0100

0.0000

-

0.00%	0.0050
SingleSource/Regression/C++/EH/ctor_dtor_count

-100.00%

0.0100

0.0000

-

0.00%

0.0077

SingleSource/Regression/C/2003-05-21-BitfieldHandling

-100.00%

0.0200

0.0000

-

-100.00%

0.0070

SingleSource/Regression/C/2003-05-23-TransparentUnion

-100.00%

0.0200

0.0000

-

-100.00%

0.0070

SingleSource/Regression/C/2003-10-12-GlobalVarInitializers

-100.00%

0.0100

0.0000

-

-100.00%

0.0077

SingleSource/UnitTests/2002-05-02-CastTest1

-100.00%

0.0100

0.0000

-

0.00%

0.0046

SingleSource/UnitTests/2002-05-02-CastTest2

-100.00%

0.0200

0.0000

-

-100.00%

0.0040

SingleSource/UnitTests/2002-08-02-CastTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2005-05-12-Int64ToFP

-100.00%

0.0200

0.0000

-

-100.00%

0.0078

SingleSource/UnitTests/2007-01-04-KNR-Args

-100.00%

0.0200

0.0000

-

-100.00%

0.0066

SingleSource/UnitTests/2010-05-24-BitfieldTest

-100.00%

0.0100

0.0000

-

-100.00%

0.0049

SingleSource/UnitTests/block-copied-in-cxxobj

-100.00%

0.0100

0.0000

-

-100.00%

0.0046

SingleSource/UnitTests/ms_struct-bitfield-1

-100.00%

0.0100

0.0000

-

-100.00%

0.0040

MultiSource/Benchmarks/BitBench/uuencode/uuencode	-80.00%	0.0500	0.0100	-	-66.67%	0.0090
SingleSource/Benchmarks/Misc/flops-4

-66.67%

0.0300

0.0100

-

-50.00%

0.0066

SingleSource/Benchmarks/Shootout/methcall

-66.67%

0.0300

0.0100

-

-66.67%

0.0046

SingleSource/Regression/C/casts

-66.67%

0.0300

0.0100

-

-50.00%

0.0030

MultiSource/Benchmarks/Prolangs-C++/NP/np

-50.00%

0.0200

0.0100

-

0.00%

0.0049

SingleSource/Benchmarks/BenchmarkGame/puzzle

-50.00%

0.0400

0.0200

-

0.00%

0.0090

SingleSource/Benchmarks/Misc/dt

-50.00%

0.0400

0.0200

-

100.00%	0.0087

SingleSource/Benchmarks/Shootout/ackermann

-50.00%

0.0200

0.0100

-

0.00%

0.0064

SingleSource/Benchmarks/Shootout/heapsort

-50.00%

0.0400

0.0200

-

-50.00%

0.0078

SingleSource/Benchmarks/Shootout/nestedloop

-50.00%

0.0200

0.0100

-

-50.00%

0.0077

SingleSource/Benchmarks/Stanford/FloatMM

-50.00%

0.0400

0.0200

-

-50.00%	0.0063
SingleSource/Regression/C++/2011-03-28-Bitfield

-50.00%

0.0200

0.0100

-

-50.00%

0.0067

SingleSource/Regression/C++/BuiltinTypeInfo

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/Regression/C++/EH/ctor_dtor_count-2

-50.00%

0.0200

0.0100

-

0.00%	0.0070
SingleSource/Regression/C++/EH/dead_try_block

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/Regression/C++/EH/inlined_cleanup

-50.00%

0.0200

0.0100

-

-50.00%	0.0049

SingleSource/Regression/C++/pointer_member

-50.00%

0.0200

0.0100

-

0.00%	0.0066

SingleSource/Regression/C/2004-02-03-AggregateCopy

-50.00%

0.0200

0.0100

-

-50.00%

0.0075

SingleSource/UnitTests/2005-11-29-LongSwitch

-50.00%

0.0200

0.0100

-

0.00%

0.0067

SingleSource/UnitTests/2006-02-04-DivRem

-50.00%

0.0200

0.0100

-

-50.00%

0.0046

SingleSource/UnitTests/2007-03-02-VaCopy

-50.00%

0.0200

0.0100

-

0.00%

0.0046

SingleSource/UnitTests/AtomicOps

-50.00%

0.0200

0.0100

-

0.00%

0.0066

SingleSource/UnitTests/Vector/SSE/sse_isamax

-50.00%

0.0800

0.0400

-

-20.00%

0.0087

SingleSource/UnitTests/Vector/sumarray

-50.00%

0.0200

0.0100

-

-50.00%

0.0078

SingleSource/UnitTests/byval-alignment

-50.00%

0.0200

0.0100

-

-50.00%

0.0070

SingleSource/UnitTests/member-function-pointers

-50.00%

0.0200

0.0100

-

0.00%

0.0067

MultiSource/Benchmarks/FreeBench/mason/mason

-42.86%

0.0700

0.0400

-

-20.00%

0.0066

MultiSource/Benchmarks/FreeBench/distray/distray

-37.50%

0.0800

0.0500

-

-44.44%

0.0135

MultiSource/Benchmarks/Olden/mst/mst

-33.33%

0.0600

0.0400

-

-50.00%

0.0141

MultiSource/Benchmarks/Olden/tsp/tsp

-33.33%

0.0900

0.0600

-

-40.00%

0.0134

MultiSource/Benchmarks/VersaBench/8b10b/8b10b

-33.33%

0.0600

0.0400

-

-20.00%

0.0108

SingleSource/Benchmarks/BenchmarkGame/spectral-norm

-33.33%

0.0600

0.0400

-

-20.00%

0.0078

SingleSource/Benchmarks/Misc/fbench

-33.33%

0.0600

0.0400

-

-20.00%

0.0050

MultiSource/Benchmarks/McCat/12-IOtest/iotest

-28.57%

0.0700

0.0500

-

25.00%

0.0119

MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1

-28.57%

0.0700

0.0500

-

-16.67%

0.0080
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk	-26.67%	0.1500	0.1100	-	-15.38%	0.0172
MultiSource/Benchmarks/BitBench/drop3/drop3

-25.00%

0.0400

0.0300

-

-25.00%

0.0067

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

50.00%	0.0077

MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32

-25.00%

0.0400

0.0300

-

-25.00%	0.0045

MultiSource/Benchmarks/Olden/treeadd/treeadd

-25.00%

0.0400

0.0300

-

-25.00%	0.0110
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm

-25.00%

0.0400

0.0300

-

-25.00%

0.0064

SingleSource/Benchmarks/Dhrystone/dry

-25.00%

0.0400

0.0300

-

0.00%

0.0098

SingleSource/Benchmarks/Misc/flops

-25.00%

0.0800

0.0600

-

-25.00%

0.0064

SingleSource/UnitTests/Vector/SSE/sse_stepfft

-22.22%

0.0900

0.0700

-

-12.50%	0.0098

MultiSource/Benchmarks/BitBench/five11/five11

-20.00%

0.0500

0.0400

-

0.00%

0.0075

MultiSource/Benchmarks/Prolangs-C++/simul/simul

-20.00%

0.0500

0.0400

-

0.00%

0.0049

SingleSource/Benchmarks/Misc/mandel

-20.00%

0.0500

0.0400

-

0.00%

0.0040

SingleSource/UnitTests/SignlessTypes/Large/cast

-20.00%

0.0500

0.0400

-

100.00%	0.0083

SingleSource/Benchmarks/Shootout-C++/strcat

-16.67%

0.1800

0.1500

-

-11.76%

0.0128

MultiSource/Benchmarks/MiBench/security-sha/security-sha

-14.29%

0.0700

0.0600

-

0.00%

0.0128

SingleSource/Benchmarks/Misc/ffbench

-14.29%

0.0700

0.0600

-

-14.29%	0.0064

SingleSource/Benchmarks/Shootout-C++/matrix

-14.29%

0.2100

0.1800

-

-14.29%	0.0100
MultiSource/Benchmarks/MallocBench/cfrac/cfrac	-13.79%	0.5800	0.5000	-	-26.47%	0.0516
MultiSource/Benchmarks/McCat/09-vor/vor

-13.04%

0.2300

0.2000

-

0.00%

0.0223
MultiSource/Benchmarks/Prolangs-C++/office/office	-11.76%	0.1700	0.1500	-	-21.05%	0.0092

MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url

-11.11%

0.1800

0.1600

-

0.00%	0.0148

MultiSource/Benchmarks/McCat/05-eks/eks

-10.00%

0.4000

0.3600

-

-10.00%	0.0140
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc

-10.00%

0.1000

0.0900

-

-10.00%

0.0111

SingleSource/Benchmarks/CoyoteBench/lpbench

-10.00%

0.1000

0.0900

-

12.50%

0.0066

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-9.09%

0.4400

0.4000

-

0.00%

0.0245

SingleSource/Benchmarks/Shootout-C++/ary2

-8.70%

0.2300

0.2100

-

-4.55%

0.0117

SingleSource/Benchmarks/Shootout-C++/hash2	-8.57%	0.3500	0.3200	-	0.00%	0.0150

MultiSource/Benchmarks/Olden/em3d/em3d

-7.69%

0.1300

0.1200

-

9.09%

0.0185

SingleSource/Benchmarks/McGill/chomp

-7.69%

0.1300

0.1200

-

-7.69%

0.0066

MultiSource/Benchmarks/MiBench/office-ispell/office-ispell

-6.30%

1.2700

1.1900

-

0.85%	0.0287

MultiSource/Benchmarks/Prolangs-C/football/football

-6.06%

0.6600

0.6200

-

-3.13%	0.0136

SingleSource/Benchmarks/Shootout-C++/fibo

-5.88%

0.1700

0.1600

-

-5.88%	0.0117
SingleSource/Benchmarks/Shootout-C++/nestedloop	-5.88%	0.1700	0.1600	-	-5.88%	0.0080

SingleSource/Benchmarks/Adobe-C++/functionobjects

-5.56%

0.3600

0.3400

-

-10.53%	0.0110

MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael

-5.45%

0.5500

0.5200

-

4.00%	0.0215
MultiSource/Benchmarks/Prolangs-C/agrep/agrep	-5.26%	0.9500	0.9000	-	-10.00%	0.0211

MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish

-5.00%

0.2000

0.1900

-

-5.00%

0.0145

Performance Improvements - Execution Time	Δ(B)	Baseline	Current	σ(B)	Δ	σ

SingleSource/Benchmarks/Shootout-C++/ary

-66.67%

0.0300

0.0100

-

-50.00%

0.0081

MultiSource/Applications/d/make_dparser

-50.00%

0.0200

0.0100

-

-50.00%

0.0045
MultiSource/Benchmarks/Olden/treeadd/treeadd	-33.33%	0.2100	0.1400	-	-26.32%	0.0167

MultiSource/Applications/JM/ldecod/ldecod

-28.57%

0.0700

0.0500

-

66.67%	0.0117

MultiSource/Benchmarks/Prolangs-C++/ocean/ocean

-28.57%

0.0700

0.0500

-

-16.67%	0.0081

MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra

-25.00%

0.0400

0.0300

-

-25.00%

0.0030

SingleSource/Benchmarks/Shootout-C++/strcat

-25.00%

0.0800

0.0600

-

0.00%	0.0110
MultiSource/Benchmarks/FreeBench/analyzer/analyzer

-14.29%

0.0700

0.0600

-

-14.29%

0.0049

MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail

-14.29%

0.0700

0.0600

-

-14.29%

0.0075

SingleSource/Benchmarks/Misc-C++/bigfib

-8.82%

0.3400

0.3100

-

-8.82%	0.0202

SingleSource/Benchmarks/Shootout-C++/nestedloop

-6.25%

0.1600

0.1500

-

-6.25%	0.0049

SingleSource/Benchmarks/Misc-C++/Large/ray

-6.21%

3.2200

3.0200

-

0.00%

0.0128
SingleSource/Benchmarks/Shootout-C++/methcall	-6.20%	5.0000	4.6900	-	2.63%	0.0572