./benchmarks/RunHtmlBenchmarks --resamples 10000 -u results.csv
warming up
estimating clock resolution...
mean is 2.045215 us (320001 iterations)
found 22885 outliers among 319999 samples (7.2%)
13018 (4.1%) low severe
9867 (3.1%) high severe
estimating cost of a clock call...
mean is 77.64018 ns (18 iterations)
found 2 outliers among 18 samples (11.1%)
2 (11.1%) high mild
benchmarking bigTable/Utf8
mean: 2.897364 ms, lb 2.787210 ms, ub 3.134569 ms, ci 0.950
std dev: 786.3641 us, lb 451.0955 us, ub 1.421699 ms, ci 0.950
found 11 outliers among 100 samples (11.0%)
5 (5.0%) high mild
6 (6.0%) high severe
variance introduced by outliers: 96.800%
variance is severely inflated by outliers
benchmarking bigTable/String
mean: 5.520333 ms, lb 4.817268 ms, ub 7.307035 ms, ci 0.950
std dev: 5.217771 ms, lb 1.528846 ms, ub 10.36575 ms, ci 0.950
found 7 outliers among 100 samples (7.0%)
3 (3.0%) high mild
4 (4.0%) high severe
variance introduced by outliers: 98.983%
variance is severely inflated by outliers
benchmarking bigTable/Text
mean: 6.031819 ms, lb 5.928806 ms, ub 6.171375 ms, ci 0.950
std dev: 614.0657 us, lb 488.9392 us, ub 771.6949 us, ci 0.950
found 13 outliers among 100 samples (13.0%)
6 (6.0%) high mild
7 (7.0%) high severe
variance introduced by outliers: 80.011%
variance is severely inflated by outliers
benchmarking basic/Utf8
mean: 9.789789 us, lb 9.570677 us, ub 10.16748 us, ci 0.950
std dev: 1.435650 us, lb 1.006768 us, ub 2.523441 us, ci 0.950
found 23 outliers among 100 samples (23.0%)
2 (2.0%) high mild
21 (21.0%) high severe
variance introduced by outliers: 89.411%
variance is severely inflated by outliers
benchmarking basic/String
mean: 14.32495 us, lb 14.30233 us, ub 14.36845 us, ci 0.950
std dev: 155.4316 ns, lb 85.75437 ns, ub 249.3516 ns, ci 0.950
benchmarking basic/Text
mean: 30.06538 us, lb 29.44106 us, ub 30.87376 us, ci 0.950
std dev: 3.630272 us, lb 3.022776 us, ub 4.378462 us, ci 0.950
found 11 outliers among 100 samples (11.0%)
10 (10.0%) high mild
1 (1.0%) high severe
variance introduced by outliers: 85.207%
variance is severely inflated by outliers
benchmarking wideTree/Utf8
mean: 2.877172 ms, lb 2.785233 ms, ub 3.026937 ms, ci 0.950
std dev: 588.7537 us, lb 410.6614 us, ub 856.7281 us, ci 0.950
found 6 outliers among 100 samples (6.0%)
3 (3.0%) high mild
3 (3.0%) high severe
variance introduced by outliers: 94.663%
variance is severely inflated by outliers
benchmarking wideTree/String
mean: 4.745978 ms, lb 4.441234 ms, ub 5.848132 ms, ci 0.950
std dev: 2.668196 ms, lb 617.6598 us, ub 6.106177 ms, ci 0.950
found 10 outliers among 100 samples (10.0%)
6 (6.0%) high mild
4 (4.0%) high severe
variance introduced by outliers: 98.952%
variance is severely inflated by outliers
benchmarking wideTree/Text
mean: 9.528571 ms, lb 9.360958 ms, ub 9.730931 ms, ci 0.950
std dev: 949.5980 us, lb 797.8217 us, ub 1.134420 ms, ci 0.950
found 9 outliers among 100 samples (9.0%)
9 (9.0%) high mild
variance introduced by outliers: 78.993%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/Utf8
mean: 572.4802 us, lb 556.1503 us, ub 594.4320 us, ci 0.950
std dev: 95.92616 us, lb 77.36694 us, ub 129.2188 us, ci 0.950
found 5 outliers among 100 samples (5.0%)
4 (4.0%) high mild
1 (1.0%) high severe
variance introduced by outliers: 91.529%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/String
mean: 889.9509 us, lb 870.0144 us, ub 915.9608 us, ci 0.950
std dev: 116.5614 us, lb 93.49379 us, ub 142.3191 us, ci 0.950
found 20 outliers among 100 samples (20.0%)
6 (6.0%) high mild
14 (14.0%) high severe
variance introduced by outliers: 87.295%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/Text
mean: 1.670733 ms, lb 1.649873 ms, ub 1.718132 ms, ci 0.950
std dev: 149.0336 us, lb 77.81396 us, ub 272.0321 us, ci 0.950
found 13 outliers among 100 samples (13.0%)
3 (3.0%) high mild
10 (10.0%) high severe
variance introduced by outliers: 74.866%
variance is severely inflated by outliers
benchmarking deepTree/Utf8
mean: 1.196811 ms, lb 1.141062 ms, ub 1.276019 ms, ci 0.950
std dev: 334.7102 us, lb 255.9203 us, ub 450.7396 us, ci 0.950
found 5 outliers among 100 samples (5.0%)
3 (3.0%) high mild
2 (2.0%) high severe
variance introduced by outliers: 96.812%
variance is severely inflated by outliers
benchmarking deepTree/String
mean: 4.033190 ms, lb 3.351296 ms, ub 5.517129 ms, ci 0.950
std dev: 4.975742 ms, lb 2.244801 ms, ub 8.337380 ms, ci 0.950
found 5 outliers among 100 samples (5.0%)
5 (5.0%) high severe
variance introduced by outliers: 98.990%
variance is severely inflated by outliers
benchmarking deepTree/Text
mean: 3.289834 ms, lb 3.184312 ms, ub 3.429586 ms, ci 0.950
std dev: 608.9533 us, lb 493.9128 us, ub 816.7124 us, ci 0.950
found 5 outliers among 100 samples (5.0%)
4 (4.0%) high mild
1 (1.0%) high severe
variance introduced by outliers: 93.597%
variance is severely inflated by outliers
benchmarking manyAttributes/Utf8
mean: 2.585817 ms, lb 2.527445 ms, ub 2.659513 ms, ci 0.950
std dev: 334.3009 us, lb 276.7088 us, ub 452.4143 us, ci 0.950
found 2 outliers among 100 samples (2.0%)
1 (1.0%) high severe
variance introduced by outliers: 86.292%
variance is severely inflated by outliers
benchmarking manyAttributes/String
mean: 4.208237 ms, lb 4.012309 ms, ub 4.450015 ms, ci 0.950
std dev: 1.106662 ms, lb 940.1383 us, ub 1.542857 ms, ci 0.950
found 1 outliers among 100 samples (1.0%)
variance introduced by outliers: 96.787%
variance is severely inflated by outliers
benchmarking manyAttributes/Text
mean: 15.01799 ms, lb 13.42097 ms, ub 18.29246 ms, ci 0.950
std dev: 11.15547 ms, lb 6.618672 ms, ub 19.50267 ms, ci 0.950
found 11 outliers among 100 samples (11.0%)
2 (2.0%) high mild
9 (9.0%) high severe
variance introduced by outliers: 98.972%
variance is severely inflated by outliers
Created
March 31, 2012 03:43
-
-
Save deepakjois/2259061 to your computer and use it in GitHub Desktop.
Comparing blaze-markup and blaze-html benchmarks
./benchmarks/RunHtmlBenchmarks --resamples 10000 -u results.csv
warming up
estimating clock resolution...
mean is 2.129610 us (320001 iterations)
found 59303 outliers among 319999 samples (18.5%)
27837 (8.7%) low severe
31466 (9.8%) high severe
estimating cost of a clock call...
mean is 80.18119 ns (19 iterations)
found 1 outliers among 19 samples (5.3%)
1 (5.3%) high severe
benchmarking bigTable/Utf8
mean: 3.413175 ms, lb 3.125144 ms, ub 3.970104 ms, ci 0.950
std dev: 1.933358 ms, lb 1.105154 ms, ub 3.203067 ms, ci 0.950
found 11 outliers among 100 samples (11.0%)
4 (4.0%) high mild
7 (7.0%) high severe
variance introduced by outliers: 98.952%
variance is severely inflated by outliers
benchmarking bigTable/String
mean: 4.920224 ms, lb 4.726637 ms, ub 5.420099 ms, ci 0.950
std dev: 1.449703 ms, lb 727.6687 us, ub 3.120282 ms, ci 0.950
found 8 outliers among 100 samples (8.0%)
3 (3.0%) high mild
5 (5.0%) high severe
variance introduced by outliers: 97.827%
variance is severely inflated by outliers
benchmarking bigTable/Text
mean: 5.810104 ms, lb 5.614353 ms, ub 6.449786 ms, ci 0.950
std dev: 1.611946 ms, lb 606.0810 us, ub 3.590664 ms, ci 0.950
found 4 outliers among 100 samples (4.0%)
3 (3.0%) high mild
1 (1.0%) high severe
variance introduced by outliers: 96.809%
variance is severely inflated by outliers
benchmarking basic/Utf8
mean: 9.734137 us, lb 9.489844 us, ub 10.18514 us, ci 0.950
std dev: 1.674613 us, lb 998.8575 ns, ub 2.787117 us, ci 0.950
found 9 outliers among 100 samples (9.0%)
4 (4.0%) high mild
5 (5.0%) high severe
variance introduced by outliers: 92.543%
variance is severely inflated by outliers
benchmarking basic/String
mean: 16.35028 us, lb 15.85335 us, ub 17.19551 us, ci 0.950
std dev: 3.315743 us, lb 2.194915 us, ub 5.508651 us, ci 0.950
found 16 outliers among 100 samples (16.0%)
11 (11.0%) high mild
5 (5.0%) high severe
variance introduced by outliers: 94.657%
variance is severely inflated by outliers
benchmarking basic/Text
mean: 30.05644 us, lb 29.50045 us, ub 30.90543 us, ci 0.950
std dev: 3.495580 us, lb 2.561936 us, ub 5.364537 us, ci 0.950
found 19 outliers among 100 samples (19.0%)
6 (6.0%) high mild
13 (13.0%) high severe
variance introduced by outliers: 84.165%
variance is severely inflated by outliers
benchmarking wideTree/Utf8
mean: 3.343075 ms, lb 3.121999 ms, ub 3.997465 ms, ci 0.950
std dev: 1.760018 ms, lb 753.5544 us, ub 4.011678 ms, ci 0.950
found 4 outliers among 100 samples (4.0%)
3 (3.0%) high severe
variance introduced by outliers: 98.945%
variance is severely inflated by outliers
benchmarking wideTree/String
mean: 5.233468 ms, lb 4.432038 ms, ub 8.984934 ms, ci 0.950
std dev: 7.577983 ms, lb 605.9251 us, ub 18.03619 ms, ci 0.950
found 8 outliers among 100 samples (8.0%)
5 (5.0%) high mild
3 (3.0%) high severe
variance introduced by outliers: 98.993%
variance is severely inflated by outliers
benchmarking wideTree/Text
mean: 9.896274 ms, lb 9.598931 ms, ub 10.85794 ms, ci 0.950
std dev: 2.473425 ms, lb 925.4813 us, ub 5.468490 ms, ci 0.950
found 3 outliers among 100 samples (3.0%)
2 (2.0%) high severe
variance introduced by outliers: 96.765%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/Utf8
mean: 659.4136 us, lb 605.1265 us, ub 792.3169 us, ci 0.950
std dev: 403.5336 us, lb 209.8527 us, ub 810.6021 us, ci 0.950
found 8 outliers among 100 samples (8.0%)
7 (7.0%) high severe
variance introduced by outliers: 98.959%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/String
mean: 936.9668 us, lb 919.6743 us, ub 966.4354 us, ci 0.950
std dev: 111.2063 us, lb 73.81805 us, ub 163.6740 us, ci 0.950
found 14 outliers among 100 samples (14.0%)
3 (3.0%) high mild
11 (11.0%) high severe
variance introduced by outliers: 84.199%
variance is severely inflated by outliers
benchmarking wideTreeEscaping/Text
mean: 1.918717 ms, lb 1.825247 ms, ub 2.132600 ms, ci 0.950
std dev: 681.4392 us, lb 386.9496 us, ub 1.310259 ms, ci 0.950
found 10 outliers among 100 samples (10.0%)
5 (5.0%) high mild
5 (5.0%) high severe
variance introduced by outliers: 98.879%
variance is severely inflated by outliers
benchmarking deepTree/Utf8
mean: 1.357261 ms, lb 1.219198 ms, ub 1.735394 ms, ci 0.950
std dev: 1.067049 ms, lb 480.0332 us, ub 2.261631 ms, ci 0.950
found 5 outliers among 100 samples (5.0%)
4 (4.0%) high severe
variance introduced by outliers: 98.975%
variance is severely inflated by outliers
benchmarking deepTree/String
mean: 2.826992 ms, lb 2.763375 ms, ub 2.904800 ms, ci 0.950
std dev: 359.8448 us, lb 310.0550 us, ub 439.6723 us, ci 0.950
found 4 outliers among 100 samples (4.0%)
4 (4.0%) high mild
variance introduced by outliers: 86.270%
variance is severely inflated by outliers
benchmarking deepTree/Text
mean: 3.709706 ms, lb 3.380638 ms, ub 4.576257 ms, ci 0.950
std dev: 2.546182 ms, lb 741.8457 us, ub 4.909701 ms, ci 0.950
found 7 outliers among 100 samples (7.0%)
3 (3.0%) high mild
4 (4.0%) high severe
variance introduced by outliers: 98.967%
variance is severely inflated by outliers
benchmarking manyAttributes/Utf8
mean: 2.747203 ms, lb 2.669223 ms, ub 2.834109 ms, ci 0.950
std dev: 427.3831 us, lb 373.2268 us, ub 487.5290 us, ci 0.950
variance introduced by outliers: 90.465%
variance is severely inflated by outliers
benchmarking manyAttributes/String
mean: 3.987590 ms, lb 3.839308 ms, ub 4.165550 ms, ci 0.950
std dev: 840.9209 us, lb 723.1863 us, ub 1.000081 ms, ci 0.950
found 2 outliers among 100 samples (2.0%)
2 (2.0%) high mild
variance introduced by outliers: 94.683%
variance is severely inflated by outliers
benchmarking manyAttributes/Text
mean: 12.07373 ms, lb 11.27576 ms, ub 13.44009 ms, ci 0.950
std dev: 5.198691 ms, lb 3.479450 ms, ub 8.607788 ms, ci 0.950
found 14 outliers among 100 samples (14.0%)
4 (4.0%) high mild
10 (10.0%) high severe
variance introduced by outliers: 98.917%
variance is severely inflated by outliers
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment