Skip to content

Instantly share code, notes, and snippets.

@bohde

bohde/binary-results.txt

Created June 14, 2015 13:44
Show Gist options
  • Save bohde/2b7b763805ddb2c6bfd1 to your computer and use it in GitHub Desktop.
Save bohde/2b7b763805ddb2c6bfd1 to your computer and use it in GitHub Desktop.
Download ZIP
protobuf benchmarks
Raw
binary-results.txt
Running 1 benchmarks...
Benchmark bench: RUNNING...
benchmarking burst/encoding/1
time 520.7 ns (512.9 ns .. 529.5 ns)
0.997 R² (0.992 R² .. 0.999 R²)
mean 516.5 ns (509.9 ns .. 534.9 ns)
std dev 32.75 ns (12.46 ns .. 65.36 ns)
variance introduced by outliers: 77% (severely inflated)
benchmarking burst/encoding/10
time 2.995 μs (2.933 μs .. 3.067 μs)
0.996 R² (0.993 R² .. 0.999 R²)
mean 3.019 μs (2.962 μs .. 3.103 μs)
std dev 241.1 ns (171.4 ns .. 342.4 ns)
variance introduced by outliers: 82% (severely inflated)
benchmarking burst/encoding/100
time 26.99 μs (26.61 μs .. 27.43 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 28.09 μs (27.60 μs .. 28.89 μs)
std dev 2.228 μs (1.674 μs .. 3.366 μs)
variance introduced by outliers: 77% (severely inflated)
benchmarking burst/encoding/1000
time 377.4 μs (372.7 μs .. 381.7 μs)
0.999 R² (0.998 R² .. 0.999 R²)
mean 379.8 μs (376.7 μs .. 382.8 μs)
std dev 10.95 μs (9.574 μs .. 12.65 μs)
variance introduced by outliers: 21% (moderately inflated)
benchmarking burst/decoding/1
time 759.1 ns (746.4 ns .. 778.2 ns)
0.990 R² (0.982 R² .. 0.997 R²)
mean 808.4 ns (779.4 ns .. 846.3 ns)
std dev 106.5 ns (75.79 ns .. 159.9 ns)
variance introduced by outliers: 94% (severely inflated)
benchmarking burst/decoding/10
time 3.374 μs (3.353 μs .. 3.401 μs)
0.999 R² (0.998 R² .. 1.000 R²)
mean 3.382 μs (3.359 μs .. 3.473 μs)
std dev 125.8 ns (37.51 ns .. 273.6 ns)
variance introduced by outliers: 48% (moderately inflated)
benchmarking burst/decoding/100
time 29.81 μs (29.65 μs .. 30.03 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 29.75 μs (29.64 μs .. 29.93 μs)
std dev 489.8 ns (362.6 ns .. 701.6 ns)
variance introduced by outliers: 13% (moderately inflated)
benchmarking burst/decoding/1000
time 414.0 μs (411.0 μs .. 418.5 μs)
0.999 R² (0.998 R² .. 0.999 R²)
mean 424.5 μs (420.3 μs .. 430.2 μs)
std dev 16.35 μs (13.02 μs .. 21.27 μs)
variance introduced by outliers: 33% (moderately inflated)
benchmarking nested/encoding/a1
time 2.414 μs (2.395 μs .. 2.433 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 2.406 μs (2.391 μs .. 2.428 μs)
std dev 59.30 ns (43.25 ns .. 87.28 ns)
variance introduced by outliers: 30% (moderately inflated)
benchmarking nested/encoding/a10
time 14.50 μs (14.42 μs .. 14.59 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 14.59 μs (14.52 μs .. 14.68 μs)
std dev 256.9 ns (203.6 ns .. 322.6 ns)
variance introduced by outliers: 15% (moderately inflated)
benchmarking nested/encoding/a100
time 155.7 μs (154.5 μs .. 156.9 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 156.3 μs (155.2 μs .. 158.6 μs)
std dev 5.168 μs (2.611 μs .. 9.654 μs)
variance introduced by outliers: 30% (moderately inflated)
benchmarking nested/encoding/a1000
time 3.731 ms (3.690 ms .. 3.776 ms)
0.999 R² (0.998 R² .. 1.000 R²)
mean 3.750 ms (3.721 ms .. 3.800 ms)
std dev 113.0 μs (77.65 μs .. 157.1 μs)
variance introduced by outliers: 14% (moderately inflated)
benchmarking nested/encoding/b10
time 20.49 μs (20.32 μs .. 20.70 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 20.49 μs (20.37 μs .. 20.77 μs)
std dev 561.6 ns (279.6 ns .. 994.3 ns)
variance introduced by outliers: 29% (moderately inflated)
benchmarking nested/encoding/b100
time 264.2 μs (254.0 μs .. 280.5 μs)
0.986 R² (0.969 R² .. 0.999 R²)
mean 255.2 μs (251.4 μs .. 265.5 μs)
std dev 18.26 μs (7.916 μs .. 39.59 μs)
variance introduced by outliers: 65% (severely inflated)
benchmarking nested/encoding/b1000
time 5.751 ms (5.629 ms .. 5.858 ms)
0.998 R² (0.997 R² .. 0.999 R²)
mean 5.659 ms (5.618 ms .. 5.728 ms)
std dev 154.3 μs (99.02 μs .. 247.8 μs)
benchmarking nested/decoding/a1
time 1.011 μs (999.5 ns .. 1.022 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 1.003 μs (997.2 ns .. 1.012 μs)
std dev 24.03 ns (15.62 ns .. 39.28 ns)
variance introduced by outliers: 30% (moderately inflated)
benchmarking nested/decoding/a10
time 1.071 μs (1.064 μs .. 1.079 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 1.075 μs (1.065 μs .. 1.106 μs)
std dev 51.06 ns (16.02 ns .. 101.9 ns)
variance introduced by outliers: 64% (severely inflated)
benchmarking nested/decoding/a100
time 1.079 μs (1.072 μs .. 1.087 μs)
0.999 R² (0.998 R² .. 1.000 R²)
mean 1.084 μs (1.076 μs .. 1.097 μs)
std dev 32.37 ns (21.58 ns .. 53.50 ns)
variance introduced by outliers: 41% (moderately inflated)
benchmarking nested/decoding/a1000
time 3.765 μs (3.747 μs .. 3.784 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 3.773 μs (3.750 μs .. 3.845 μs)
std dev 125.7 ns (59.40 ns .. 239.6 ns)
variance introduced by outliers: 43% (moderately inflated)
benchmarking nested/decoding/b10
time 3.705 μs (3.677 μs .. 3.734 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 3.701 μs (3.674 μs .. 3.750 μs)
std dev 118.3 ns (73.55 ns .. 183.9 ns)
variance introduced by outliers: 41% (moderately inflated)
benchmarking nested/decoding/b100
time 29.94 μs (29.78 μs .. 30.13 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 29.88 μs (29.76 μs .. 30.09 μs)
std dev 499.3 ns (334.1 ns .. 723.4 ns)
variance introduced by outliers: 13% (moderately inflated)
benchmarking nested/decoding/b1000
time 446.8 μs (443.2 μs .. 451.1 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 452.3 μs (448.7 μs .. 458.1 μs)
std dev 16.37 μs (10.28 μs .. 23.90 μs)
variance introduced by outliers: 30% (moderately inflated)
Benchmark bench: FINISH
Raw
master-results.txt
Running 1 benchmarks...
Benchmark bench: RUNNING...
benchmarking burst/encoding/1
time 2.648 μs (2.624 μs .. 2.682 μs)
0.999 R² (0.998 R² .. 1.000 R²)
mean 2.666 μs (2.645 μs .. 2.703 μs)
std dev 92.61 ns (59.64 ns .. 139.0 ns)
variance introduced by outliers: 46% (moderately inflated)
benchmarking burst/encoding/10
time 17.06 μs (16.93 μs .. 17.16 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 16.84 μs (16.74 μs .. 16.95 μs)
std dev 351.5 ns (298.2 ns .. 424.9 ns)
variance introduced by outliers: 19% (moderately inflated)
benchmarking burst/encoding/100
time 155.3 μs (154.3 μs .. 156.6 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 157.7 μs (156.5 μs .. 160.0 μs)
std dev 5.574 μs (3.133 μs .. 8.686 μs)
variance introduced by outliers: 33% (moderately inflated)
benchmarking burst/encoding/1000
time 1.702 ms (1.688 ms .. 1.714 ms)
0.999 R² (0.999 R² .. 1.000 R²)
mean 1.685 ms (1.678 ms .. 1.696 ms)
std dev 31.39 μs (22.41 μs .. 49.95 μs)
benchmarking burst/decoding/1
time 3.501 μs (3.480 μs .. 3.528 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 3.498 μs (3.486 μs .. 3.521 μs)
std dev 52.74 ns (29.33 ns .. 89.58 ns)
variance introduced by outliers: 13% (moderately inflated)
benchmarking burst/decoding/10
time 22.46 μs (21.17 μs .. 23.80 μs)
0.983 R² (0.968 R² .. 0.998 R²)
mean 21.24 μs (20.82 μs .. 22.04 μs)
std dev 1.928 μs (1.066 μs .. 3.501 μs)
variance introduced by outliers: 82% (severely inflated)
benchmarking burst/decoding/100
time 191.3 μs (190.0 μs .. 192.8 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 191.6 μs (190.6 μs .. 193.1 μs)
std dev 4.105 μs (2.884 μs .. 5.731 μs)
variance introduced by outliers: 15% (moderately inflated)
benchmarking burst/decoding/1000
time 2.028 ms (1.990 ms .. 2.059 ms)
0.997 R² (0.995 R² .. 0.998 R²)
mean 2.057 ms (2.045 ms .. 2.083 ms)
std dev 61.85 μs (33.87 μs .. 117.9 μs)
variance introduced by outliers: 17% (moderately inflated)
benchmarking nested/encoding/a1
time 26.53 μs (26.22 μs .. 26.86 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 26.85 μs (26.49 μs .. 27.50 μs)
std dev 1.498 μs (987.5 ns .. 2.086 μs)
variance introduced by outliers: 62% (severely inflated)
benchmarking nested/encoding/a10
time 189.3 μs (187.8 μs .. 191.0 μs)
0.999 R² (0.998 R² .. 0.999 R²)
mean 193.2 μs (191.7 μs .. 196.1 μs)
std dev 6.820 μs (4.370 μs .. 11.50 μs)
variance introduced by outliers: 33% (moderately inflated)
benchmarking nested/encoding/a100
time 1.660 ms (1.643 ms .. 1.680 ms)
0.999 R² (0.999 R² .. 1.000 R²)
mean 1.658 ms (1.652 ms .. 1.672 ms)
std dev 32.59 μs (20.02 μs .. 58.86 μs)
benchmarking nested/encoding/a1000
time 15.82 ms (15.66 ms .. 15.98 ms)
0.999 R² (0.998 R² .. 1.000 R²)
mean 15.96 ms (15.86 ms .. 16.10 ms)
std dev 304.6 μs (201.4 μs .. 456.4 μs)
benchmarking nested/encoding/b10
time 271.1 μs (268.7 μs .. 273.8 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 270.1 μs (268.7 μs .. 272.4 μs)
std dev 6.047 μs (4.074 μs .. 9.678 μs)
variance introduced by outliers: 16% (moderately inflated)
benchmarking nested/encoding/b100
time 2.524 ms (2.498 ms .. 2.548 ms)
0.999 R² (0.999 R² .. 1.000 R²)
mean 2.501 ms (2.491 ms .. 2.514 ms)
std dev 38.08 μs (29.69 μs .. 50.84 μs)
benchmarking nested/encoding/b1000
time 25.74 ms (24.11 ms .. 28.01 ms)
0.973 R² (0.931 R² .. 0.994 R²)
mean 27.09 ms (26.37 ms .. 28.26 ms)
std dev 1.872 ms (1.200 ms .. 3.009 ms)
variance introduced by outliers: 26% (moderately inflated)
benchmarking nested/decoding/a1
time 35.99 μs (35.75 μs .. 36.22 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 36.05 μs (35.84 μs .. 36.43 μs)
std dev 938.6 ns (485.8 ns .. 1.772 μs)
variance introduced by outliers: 26% (moderately inflated)
benchmarking nested/decoding/a10
time 244.2 μs (237.1 μs .. 255.6 μs)
0.990 R² (0.976 R² .. 1.000 R²)
mean 241.6 μs (238.7 μs .. 250.5 μs)
std dev 15.46 μs (7.016 μs .. 31.79 μs)
variance introduced by outliers: 60% (severely inflated)
benchmarking nested/decoding/a100
time 2.438 ms (2.414 ms .. 2.461 ms)
0.999 R² (0.999 R² .. 1.000 R²)
mean 2.442 ms (2.431 ms .. 2.458 ms)
std dev 45.42 μs (33.84 μs .. 60.74 μs)
benchmarking nested/decoding/a1000
time 24.89 ms (24.37 ms .. 25.40 ms)
0.998 R² (0.997 R² .. 1.000 R²)
mean 24.94 ms (24.80 ms .. 25.18 ms)
std dev 394.7 μs (240.7 μs .. 644.5 μs)
benchmarking nested/decoding/b10
time 353.8 μs (337.8 μs .. 378.7 μs)
0.972 R² (0.953 R² .. 0.988 R²)
mean 401.3 μs (373.7 μs .. 434.2 μs)
std dev 105.6 μs (78.94 μs .. 127.2 μs)
variance introduced by outliers: 96% (severely inflated)
benchmarking nested/decoding/b100
time 3.666 ms (3.640 ms .. 3.695 ms)
0.999 R² (0.998 R² .. 1.000 R²)
mean 3.687 ms (3.658 ms .. 3.759 ms)
std dev 144.2 μs (56.68 μs .. 283.1 μs)
variance introduced by outliers: 21% (moderately inflated)
benchmarking nested/decoding/b1000
time 37.96 ms (37.60 ms .. 38.35 ms)
1.000 R² (1.000 R² .. 1.000 R²)
mean 37.73 ms (37.45 ms .. 37.92 ms)
std dev 461.4 μs (328.2 μs .. 678.4 μs)
Benchmark bench: FINISH
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment