Skip to content

Instantly share code, notes, and snippets.

@turtlesoupy
Created May 21, 2020 00:22
Show Gist options
  • Select an option

  • Save turtlesoupy/003a6b3316afd57965252e292dce8672 to your computer and use it in GitHub Desktop.

Select an option

Save turtlesoupy/003a6b3316afd57965252e292dce8672 to your computer and use it in GitHub Desktop.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
eval_bench is a Catch v2.11.1 host application.
Run with -? for options
-------------------------------------------------------------------------------
Benchmark 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:90
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 660.181 ms
6.54256 ms 6.43287 ms 6.67198 ms
606.807 us 516.993 us 737.254 us
lower_bound 100 1 678.35 ms
6.73762 ms 6.59054 ms 6.88534 ms
751.577 us 650.348 us 893.421 us
-------------------------------------------------------------------------------
Benchmark 2-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:111
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 960.132 ms
9.36567 ms 9.20898 ms 9.53173 ms
822.301 us 734.478 us 928.301 us
lower_bound 100 1 1.07993 s
9.77261 ms 9.60027 ms 9.97671 ms
956.369 us 788.097 us 1.21084 ms
-------------------------------------------------------------------------------
Benchmark 4-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:137
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.5393 s
12.9899 ms 12.8039 ms 13.1765 ms
949.016 us 825.615 us 1.10656 ms
lower_bound 100 1 1.52382 s
15.7757 ms 15.5506 ms 16.0215 ms
1.1989 ms 1.05052 ms 1.50529 ms
-------------------------------------------------------------------------------
Benchmark 8-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:165
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.94962 s
19.8532 ms 19.6253 ms 20.0991 ms
1.20497 ms 1.04201 ms 1.41538 ms
lower_bound 100 1 2.43107 s
25.0092 ms 24.6423 ms 25.4967 ms
2.1424 ms 1.70429 ms 2.81254 ms
-------------------------------------------------------------------------------
Benchmark 16-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:205
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.25548 s
33.4723 ms 33.1081 ms 34.0963 ms
2.3872 ms 1.57811 ms 3.87109 ms
lower_bound 100 1 4.30934 s
44.8429 ms 44.154 ms 45.7647 ms
4.04507 ms 3.25697 ms 5.03377 ms
-------------------------------------------------------------------------------
Benchmark 32-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:253
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 5.99335 s
60.3226 ms 59.4971 ms 61.4937 ms
4.96661 ms 3.82846 ms 6.34197 ms
lower_bound 100 1 8.19281 s
82.9857 ms 81.9874 ms 84.8819 ms
6.77907 ms 4.22927 ms 10.8908 ms
-------------------------------------------------------------------------------
Benchmark boxed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:317
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 643.566 ms
6.63043 ms 6.49089 ms 6.79828 ms
775.241 us 654.945 us 938.572 us
lower_bound 100 1 722.641 ms
7.53038 ms 7.34964 ms 7.78011 ms
1.07693 ms 828.512 us 1.68476 ms
-------------------------------------------------------------------------------
Benchmark boxed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:338
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 923.701 ms
9.79195 ms 9.58841 ms 10.0224 ms
1.1045 ms 976.265 us 1.30134 ms
lower_bound 100 1 980.93 ms
9.51852 ms 9.34066 ms 9.711 ms
946.071 us 837.237 us 1.08978 ms
-------------------------------------------------------------------------------
Benchmark boxed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:363
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.35359 s
13.6122 ms 13.3591 ms 13.8819 ms
1.33598 ms 1.1694 ms 1.54361 ms
lower_bound 100 1 1.9184 s
16.8557 ms 16.6082 ms 17.1652 ms
1.40896 ms 1.14488 ms 2.01343 ms
-------------------------------------------------------------------------------
Benchmark boxed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:399
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.02481 s
20.7618 ms 20.4826 ms 21.1141 ms
1.58794 ms 1.30831 ms 2.00901 ms
lower_bound 100 1 2.58829 s
27.1875 ms 26.8737 ms 27.6146 ms
1.84701 ms 1.4258 ms 2.48918 ms
-------------------------------------------------------------------------------
Benchmark boxed ternary evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:443
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.26769 s
11.934 ms 11.7291 ms 12.1739 ms
1.1253 ms 964.476 us 1.32896 ms
lower_bound 100 1 1.40251 s
12.9607 ms 12.7111 ms 13.2406 ms
1.35063 ms 1.19429 ms 1.54748 ms
-------------------------------------------------------------------------------
Benchmark mixed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:473
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.64346 s
16.5194 ms 16.1842 ms 16.8978 ms
1.82003 ms 1.5844 ms 2.11441 ms
lower_bound 100 1 1.28196 s
11.9267 ms 11.7756 ms 12.1168 ms
860.143 us 706.157 us 1.08369 ms
-------------------------------------------------------------------------------
Benchmark mixed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:499
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.48632 s
23.4625 ms 23.1552 ms 23.8589 ms
1.77768 ms 1.41335 ms 2.3385 ms
lower_bound 100 1 1.67321 s
17.8776 ms 17.6089 ms 18.1924 ms
1.47985 ms 1.27076 ms 1.77379 ms
-------------------------------------------------------------------------------
Benchmark mixed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:531
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.98745 s
39.8872 ms 39.5538 ms 40.3629 ms
2.01746 ms 1.54094 ms 2.69669 ms
lower_bound 100 1 2.75683 s
28.4963 ms 28.188 ms 28.9081 ms
1.80839 ms 1.42546 ms 2.36148 ms
-------------------------------------------------------------------------------
Benchmark mixed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:567
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 7.17099 s
73.1777 ms 72.2064 ms 74.4708 ms
5.69784 ms 4.5529 ms 7.27229 ms
lower_bound 100 1 4.87258 s
50.6881 ms 50.0926 ms 51.5412 ms
3.59709 ms 2.72336 ms 4.8845 ms
-------------------------------------------------------------------------------
Benchmark strided 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:611
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 541.798 ms
5.2857 ms 5.1978 ms 5.40771 ms
523.727 us 396.764 us 750.52 us
lower_bound 100 1 750.543 ms
6.99915 ms 6.85144 ms 7.15358 ms
773.624 us 659.322 us 921.193 us
-------------------------------------------------------------------------------
Benchmark strided 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:634
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 703.746 ms
6.92201 ms 6.78688 ms 7.06697 ms
712.387 us 611.047 us 851.986 us
lower_bound 100 1 1.0108 s
9.85081 ms 9.64763 ms 10.094 ms
1.13569 ms 943.981 us 1.52005 ms
-------------------------------------------------------------------------------
Benchmark strided 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:661
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.10542 s
10.8897 ms 10.6916 ms 11.126 ms
1.09995 ms 929.818 us 1.33561 ms
lower_bound 100 1 1.53215 s
15.6058 ms 15.3819 ms 15.8582 ms
1.21202 ms 1.05599 ms 1.50262 ms
-------------------------------------------------------------------------------
Benchmark cyclic 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:690
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 688.077 ms
6.51661 ms 6.40651 ms 6.65471 ms
628.276 us 517.257 us 814.86 us
lower_bound 100 1 676.606 ms
7.09886 ms 6.95767 ms 7.27142 ms
793.045 us 662.058 us 948.883 us
-------------------------------------------------------------------------------
Benchmark cyclic 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:727
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 940.544 ms
9.36678 ms 9.24218 ms 9.51021 ms
679.21 us 577.94 us 888.509 us
lower_bound 100 1 1.02447 s
10.4394 ms 10.2706 ms 10.6433 ms
941.332 us 793.791 us 1.26734 ms
-------------------------------------------------------------------------------
Benchmark cyclic 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:768
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.29258 s
14.1548 ms 13.9268 ms 14.4077 ms
1.22661 ms 1.05577 ms 1.46112 ms
lower_bound 100 1 1.46554 s
15.2661 ms 15.096 ms 15.4789 ms
965.867 us 791.208 us 1.35721 ms
-------------------------------------------------------------------------------
Benchmark cyclic 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:812
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.11515 s
22.4347 ms 22.1008 ms 22.8039 ms
1.7922 ms 1.57553 ms 2.06263 ms
lower_bound 100 1 2.42795 s
24.5707 ms 24.2082 ms 25.0675 ms
2.15379 ms 1.63286 ms 2.81828 ms
===============================================================================
All tests passed (3 assertions in 23 test cases)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment