Created
May 21, 2020 00:22
-
-
Save turtlesoupy/003a6b3316afd57965252e292dce8672 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ | |
| eval_bench is a Catch v2.11.1 host application. | |
| Run with -? for options | |
| ------------------------------------------------------------------------------- | |
| Benchmark 1-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:90 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 660.181 ms | |
| 6.54256 ms 6.43287 ms 6.67198 ms | |
| 606.807 us 516.993 us 737.254 us | |
| lower_bound 100 1 678.35 ms | |
| 6.73762 ms 6.59054 ms 6.88534 ms | |
| 751.577 us 650.348 us 893.421 us | |
| ------------------------------------------------------------------------------- | |
| Benchmark 2-source plan evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:111 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 960.132 ms | |
| 9.36567 ms 9.20898 ms 9.53173 ms | |
| 822.301 us 734.478 us 928.301 us | |
| lower_bound 100 1 1.07993 s | |
| 9.77261 ms 9.60027 ms 9.97671 ms | |
| 956.369 us 788.097 us 1.21084 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark 4-source plan evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:137 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.5393 s | |
| 12.9899 ms 12.8039 ms 13.1765 ms | |
| 949.016 us 825.615 us 1.10656 ms | |
| lower_bound 100 1 1.52382 s | |
| 15.7757 ms 15.5506 ms 16.0215 ms | |
| 1.1989 ms 1.05052 ms 1.50529 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark 8-source plan evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:165 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.94962 s | |
| 19.8532 ms 19.6253 ms 20.0991 ms | |
| 1.20497 ms 1.04201 ms 1.41538 ms | |
| lower_bound 100 1 2.43107 s | |
| 25.0092 ms 24.6423 ms 25.4967 ms | |
| 2.1424 ms 1.70429 ms 2.81254 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark 16-source plan evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:205 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 3.25548 s | |
| 33.4723 ms 33.1081 ms 34.0963 ms | |
| 2.3872 ms 1.57811 ms 3.87109 ms | |
| lower_bound 100 1 4.30934 s | |
| 44.8429 ms 44.154 ms 45.7647 ms | |
| 4.04507 ms 3.25697 ms 5.03377 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark 32-source plan evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:253 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 5.99335 s | |
| 60.3226 ms 59.4971 ms 61.4937 ms | |
| 4.96661 ms 3.82846 ms 6.34197 ms | |
| lower_bound 100 1 8.19281 s | |
| 82.9857 ms 81.9874 ms 84.8819 ms | |
| 6.77907 ms 4.22927 ms 10.8908 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark boxed 1-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:317 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 643.566 ms | |
| 6.63043 ms 6.49089 ms 6.79828 ms | |
| 775.241 us 654.945 us 938.572 us | |
| lower_bound 100 1 722.641 ms | |
| 7.53038 ms 7.34964 ms 7.78011 ms | |
| 1.07693 ms 828.512 us 1.68476 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark boxed 2-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:338 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 923.701 ms | |
| 9.79195 ms 9.58841 ms 10.0224 ms | |
| 1.1045 ms 976.265 us 1.30134 ms | |
| lower_bound 100 1 980.93 ms | |
| 9.51852 ms 9.34066 ms 9.711 ms | |
| 946.071 us 837.237 us 1.08978 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark boxed 4-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:363 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.35359 s | |
| 13.6122 ms 13.3591 ms 13.8819 ms | |
| 1.33598 ms 1.1694 ms 1.54361 ms | |
| lower_bound 100 1 1.9184 s | |
| 16.8557 ms 16.6082 ms 17.1652 ms | |
| 1.40896 ms 1.14488 ms 2.01343 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark boxed 8-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:399 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 2.02481 s | |
| 20.7618 ms 20.4826 ms 21.1141 ms | |
| 1.58794 ms 1.30831 ms 2.00901 ms | |
| lower_bound 100 1 2.58829 s | |
| 27.1875 ms 26.8737 ms 27.6146 ms | |
| 1.84701 ms 1.4258 ms 2.48918 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark boxed ternary evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:443 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.26769 s | |
| 11.934 ms 11.7291 ms 12.1739 ms | |
| 1.1253 ms 964.476 us 1.32896 ms | |
| lower_bound 100 1 1.40251 s | |
| 12.9607 ms 12.7111 ms 13.2406 ms | |
| 1.35063 ms 1.19429 ms 1.54748 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark mixed 1-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:473 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.64346 s | |
| 16.5194 ms 16.1842 ms 16.8978 ms | |
| 1.82003 ms 1.5844 ms 2.11441 ms | |
| lower_bound 100 1 1.28196 s | |
| 11.9267 ms 11.7756 ms 12.1168 ms | |
| 860.143 us 706.157 us 1.08369 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark mixed 2-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:499 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 2.48632 s | |
| 23.4625 ms 23.1552 ms 23.8589 ms | |
| 1.77768 ms 1.41335 ms 2.3385 ms | |
| lower_bound 100 1 1.67321 s | |
| 17.8776 ms 17.6089 ms 18.1924 ms | |
| 1.47985 ms 1.27076 ms 1.77379 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark mixed 4-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:531 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 3.98745 s | |
| 39.8872 ms 39.5538 ms 40.3629 ms | |
| 2.01746 ms 1.54094 ms 2.69669 ms | |
| lower_bound 100 1 2.75683 s | |
| 28.4963 ms 28.188 ms 28.9081 ms | |
| 1.80839 ms 1.42546 ms 2.36148 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark mixed 8-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:567 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 7.17099 s | |
| 73.1777 ms 72.2064 ms 74.4708 ms | |
| 5.69784 ms 4.5529 ms 7.27229 ms | |
| lower_bound 100 1 4.87258 s | |
| 50.6881 ms 50.0926 ms 51.5412 ms | |
| 3.59709 ms 2.72336 ms 4.8845 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark strided 1-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:611 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 541.798 ms | |
| 5.2857 ms 5.1978 ms 5.40771 ms | |
| 523.727 us 396.764 us 750.52 us | |
| lower_bound 100 1 750.543 ms | |
| 6.99915 ms 6.85144 ms 7.15358 ms | |
| 773.624 us 659.322 us 921.193 us | |
| ------------------------------------------------------------------------------- | |
| Benchmark strided 2-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:634 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 703.746 ms | |
| 6.92201 ms 6.78688 ms 7.06697 ms | |
| 712.387 us 611.047 us 851.986 us | |
| lower_bound 100 1 1.0108 s | |
| 9.85081 ms 9.64763 ms 10.094 ms | |
| 1.13569 ms 943.981 us 1.52005 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark strided 4-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:661 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.10542 s | |
| 10.8897 ms 10.6916 ms 11.126 ms | |
| 1.09995 ms 929.818 us 1.33561 ms | |
| lower_bound 100 1 1.53215 s | |
| 15.6058 ms 15.3819 ms 15.8582 ms | |
| 1.21202 ms 1.05599 ms 1.50262 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark cyclic 1-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:690 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 688.077 ms | |
| 6.51661 ms 6.40651 ms 6.65471 ms | |
| 628.276 us 517.257 us 814.86 us | |
| lower_bound 100 1 676.606 ms | |
| 7.09886 ms 6.95767 ms 7.27142 ms | |
| 793.045 us 662.058 us 948.883 us | |
| ------------------------------------------------------------------------------- | |
| Benchmark cyclic 2-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:727 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 940.544 ms | |
| 9.36678 ms 9.24218 ms 9.51021 ms | |
| 679.21 us 577.94 us 888.509 us | |
| lower_bound 100 1 1.02447 s | |
| 10.4394 ms 10.2706 ms 10.6433 ms | |
| 941.332 us 793.791 us 1.26734 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark cyclic 4-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:768 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 1.29258 s | |
| 14.1548 ms 13.9268 ms 14.4077 ms | |
| 1.22661 ms 1.05577 ms 1.46112 ms | |
| lower_bound 100 1 1.46554 s | |
| 15.2661 ms 15.096 ms 15.4789 ms | |
| 965.867 us 791.208 us 1.35721 ms | |
| ------------------------------------------------------------------------------- | |
| Benchmark cyclic 8-source evaluation | |
| ------------------------------------------------------------------------------- | |
| /home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:812 | |
| ............................................................................... | |
| benchmark name samples iterations estimated | |
| mean low mean high mean | |
| std dev low std dev high std dev | |
| ------------------------------------------------------------------------------- | |
| eval 100 1 2.11515 s | |
| 22.4347 ms 22.1008 ms 22.8039 ms | |
| 1.7922 ms 1.57553 ms 2.06263 ms | |
| lower_bound 100 1 2.42795 s | |
| 24.5707 ms 24.2082 ms 25.0675 ms | |
| 2.15379 ms 1.63286 ms 2.81828 ms | |
| =============================================================================== | |
| All tests passed (3 assertions in 23 test cases) | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment