Skip to content

Instantly share code, notes, and snippets.

@turtlesoupy

turtlesoupy/eval.txt

Created May 21, 2020 00:09
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save turtlesoupy/fb95f3f56e1ff27d8da7771b1a6d78ca to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save turtlesoupy/fb95f3f56e1ff27d8da7771b1a6d78ca to your computer and use it in GitHub Desktop.
Download ZIP
Raw
eval.txt
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
eval_bench is a Catch v2.11.1 host application.
Run with -? for options
-------------------------------------------------------------------------------
Benchmark 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:90
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 674.337 ms
6.44419 ms 6.358 ms 6.53258 ms
446.574 us 396.299 us 506.597 us
lower_bound 100 1 1.68404 s
17.1677 ms 16.7952 ms 17.539 ms
1.88972 ms 1.6919 ms 2.23072 ms
-------------------------------------------------------------------------------
Benchmark 2-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:111
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 937.555 ms
9.12932 ms 8.96714 ms 9.32876 ms
912.27 us 762.043 us 1.12466 ms
lower_bound 100 1 2.13788 s
21.1011 ms 20.6493 ms 21.499 ms
2.15738 ms 1.81268 ms 2.51323 ms
-------------------------------------------------------------------------------
Benchmark 4-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:137
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.42346 s
13.0123 ms 12.7898 ms 13.223 ms
1.10263 ms 955.402 us 1.29045 ms
lower_bound 100 1 3.19834 s
33.4202 ms 33.0377 ms 33.7531 ms
1.81746 ms 1.47812 ms 2.21938 ms
-------------------------------------------------------------------------------
Benchmark 8-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:165
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.08029 s
19.26 ms 19.0183 ms 19.4755 ms
1.16238 ms 966.53 us 1.41387 ms
lower_bound 100 1 5.52541 s
55.4918 ms 55.0157 ms 56.5284 ms
3.41178 ms 1.69244 ms 6.05682 ms
-------------------------------------------------------------------------------
Benchmark 16-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:205
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.19055 s
33.2551 ms 32.8788 ms 33.8896 ms
2.43708 ms 1.62324 ms 3.57219 ms
lower_bound 100 1 10.0397 s
99.799 ms 99.4413 ms 100.41 ms
2.32877 ms 1.50438 ms 4.23213 ms
-------------------------------------------------------------------------------
Benchmark 32-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:253
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 5.95183 s
60.4299 ms 59.9726 ms 61.2974 ms
3.0997 ms 1.86308 ms 5.02596 ms
lower_bound 100 1 19.1329 s
192.206 ms 191.825 ms 192.705 ms
2.21664 ms 1.75046 ms 2.96963 ms
-------------------------------------------------------------------------------
Benchmark boxed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:317
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 674.731 ms
6.30639 ms 6.1856 ms 6.45005 ms
672.173 us 577.757 us 843.726 us
lower_bound 100 1 1.57242 s
16.2359 ms 15.7779 ms 16.6673 ms
2.27623 ms 2.02102 ms 2.55333 ms
-------------------------------------------------------------------------------
Benchmark boxed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:338
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 918.111 ms
9.30332 ms 9.14406 ms 9.47883 ms
853.013 us 763.903 us 988.636 us
lower_bound 100 1 2.12572 s
21.5305 ms 21.2066 ms 21.8775 ms
1.70927 ms 1.39003 ms 2.13225 ms
-------------------------------------------------------------------------------
Benchmark boxed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:363
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.42545 s
14.023 ms 13.7906 ms 14.2662 ms
1.21191 ms 1.06434 ms 1.43493 ms
lower_bound 100 1 3.98861 s
38.8715 ms 38.5283 ms 39.4944 ms
2.2952 ms 1.44823 ms 4.21314 ms
-------------------------------------------------------------------------------
Benchmark boxed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:399
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.09911 s
20.0483 ms 19.8752 ms 20.2497 ms
953.863 us 808.792 us 1.13612 ms
lower_bound 100 1 6.33463 s
64.456 ms 63.7426 ms 65.4735 ms
4.2975 ms 3.23257 ms 5.56223 ms
-------------------------------------------------------------------------------
Benchmark boxed ternary evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:443
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.15463 s
11.7854 ms 11.6195 ms 11.9893 ms
935.026 us 787.429 us 1.20427 ms
lower_bound 100 1 2.71247 s
26.2736 ms 25.7257 ms 26.7732 ms
2.67368 ms 2.3741 ms 2.97613 ms
-------------------------------------------------------------------------------
Benchmark mixed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:473
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.60247 s
14.584 ms 14.3547 ms 14.859 ms
1.27476 ms 1.0617 ms 1.5708 ms
lower_bound 100 1 2.16194 s
23.933 ms 23.5656 ms 24.3936 ms
2.0855 ms 1.63953 ms 3.13543 ms
-------------------------------------------------------------------------------
Benchmark mixed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:499
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.34717 s
23.0767 ms 22.8732 ms 23.3091 ms
1.11199 ms 956.458 us 1.31738 ms
lower_bound 100 1 3.76578 s
36.7594 ms 36.4583 ms 37.0425 ms
1.4857 ms 1.26974 ms 1.83896 ms
-------------------------------------------------------------------------------
Benchmark mixed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:531
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.91705 s
39.7897 ms 39.4994 ms 40.2443 ms
1.82704 ms 1.2878 ms 2.73927 ms
lower_bound 100 1 6.21799 s
62.7447 ms 62.4047 ms 63.0942 ms
1.75608 ms 1.55612 ms 2.02737 ms
-------------------------------------------------------------------------------
Benchmark mixed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:567
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 6.64282 s
67.3636 ms 66.9745 ms 68.1057 ms
2.65971 ms 1.67464 ms 4.12948 ms
lower_bound 100 1 10.9163 s
109.381 ms 108.897 ms 110.083 ms
2.93467 ms 2.18804 ms 4.55797 ms
-------------------------------------------------------------------------------
Benchmark strided 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:611
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 549.128 ms
5.22619 ms 5.14292 ms 5.31894 ms
446.533 us 391.224 us 556.874 us
lower_bound 100 1 1.5332 s
15.6753 ms 15.2857 ms 16.0099 ms
1.84156 ms 1.53319 ms 2.2064 ms
-------------------------------------------------------------------------------
Benchmark strided 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:634
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 702.903 ms
6.99328 ms 6.85419 ms 7.14202 ms
734.993 us 657.983 us 856.144 us
lower_bound 100 1 1.84774 s
20.1146 ms 19.5801 ms 20.6143 ms
2.63289 ms 2.37408 ms 2.89043 ms
-------------------------------------------------------------------------------
Benchmark strided 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:661
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.1623 s
11.3749 ms 11.1897 ms 11.5949 ms
1.02741 ms 873.882 us 1.2228 ms
lower_bound 100 1 2.98257 s
33.8301 ms 33.4008 ms 34.2722 ms
2.2243 ms 1.79832 ms 2.80743 ms
-------------------------------------------------------------------------------
Benchmark cyclic 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:690
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 648.366 ms
6.30291 ms 6.21105 ms 6.40773 ms
497.559 us 437.485 us 626.593 us
lower_bound 100 1 1.63176 s
15.4369 ms 15.0196 ms 15.8236 ms
2.05399 ms 1.73719 ms 2.43579 ms
-------------------------------------------------------------------------------
Benchmark cyclic 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:727
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 923.673 ms
9.4189 ms 9.28094 ms 9.58132 ms
761.48 us 664.142 us 914.093 us
lower_bound 100 1 2.24125 s
21.1532 ms 20.6139 ms 21.6612 ms
2.66449 ms 2.32769 ms 3.06582 ms
-------------------------------------------------------------------------------
Benchmark cyclic 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:768
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.53898 s
13.6051 ms 13.3701 ms 13.8376 ms
1.19907 ms 1.01098 ms 1.45914 ms
lower_bound 100 1 3.43513 s
33.4151 ms 33.039 ms 33.749 ms
1.79578 ms 1.51769 ms 2.168 ms
-------------------------------------------------------------------------------
Benchmark cyclic 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:812
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.03795 s
21.6259 ms 21.3441 ms 21.9986 ms
1.635 ms 1.30988 ms 2.27198 ms
lower_bound 100 1 5.76417 s
56.1344 ms 55.7852 ms 56.68 ms
2.19067 ms 1.42178 ms 3.41062 ms
===============================================================================
All tests passed (3 assertions in 23 test cases)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment