Skip to content

Instantly share code, notes, and snippets.

@turtlesoupy

turtlesoupy/eval_thomas_impl.txt

Created May 31, 2020 08:16
Show Gist options
  • Save turtlesoupy/9a0dbbe35ba428a670e91f118d30d922 to your computer and use it in GitHub Desktop.
Save turtlesoupy/9a0dbbe35ba428a670e91f118d30d922 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
eval_thomas_impl.txt
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
eval_bench is a Catch v2.11.1 host application.
Run with -? for options
-------------------------------------------------------------------------------
Benchmark 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:103
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 415.408 ms
4.18136 ms 4.13177 ms 4.24209 ms
280.905 us 224.516 us 359.081 us
lower_bound 100 1 714.267 ms
7.12437 ms 6.98354 ms 7.27939 ms
751.983 us 666.856 us 863.709 us
-------------------------------------------------------------------------------
Benchmark 2-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:125
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 541.641 ms
5.42423 ms 5.351 ms 5.5149 ms
413.069 us 334.125 us 534.573 us
lower_bound 100 1 1.09096 s
10.6187 ms 10.4154 ms 10.8332 ms
1.06669 ms 906.158 us 1.27029 ms
-------------------------------------------------------------------------------
Benchmark 4-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:152
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 788.416 ms
7.49232 ms 7.35123 ms 7.64259 ms
744.143 us 655.208 us 860.996 us
lower_bound 100 1 1.58402 s
16.151 ms 15.8466 ms 16.5186 ms
1.69973 ms 1.42149 ms 2.10388 ms
-------------------------------------------------------------------------------
Benchmark 8-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:181
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.27821 s
12.6458 ms 12.4147 ms 12.8939 ms
1.20942 ms 1.02918 ms 1.44596 ms
lower_bound 100 1 2.41199 s
25.1968 ms 24.8048 ms 25.7316 ms
2.31554 ms 1.8393 ms 3.003 ms
-------------------------------------------------------------------------------
Benchmark 16-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:222
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.30899 s
24.4317 ms 23.9044 ms 25.0517 ms
2.91211 ms 2.49601 ms 3.54277 ms
lower_bound 100 1 4.99868 s
50.8212 ms 49.8522 ms 51.9173 ms
5.25042 ms 4.58871 ms 6.11639 ms
-------------------------------------------------------------------------------
Benchmark 32-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:271
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 6.00391 s
56.3891 ms 55.1896 ms 57.9001 ms
6.85105 ms 5.55871 ms 9.05095 ms
lower_bound 100 1 8.07226 s
84.2532 ms 83.208 ms 85.9347 ms
6.61445 ms 4.73297 ms 10.2058 ms
-------------------------------------------------------------------------------
Benchmark shifted 2-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:336
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 761.931 ms
7.59297 ms 7.45167 ms 7.74277 ms
740.596 us 634.527 us 880.606 us
lower_bound 100 1 1.07614 s
10.3426 ms 10.1637 ms 10.5465 ms
971.953 us 824.168 us 1.18638 ms
-------------------------------------------------------------------------------
Benchmark shifted 4-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:363
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.77012 s
17.5582 ms 17.3779 ms 17.8197 ms
1.09878 ms 805.768 us 1.58282 ms
lower_bound 100 1 1.56263 s
15.8406 ms 15.599 ms 16.1249 ms
1.33407 ms 1.12983 ms 1.63007 ms
-------------------------------------------------------------------------------
Benchmark shifted 8-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:392
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 5.10477 s
49.3351 ms 48.9837 ms 50.0338 ms
2.44673 ms 1.49378 ms 4.36001 ms
lower_bound 100 1 2.38293 s
24.0694 ms 23.7582 ms 24.4762 ms
1.79992 ms 1.46246 ms 2.32915 ms
-------------------------------------------------------------------------------
Benchmark shifted 16-source plan evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:433
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 19.5271 s
184.362 ms 182.519 ms 187.251 ms
11.5617 ms 8.03227 ms 15.8517 ms
lower_bound 100 1 4.25707 s
44.526 ms 44.0483 ms 45.4736 ms
3.30709 ms 1.98546 ms 5.80549 ms
-------------------------------------------------------------------------------
Benchmark boxed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:482
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 407.308 ms
4.14243 ms 4.07331 ms 4.2271 ms
388.216 us 329.469 us 502.82 us
lower_bound 100 1 771.5 ms
7.25047 ms 7.12083 ms 7.40133 ms
710.946 us 582.312 us 938.069 us
-------------------------------------------------------------------------------
Benchmark boxed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:504
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 539.938 ms
5.47255 ms 5.39887 ms 5.55248 ms
391.085 us 344.227 us 452.107 us
lower_bound 100 1 919.371 ms
9.51528 ms 9.36978 ms 9.68292 ms
796.974 us 676.71 us 976.867 us
-------------------------------------------------------------------------------
Benchmark boxed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:530
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 799.563 ms
8.0579 ms 7.94233 ms 8.19289 ms
637.24 us 551.31 us 772.694 us
lower_bound 100 1 1.59326 s
16.0516 ms 15.8712 ms 16.2489 ms
968.921 us 820.856 us 1.14789 ms
-------------------------------------------------------------------------------
Benchmark boxed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:567
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.33725 s
13.5923 ms 13.3448 ms 13.8921 ms
1.3791 ms 1.1608 ms 1.71481 ms
lower_bound 100 1 2.5171 s
25.7672 ms 25.5787 ms 25.9888 ms
1.04128 ms 863.614 us 1.32401 ms
-------------------------------------------------------------------------------
Benchmark boxed 16-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:612
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.37579 s
23.9835 ms 23.8286 ms 24.1665 ms
857.47 us 721.139 us 1.01219 ms
lower_bound 100 1 4.42074 s
47.4923 ms 46.8352 ms 48.3636 ms
3.84172 ms 3.05297 ms 4.81105 ms
-------------------------------------------------------------------------------
Benchmark boxed ternary evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:661
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 652.212 ms
6.88737 ms 6.76773 ms 7.05678 ms
721.196 us 549.838 us 1.1579 ms
lower_bound 100 1 1.29119 s
12.2298 ms 12.0326 ms 12.4343 ms
1.01937 ms 865.212 us 1.26286 ms
-------------------------------------------------------------------------------
Benchmark mixed 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:692
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.64103 s
16.0216 ms 15.7692 ms 16.3116 ms
1.38061 ms 1.21305 ms 1.71202 ms
lower_bound 100 1 1.2512 s
12.0708 ms 11.8806 ms 12.2482 ms
930.329 us 755.932 us 1.16016 ms
-------------------------------------------------------------------------------
Benchmark mixed 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:719
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.56551 s
26.0297 ms 25.762 ms 26.3946 ms
1.60083 ms 1.23495 ms 2.10972 ms
lower_bound 100 1 1.75098 s
17.4148 ms 17.2347 ms 17.6011 ms
934.077 us 761.48 us 1.16338 ms
-------------------------------------------------------------------------------
Benchmark mixed 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:752
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 4.30796 s
44.478 ms 44.1471 ms 45.0073 ms
2.08739 ms 1.45992 ms 3.0487 ms
lower_bound 100 1 2.90812 s
28.9974 ms 28.6732 ms 29.4007 ms
1.83869 ms 1.45034 ms 2.36618 ms
-------------------------------------------------------------------------------
Benchmark mixed 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:789
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 8.52926 s
80.7863 ms 80.2915 ms 81.7379 ms
3.38141 ms 1.85402 ms 5.5225 ms
lower_bound 100 1 5.00469 s
51.5357 ms 50.8474 ms 52.6528 ms
4.39249 ms 3.06984 ms 6.49955 ms
-------------------------------------------------------------------------------
Benchmark strided 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:834
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 363.421 ms
3.67634 ms 3.6233 ms 3.73747 ms
291.158 us 245.852 us 359.861 us
lower_bound 100 1 713.524 ms
6.86567 ms 6.70145 ms 7.04343 ms
870.652 us 754.231 us 1.02791 ms
-------------------------------------------------------------------------------
Benchmark strided 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:858
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 641.614 ms
5.68243 ms 5.59681 ms 5.78338 ms
473.136 us 402.762 us 604.18 us
lower_bound 100 1 1.17863 s
10.1812 ms 10.024 ms 10.3927 ms
925.019 us 732.153 us 1.23215 ms
-------------------------------------------------------------------------------
Benchmark strided 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:886
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 977.654 ms
9.84098 ms 9.70013 ms 10.0246 ms
813.416 us 646.66 us 1.09266 ms
lower_bound 100 1 1.60379 s
15.7395 ms 15.3688 ms 16.1123 ms
1.88246 ms 1.60429 ms 2.21864 ms
-------------------------------------------------------------------------------
Benchmark cyclic 1-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:916
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 483.81 ms
4.73018 ms 4.67354 ms 4.80135 ms
321.975 us 260.792 us 439.02 us
lower_bound 100 1 725.665 ms
6.96013 ms 6.7967 ms 7.13687 ms
870.074 us 753.044 us 1.02404 ms
-------------------------------------------------------------------------------
Benchmark cyclic 2-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:954
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 731.742 ms
6.84663 ms 6.72907 ms 6.97318 ms
620.275 us 530.879 us 750.269 us
lower_bound 100 1 1.04943 s
10.0087 ms 9.79145 ms 10.2489 ms
1.16193 ms 988.821 us 1.39009 ms
-------------------------------------------------------------------------------
Benchmark cyclic 4-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:996
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.08955 s
11.3074 ms 11.1347 ms 11.6014 ms
1.121 ms 774.38 us 1.97883 ms
lower_bound 100 1 1.63983 s
15.2576 ms 15.0344 ms 15.5287 ms
1.25544 ms 1.05302 ms 1.57972 ms
-------------------------------------------------------------------------------
Benchmark cyclic 8-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:1041
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 1.82088 s
18.4577 ms 18.1933 ms 18.7559 ms
1.43729 ms 1.26312 ms 1.71214 ms
lower_bound 100 1 2.41503 s
24.081 ms 23.8665 ms 24.3137 ms
1.14044 ms 999.211 us 1.34431 ms
-------------------------------------------------------------------------------
Benchmark cyclic 16-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:1098
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.39409 s
33.7822 ms 33.4799 ms 34.2937 ms
1.9671 ms 1.32493 ms 3.53533 ms
lower_bound 100 1 4.37526 s
45.9293 ms 45.2039 ms 46.7992 ms
4.04254 ms 3.44845 ms 4.84316 ms
-------------------------------------------------------------------------------
Benchmark boxed & cyclic 16-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:1163
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 3.54744 s
36.3354 ms 35.843 ms 37.045 ms
2.97815 ms 2.21628 ms 4.04282 ms
lower_bound 100 1 4.38002 s
46.2645 ms 45.6407 ms 47.2325 ms
3.91346 ms 2.90072 ms 5.69116 ms
-------------------------------------------------------------------------------
Benchmark lambda 16-source evaluation
-------------------------------------------------------------------------------
/home/tdimson/projects/skimpy/tests/benchmarks/eval_bench.cpp:1228
...............................................................................
benchmark name samples iterations estimated
mean low mean high mean
std dev low std dev high std dev
-------------------------------------------------------------------------------
eval 100 1 2.70623 s
27.8625 ms 27.4424 ms 28.4531 ms
2.50998 ms 1.91081 ms 3.23323 ms
lower_bound 100 1 4.1932 s
43.4606 ms 42.8546 ms 44.2995 ms
3.61716 ms 2.78917 ms 4.71621 ms
===============================================================================
All tests passed (3 assertions in 31 test cases)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment