Skip to content

Instantly share code, notes, and snippets.

@viktorklang

viktorklang/Instructions.txt

Created October 8, 2017 13:01
Show Gist options
  • Save viktorklang/1c2c9e213bce6159d4114e14c6bc1f06 to your computer and use it in GitHub Desktop.
Save viktorklang/1c2c9e213bce6159d4114e14c6bc1f06 to your computer and use it in GitHub Desktop.
Download ZIP
Try the latest Scala Future impl!
Raw
Instructions.txt
First: Close all other applications, so that they don't interfere with the benchmark.
Second: Make sure that your computer is adequately cooled during the benchmark so it doesn't start thermal throttling.
Third: clone https://github.com/viktorklang/scala-futures/
Fourth: git checkout wip-optimizations-√
Fifth: start sbt
> project benches
> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .TransformationBenchmark*
> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CallbackBenchmark*
> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionWithBenchmark*
> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionBenchmark*
Last, but not least, report back the results of the benches, as a comment on this gist!
@rtfpessoa
Copy link

Benched on:

  • MacBook Pro (13-inch, 2017, Four Thunderbolt 3 Ports)
  • 3.5 GHz Intel Core i7
  • 16 GB 2133 MHz LPDDR3
> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .TransformationBenchmark*
[info] Running scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .TransformationBenchmark*
[info] # Run complete. Total time: 00:07:10
[info]
[info] Benchmark                                      (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] TransformationBenchmark.transformation_1       stdlib     fjp          1  thrpt   10   0.137 ± 0.004  ops/us
[info] TransformationBenchmark.transformation_1     improved     fjp          1  thrpt   10   0.140 ± 0.002  ops/us
[info] TransformationBenchmark.transformation_1024    stdlib     fjp          1  thrpt   10   7.721 ± 0.049  ops/us
[info] TransformationBenchmark.transformation_1024  improved     fjp          1  thrpt   10  20.812 ± 0.037  ops/us
[info] TransformationBenchmark.transformation_16      stdlib     fjp          1  thrpt   10   1.759 ± 0.018  ops/us
[info] TransformationBenchmark.transformation_16    improved     fjp          1  thrpt   10   2.073 ± 0.021  ops/us
[info] TransformationBenchmark.transformation_2       stdlib     fjp          1  thrpt   10   0.277 ± 0.004  ops/us
[info] TransformationBenchmark.transformation_2     improved     fjp          1  thrpt   10   0.276 ± 0.006  ops/us
[info] TransformationBenchmark.transformation_4       stdlib     fjp          1  thrpt   10   0.522 ± 0.011  ops/us
[info] TransformationBenchmark.transformation_4     improved     fjp          1  thrpt   10   0.542 ± 0.015  ops/us
[info] TransformationBenchmark.transformation_64      stdlib     fjp          1  thrpt   10   4.646 ± 0.032  ops/us
[info] TransformationBenchmark.transformation_64    improved     fjp          1  thrpt   10   6.428 ± 0.171  ops/us
[info] TransformationBenchmark.transformation_8192    stdlib     fjp          1  thrpt   10   9.371 ± 0.137  ops/us
[info] TransformationBenchmark.transformation_8192  improved     fjp          1  thrpt   10  25.008 ± 0.091  ops/us
[info]  scala.future.TransformationBenchmark.transformation_1024_impl=improved_pool=fjp_threads=1       21      ops/us
[info]  scala.future.TransformationBenchmark.transformation_1024_impl=stdlib_pool=fjp_threads=1 8       ops/us
[info]  scala.future.TransformationBenchmark.transformation_16_impl=improved_pool=fjp_threads=1 2       ops/us
[info]  scala.future.TransformationBenchmark.transformation_16_impl=stdlib_pool=fjp_threads=1   2       ops/us
[info]  scala.future.TransformationBenchmark.transformation_1_impl=improved_pool=fjp_threads=1  0       ops/us
[info]  scala.future.TransformationBenchmark.transformation_1_impl=stdlib_pool=fjp_threads=1    0       ops/us
[info]  scala.future.TransformationBenchmark.transformation_2_impl=improved_pool=fjp_threads=1  0       ops/us
[info]  scala.future.TransformationBenchmark.transformation_2_impl=stdlib_pool=fjp_threads=1    0       ops/us
[info]  scala.future.TransformationBenchmark.transformation_4_impl=improved_pool=fjp_threads=1  1       ops/us
[info]  scala.future.TransformationBenchmark.transformation_4_impl=stdlib_pool=fjp_threads=1    1       ops/us
[info]  scala.future.TransformationBenchmark.transformation_64_impl=improved_pool=fjp_threads=1 6       ops/us
[info]  scala.future.TransformationBenchmark.transformation_64_impl=stdlib_pool=fjp_threads=1   5       ops/us
[info]  scala.future.TransformationBenchmark.transformation_8192_impl=improved_pool=fjp_threads=1       25      ops/us
[info]  scala.future.TransformationBenchmark.transformation_8192_impl=stdlib_pool=fjp_threads=1 9       ops/us
[success] Total time: 437 s, completed 08-Oct-2017 20:06:48

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CallbackBenchmark*
[info] Running scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CallbackBenchmark*
[info] # Run complete. Total time: 00:07:08
[info]
[info] Benchmark                            (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] CallbackBenchmark.onComplete_1       stdlib     fjp          1  thrpt   10  18.447 ± 0.385  ops/us
[info] CallbackBenchmark.onComplete_1     improved     fjp          1  thrpt   10  19.855 ± 0.871  ops/us
[info] CallbackBenchmark.onComplete_1024    stdlib     fjp          1  thrpt   10  38.989 ± 3.526  ops/us
[info] CallbackBenchmark.onComplete_1024  improved     fjp          1  thrpt   10  57.790 ± 1.233  ops/us
[info] CallbackBenchmark.onComplete_16      stdlib     fjp          1  thrpt   10  38.577 ± 0.878  ops/us
[info] CallbackBenchmark.onComplete_16    improved     fjp          1  thrpt   10  41.141 ± 0.952  ops/us
[info] CallbackBenchmark.onComplete_2       stdlib     fjp          1  thrpt   10  24.621 ± 0.441  ops/us
[info] CallbackBenchmark.onComplete_2     improved     fjp          1  thrpt   10  29.744 ± 0.490  ops/us
[info] CallbackBenchmark.onComplete_4       stdlib     fjp          1  thrpt   10  31.137 ± 0.623  ops/us
[info] CallbackBenchmark.onComplete_4     improved     fjp          1  thrpt   10  32.596 ± 0.275  ops/us
[info] CallbackBenchmark.onComplete_64      stdlib     fjp          1  thrpt   10  41.329 ± 0.897  ops/us
[info] CallbackBenchmark.onComplete_64    improved     fjp          1  thrpt   10  55.296 ± 0.875  ops/us
[info] CallbackBenchmark.onComplete_8192    stdlib     fjp          1  thrpt   10  41.684 ± 0.556  ops/us
[info] CallbackBenchmark.onComplete_8192  improved     fjp          1  thrpt   10  52.779 ± 4.536  ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1024_impl=improved_pool=fjp_threads=1 58      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1024_impl=stdlib_pool=fjp_threads=1   39      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_16_impl=improved_pool=fjp_threads=1   41      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_16_impl=stdlib_pool=fjp_threads=1     39      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1_impl=improved_pool=fjp_threads=1    20      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1_impl=stdlib_pool=fjp_threads=1      18      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_2_impl=improved_pool=fjp_threads=1    30      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_2_impl=stdlib_pool=fjp_threads=1      25      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_4_impl=improved_pool=fjp_threads=1    33      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_4_impl=stdlib_pool=fjp_threads=1      31      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_64_impl=improved_pool=fjp_threads=1   55      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_64_impl=stdlib_pool=fjp_threads=1     41      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_8192_impl=improved_pool=fjp_threads=1 53      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_8192_impl=stdlib_pool=fjp_threads=1   42      ops/us
[success] Total time: 430 s, completed 08-Oct-2017 20:13:57

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionWithBenchmark*
[info] Running scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionWithBenchmark*
[info] # Run complete. Total time: 00:14:25
[info]
[info] Benchmark                                       (impl)  (result)   Mode  Cnt  Score   Error   Units
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   success  thrpt   10  3.637 ± 0.050  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   failure  thrpt   10  3.192 ± 0.052  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   success  thrpt   10  5.009 ± 0.104  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   failure  thrpt   10  4.190 ± 0.059  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   success  thrpt   10  5.353 ± 0.173  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   failure  thrpt   10  4.584 ± 0.099  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   success  thrpt   10  8.223 ± 0.113  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   failure  thrpt   10  8.228 ± 0.254  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   success  thrpt   10  4.940 ± 0.153  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   failure  thrpt   10  4.334 ± 0.091  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   success  thrpt   10  7.679 ± 0.138  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   failure  thrpt   10  7.731 ± 0.225  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   success  thrpt   10  4.148 ± 0.047  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   failure  thrpt   10  3.621 ± 0.068  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   success  thrpt   10  5.751 ± 0.174  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   failure  thrpt   10  4.557 ± 0.055  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   success  thrpt   10  4.572 ± 0.090  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   failure  thrpt   10  3.972 ± 0.075  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   success  thrpt   10  6.556 ± 0.183  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   failure  thrpt   10  6.308 ± 0.169  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   success  thrpt   10  5.031 ± 0.109  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   failure  thrpt   10  4.512 ± 0.102  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   success  thrpt   10  8.021 ± 0.155  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   failure  thrpt   10  8.150 ± 0.173  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   success  thrpt   10  5.172 ± 0.075  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   failure  thrpt   10  4.654 ± 0.067  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   success  thrpt   10  8.221 ± 0.098  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   failure  thrpt   10  8.169 ± 0.224  ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=failure  8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=success  8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=failure    5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=success    5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=failure    8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=success    8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=failure      4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=success      5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=failure     4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=success     5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=failure       3       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=success       4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=failure     5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=success     6       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=failure       4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=success       4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=failure     6       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=success     7       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=failure       4       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=success       5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=failure    8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=success    8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=failure      5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=success      5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=failure  8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=success  8       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=failure    5       ops/us
[info]  scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=success    5       ops/us
[success] Total time: 866 s, completed 08-Oct-2017 20:28:24

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionBenchmark*
[info] Running scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionBenchmark*
[info]
[info] # Run complete. Total time: 00:14:15
[info]
[info] Benchmark                               (impl)  (result)   Mode  Cnt    Score    Error   Units
[info] CompletionBenchmark.tryComplete_1       stdlib   success  thrpt   10   24.885 ±  0.440  ops/us
[info] CompletionBenchmark.tryComplete_1       stdlib   failure  thrpt   10   16.071 ±  0.336  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   success  thrpt   10   24.585 ±  0.565  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   failure  thrpt   10   17.226 ±  0.388  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   success  thrpt   10  407.948 ±  6.935  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   failure  thrpt   10   42.247 ±  1.134  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   success  thrpt   10  722.546 ± 14.567  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   failure  thrpt   10  878.938 ± 11.332  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   success  thrpt   10  225.708 ±  6.024  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   failure  thrpt   10   39.012 ±  0.661  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   success  thrpt   10  255.016 ±  4.392  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   failure  thrpt   10  207.474 ±  5.914  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   success  thrpt   10   40.754 ±  1.946  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   failure  thrpt   10   23.812 ±  0.622  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   success  thrpt   10   42.234 ±  0.905  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   failure  thrpt   10   32.116 ±  0.803  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   success  thrpt   10   72.144 ±  0.775  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   failure  thrpt   10   29.847 ±  0.529  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   success  thrpt   10   79.923 ±  1.036  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   failure  thrpt   10   62.099 ±  1.252  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   success  thrpt   10  355.129 ±  7.058  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   failure  thrpt   10   41.036 ±  0.667  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   success  thrpt   10  560.569 ± 12.095  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   failure  thrpt   10  490.880 ± 15.038  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   success  thrpt   10  406.080 ±  9.217  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   failure  thrpt   10   44.121 ±  2.879  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   success  thrpt   10  731.722 ± 26.146  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   failure  thrpt   10  730.927 ± 16.668  ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=failure  879     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=success  723     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=failure    42      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=success    408     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=failure    207     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=success    255     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=failure      39      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=success      226     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=failure     17      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=success     25      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=failure       16      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=success       25      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=failure     32      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=success     42      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=failure       24      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=success       41      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=failure     62      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=success     80      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=failure       30      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=success       72      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=failure    491     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=success    561     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=failure      41      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=success      355     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=failure  731     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=success  732     ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=failure    44      ops/us
[info]  scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=success    406     ops/us
[success] Total time: 856 s, completed 08-Oct-2017 20:47:31

@davidmweber
Copy link

Hi
I ran into this error several times. Platform is MBP 2016. Shout if I can assist in nailing this.

[info] # JMH version: 1.19
[info] # VM version: JDK 1.8.0_45, VM 25.45-b02
[info] # VM invoker: /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre/bin/java
[info] # VM options: -ea -server -XX:+UseCompressedOops -XX:+AggressiveOpts -XX:+AlwaysPreTouch -XX:+UseCondCardMark
[info] # Warmup: 15 iterations, 1 s each
[info] # Measurement: 10 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Throughput, ops/time
[info] # Benchmark: scala.future.TransformationBenchmark.transformation_1
[info] # Parameters: (impl = improved, pool = fjp, threads = 1)
[info]
[info] # Run progress: 7.14% complete, ETA 00:05:36
[info] # Fork: 1 of 1
[info] # Warmup Iteration 1:
[info]
[info] java.util.concurrent.TimeoutException: Future timed out after [60 seconds]
[info] at scala.future.impl.Promise$DefaultPromise.ready(Promise.scala:248)
[info] at scala.future.impl.Promise$DefaultPromise.result(Promise.scala:252)
[info] at scala.concurrent.Await$.$anonfun$result$1(package.scala:190)
[info] at scala.concurrent.Await$$$Lambda$15/1725172.apply(Unknown Source)
[info] at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
[info] at scala.concurrent.Await$.result(package.scala:123)
[info] at scala.future.TransformationBenchmark.transformation_1(TransformationBenchmark.scala:125)
[info] at scala.future.generated.TransformationBenchmark_transformation_1_jmhTest.transformation_1_thrpt_jmhStub(TransformationBenchmark_transformation_1_jmhTest.java:239)
[info] at scala.future.generated.TransformationBenchmark_transformation_1_jmhTest.transformation_1_Throughput(TransformationBenchmark_transformation_1_jmhTest.java:121)
[info] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[info] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[info] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[info] at java.lang.reflect.Method.invoke(Method.java:497)
[info] at org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:453)
[info] at org.openjdk.jmh.runner.BenchmarkHandler$BenchmarkTask.call(BenchmarkHandler.java:437)
[info] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[info] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[info] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[info] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[info] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[info] at java.lang.Thread.run(Thread.java:745)
[info]

@johanandren
Copy link

Late 2014 iMac, i7 4Ghz 4 core, Java 1.8.0_144, MacOS High Sierra, 32Gb 1600Mhz

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .TransformationBenchmark*
[info] # Run complete. Total time: 00:06:01
[info]
[info] Benchmark                                      (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] TransformationBenchmark.transformation_1       stdlib     fjp          1  thrpt   10   0.136 ± 0.002  ops/us
[info] TransformationBenchmark.transformation_1     improved     fjp          1  thrpt   10   0.132 ± 0.003  ops/us
[info] TransformationBenchmark.transformation_1024    stdlib     fjp          1  thrpt   10   8.853 ± 0.094  ops/us
[info] TransformationBenchmark.transformation_1024  improved     fjp          1  thrpt   10  19.439 ± 1.313  ops/us
[info] TransformationBenchmark.transformation_16      stdlib     fjp          1  thrpt   10   1.771 ± 0.023  ops/us
[info] TransformationBenchmark.transformation_16    improved     fjp          1  thrpt   10   2.070 ± 0.047  ops/us
[info] TransformationBenchmark.transformation_2       stdlib     fjp          1  thrpt   10   0.272 ± 0.006  ops/us
[info] TransformationBenchmark.transformation_2     improved     fjp          1  thrpt   10   0.263 ± 0.007  ops/us
[info] TransformationBenchmark.transformation_4       stdlib     fjp          1  thrpt   10   0.540 ± 0.008  ops/us
[info] TransformationBenchmark.transformation_4     improved     fjp          1  thrpt   10   0.533 ± 0.010  ops/us
[info] TransformationBenchmark.transformation_64      stdlib     fjp          1  thrpt   10   4.623 ± 0.084  ops/us
[info] TransformationBenchmark.transformation_64    improved     fjp          1  thrpt   10   6.422 ± 0.181  ops/us
[info] TransformationBenchmark.transformation_8192    stdlib     fjp          1  thrpt   10  10.199 ± 0.098  ops/us
[info] TransformationBenchmark.transformation_8192  improved     fjp          1  thrpt   10  19.541 ± 0.201  ops/us
[info] 	scala.future.TransformationBenchmark.transformation_1024_impl=improved_pool=fjp_threads=1	19	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_1024_impl=stdlib_pool=fjp_threads=1	9	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_16_impl=improved_pool=fjp_threads=1	2	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_16_impl=stdlib_pool=fjp_threads=1	2	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_1_impl=improved_pool=fjp_threads=1	0	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_1_impl=stdlib_pool=fjp_threads=1	0	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_2_impl=improved_pool=fjp_threads=1	0	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_2_impl=stdlib_pool=fjp_threads=1	0	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_4_impl=improved_pool=fjp_threads=1	1	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_4_impl=stdlib_pool=fjp_threads=1	1	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_64_impl=improved_pool=fjp_threads=1	6	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_64_impl=stdlib_pool=fjp_threads=1	5	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_8192_impl=improved_pool=fjp_threads=1	20	ops/us
[info] 	scala.future.TransformationBenchmark.transformation_8192_impl=stdlib_pool=fjp_threads=1	10	ops/us

>jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CallbackBenchmark*

[info] # Run complete. Total time: 00:05:58
[info]
[info] Benchmark                            (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] CallbackBenchmark.onComplete_1       stdlib     fjp          1  thrpt   10  20.906 ± 0.086  ops/us
[info] CallbackBenchmark.onComplete_1     improved     fjp          1  thrpt   10  22.638 ± 0.135  ops/us
[info] CallbackBenchmark.onComplete_1024    stdlib     fjp          1  thrpt   10  48.793 ± 0.278  ops/us
[info] CallbackBenchmark.onComplete_1024  improved     fjp          1  thrpt   10  61.475 ± 0.558  ops/us
[info] CallbackBenchmark.onComplete_16      stdlib     fjp          1  thrpt   10  45.063 ± 0.161  ops/us
[info] CallbackBenchmark.onComplete_16    improved     fjp          1  thrpt   10  48.555 ± 0.146  ops/us
[info] CallbackBenchmark.onComplete_2       stdlib     fjp          1  thrpt   10  28.859 ± 0.057  ops/us
[info] CallbackBenchmark.onComplete_2     improved     fjp          1  thrpt   10  32.741 ± 0.346  ops/us
[info] CallbackBenchmark.onComplete_4       stdlib     fjp          1  thrpt   10  36.190 ± 0.390  ops/us
[info] CallbackBenchmark.onComplete_4     improved     fjp          1  thrpt   10  38.684 ± 0.113  ops/us
[info] CallbackBenchmark.onComplete_64      stdlib     fjp          1  thrpt   10  46.715 ± 1.320  ops/us
[info] CallbackBenchmark.onComplete_64    improved     fjp          1  thrpt   10  59.903 ± 0.451  ops/us
[info] CallbackBenchmark.onComplete_8192    stdlib     fjp          1  thrpt   10  44.142 ± 1.034  ops/us
[info] CallbackBenchmark.onComplete_8192  improved     fjp          1  thrpt   10  55.726 ± 4.163  ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_1024_impl=improved_pool=fjp_threads=1	61	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_1024_impl=stdlib_pool=fjp_threads=1	49	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_16_impl=improved_pool=fjp_threads=1	49	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_16_impl=stdlib_pool=fjp_threads=1	45	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_1_impl=improved_pool=fjp_threads=1	23	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_1_impl=stdlib_pool=fjp_threads=1	21	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_2_impl=improved_pool=fjp_threads=1	33	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_2_impl=stdlib_pool=fjp_threads=1	29	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_4_impl=improved_pool=fjp_threads=1	39	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_4_impl=stdlib_pool=fjp_threads=1	36	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_64_impl=improved_pool=fjp_threads=1	60	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_64_impl=stdlib_pool=fjp_threads=1	47	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_8192_impl=improved_pool=fjp_threads=1	56	ops/us
[info] 	scala.future.CallbackBenchmark.onComplete_8192_impl=stdlib_pool=fjp_threads=1	44	ops/us

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionWithBenchmark*

[info] # Run complete. Total time: 00:12:03
[info]
[info] Benchmark                                       (impl)  (result)   Mode  Cnt  Score   Error   Units
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   success  thrpt   10  3.257 ± 0.023  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   failure  thrpt   10  3.502 ± 0.066  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   success  thrpt   10  5.415 ± 0.052  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   failure  thrpt   10  4.551 ± 0.053  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   success  thrpt   10  5.402 ± 0.090  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   failure  thrpt   10  4.828 ± 0.061  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   success  thrpt   10  8.589 ± 0.067  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   failure  thrpt   10  8.612 ± 0.141  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   success  thrpt   10  5.158 ± 0.153  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   failure  thrpt   10  4.690 ± 0.064  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   success  thrpt   10  8.336 ± 0.220  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   failure  thrpt   10  8.291 ± 0.093  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   success  thrpt   10  4.469 ± 0.046  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   failure  thrpt   10  4.001 ± 0.042  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   success  thrpt   10  5.538 ± 0.057  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   failure  thrpt   10  5.742 ± 0.183  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   success  thrpt   10  4.871 ± 0.065  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   failure  thrpt   10  4.491 ± 0.009  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   success  thrpt   10  8.105 ± 0.034  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   failure  thrpt   10  7.318 ± 0.026  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   success  thrpt   10  5.494 ± 0.026  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   failure  thrpt   10  4.976 ± 0.010  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   success  thrpt   10  9.498 ± 0.150  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   failure  thrpt   10  8.863 ± 0.191  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   success  thrpt   10  5.611 ± 0.096  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   failure  thrpt   10  5.262 ± 0.034  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   success  thrpt   10  8.858 ± 0.241  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   failure  thrpt   10  9.024 ± 0.169  ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=failure	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=success	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=failure	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=success	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=success	3	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=failure	6	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=success	6	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=success	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=failure	7	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=success	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=failure	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=success	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=failure	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=success	9	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=success	6	ops/us

> jmh:runMain scala.future.BenchRunner -p impl=stdlib,improved -p pool=fjp -p threads=1 -i 10 -wi 15 -f1 -t1 .CompletionBenchmark*

[info] # Run complete. Total time: 00:11:55
[info]
[info] Benchmark                               (impl)  (result)   Mode  Cnt     Score   Error   Units
[info] CompletionBenchmark.tryComplete_1       stdlib   success  thrpt   10    29.215 ± 0.251  ops/us
[info] CompletionBenchmark.tryComplete_1       stdlib   failure  thrpt   10    18.751 ± 0.110  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   success  thrpt   10    28.523 ± 0.263  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   failure  thrpt   10    21.073 ± 0.288  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   success  thrpt   10   687.080 ± 2.410  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   failure  thrpt   10    49.014 ± 0.089  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   success  thrpt   10  1023.992 ± 2.692  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   failure  thrpt   10  1005.651 ± 2.545  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   success  thrpt   10   239.217 ± 2.412  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   failure  thrpt   10    44.493 ± 0.093  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   success  thrpt   10   298.709 ± 2.224  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   failure  thrpt   10   231.805 ± 1.807  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   success  thrpt   10    47.226 ± 1.117  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   failure  thrpt   10    28.046 ± 0.168  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   success  thrpt   10    49.470 ± 0.389  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   failure  thrpt   10    37.818 ± 0.403  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   success  thrpt   10    88.155 ± 0.901  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   failure  thrpt   10    35.182 ± 0.160  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   success  thrpt   10    92.601 ± 1.530  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   failure  thrpt   10    72.825 ± 0.465  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   success  thrpt   10   453.317 ± 3.969  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   failure  thrpt   10    47.168 ± 0.078  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   success  thrpt   10   564.887 ± 8.966  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   failure  thrpt   10   497.314 ± 3.831  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   success  thrpt   10   717.950 ± 2.236  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   failure  thrpt   10    49.580 ± 3.462  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   success  thrpt   10  1067.990 ± 9.811  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   failure  thrpt   10  1070.038 ± 2.257  ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=failure	1006	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=success	1024	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=failure	49	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=success	687	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=failure	232	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=success	299	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=failure	44	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=success	239	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=failure	21	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=success	29	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=failure	19	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=success	29	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=failure	38	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=success	49	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=failure	28	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=success	47	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=failure	73	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=success	93	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=failure	35	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=success	88	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=failure	497	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=success	565	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=failure	47	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=success	453	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=failure	1070	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=success	1068	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=failure	50	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=success	718	ops/us

@jlprat
Copy link

jlprat commented Oct 10, 2017

i7 32GB DDR4 @ 2133MHz

[info] Result "scala.future.TransformationBenchmark.transformation_8192":
[info]   14.740 ±(99.9%) 4.271 ops/us [Average]
[info]   (min, avg, max) = (11.641, 14.740, 18.341), stdev = 2.825
[info]   CI (99.9%): [10.469, 19.012] (assumes normal distribution)
[info]
[info]
[info] # Run complete. Total time: 00:05:57
[info]
[info] Benchmark                                      (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] TransformationBenchmark.transformation_1       stdlib     fjp          1  thrpt   10   0.155 ± 0.003  ops/us
[info] TransformationBenchmark.transformation_1     improved     fjp          1  thrpt   10   0.170 ± 0.051  ops/us
[info] TransformationBenchmark.transformation_1024    stdlib     fjp          1  thrpt   10   6.901 ± 0.141  ops/us
[info] TransformationBenchmark.transformation_1024  improved     fjp          1  thrpt   10  16.790 ± 2.441  ops/us
[info] TransformationBenchmark.transformation_16      stdlib     fjp          1  thrpt   10   1.848 ± 0.052  ops/us
[info] TransformationBenchmark.transformation_16    improved     fjp          1  thrpt   10   2.230 ± 0.071  ops/us
[info] TransformationBenchmark.transformation_2       stdlib     fjp          1  thrpt   10   0.308 ± 0.003  ops/us
[info] TransformationBenchmark.transformation_2     improved     fjp          1  thrpt   10   0.326 ± 0.049  ops/us
[info] TransformationBenchmark.transformation_4       stdlib     fjp          1  thrpt   10   0.624 ± 0.084  ops/us
[info] TransformationBenchmark.transformation_4     improved     fjp          1  thrpt   10   0.636 ± 0.082  ops/us
[info] TransformationBenchmark.transformation_64      stdlib     fjp          1  thrpt   10   4.399 ± 0.063  ops/us
[info] TransformationBenchmark.transformation_64    improved     fjp          1  thrpt   10   6.745 ± 0.231  ops/us
[info] TransformationBenchmark.transformation_8192    stdlib     fjp          1  thrpt   10   7.391 ± 0.193  ops/us
[info] TransformationBenchmark.transformation_8192  improved     fjp          1  thrpt   10  14.740 ± 4.271  ops/us
[info]  scala.future.TransformationBenchmark.transformation_1024_impl=improved_pool=fjp_threads=1       17      ops/us
[info]  scala.future.TransformationBenchmark.transformation_1024_impl=stdlib_pool=fjp_threads=1 7       ops/us
[info]  scala.future.TransformationBenchmark.transformation_16_impl=improved_pool=fjp_threads=1 2       ops/us
[info]  scala.future.TransformationBenchmark.transformation_16_impl=stdlib_pool=fjp_threads=12ops/us
[info]  scala.future.TransformationBenchmark.transformation_1_impl=improved_pool=fjp_threads=10 ops/us
[info]  scala.future.TransformationBenchmark.transformation_1_impl=stdlib_pool=fjp_threads=1    0ops/us
[info]  scala.future.TransformationBenchmark.transformation_2_impl=improved_pool=fjp_threads=10 ops/us
[info]  scala.future.TransformationBenchmark.transformation_2_impl=stdlib_pool=fjp_threads=1    0ops/us
[info]  scala.future.TransformationBenchmark.transformation_4_impl=improved_pool=fjp_threads=11 ops/us
[info]  scala.future.TransformationBenchmark.transformation_4_impl=stdlib_pool=fjp_threads=1    1ops/us
[info]  scala.future.TransformationBenchmark.transformation_64_impl=improved_pool=fjp_threads=1 7       ops/us
[info]  scala.future.TransformationBenchmark.transformation_64_impl=stdlib_pool=fjp_threads=14ops/us
[info]  scala.future.TransformationBenchmark.transformation_8192_impl=improved_pool=fjp_threads=1       15      ops/us
[info]  scala.future.TransformationBenchmark.transformation_8192_impl=stdlib_pool=fjp_threads=1 7       ops/us

[info] Result "scala.future.CallbackBenchmark.onComplete_8192":
[info]   49.861 ±(99.9%) 5.720 ops/us [Average]
[info]   (min, avg, max) = (47.079, 49.861, 56.413), stdev = 3.783
[info]   CI (99.9%): [44.141, 55.580] (assumes normal distribution)
[info]
[info]
[info] # Run complete. Total time: 00:05:54
[info]
[info] Benchmark                            (impl)  (pool)  (threads)   Mode  Cnt   Score   Error   Units
[info] CallbackBenchmark.onComplete_1       stdlib     fjp          1  thrpt   10  21.110 ± 0.342  ops/us
[info] CallbackBenchmark.onComplete_1     improved     fjp          1  thrpt   10  25.511 ± 0.166  ops/us
[info] CallbackBenchmark.onComplete_1024    stdlib     fjp          1  thrpt   10  38.052 ± 0.090  ops/us
[info] CallbackBenchmark.onComplete_1024  improved     fjp          1  thrpt   10  52.904 ± 0.573  ops/us
[info] CallbackBenchmark.onComplete_16      stdlib     fjp          1  thrpt   10  36.827 ± 0.270  ops/us
[info] CallbackBenchmark.onComplete_16    improved     fjp          1  thrpt   10  38.935 ± 0.344  ops/us
[info] CallbackBenchmark.onComplete_2       stdlib     fjp          1  thrpt   10  27.046 ± 0.223  ops/us
[info] CallbackBenchmark.onComplete_2     improved     fjp          1  thrpt   10  34.077 ± 0.381  ops/us
[info] CallbackBenchmark.onComplete_4       stdlib     fjp          1  thrpt   10  31.698 ± 0.237  ops/us
[info] CallbackBenchmark.onComplete_4     improved     fjp          1  thrpt   10  33.668 ± 0.265  ops/us
[info] CallbackBenchmark.onComplete_64      stdlib     fjp          1  thrpt   10  38.727 ± 0.461  ops/us
[info] CallbackBenchmark.onComplete_64    improved     fjp          1  thrpt   10  51.312 ± 0.235  ops/us
[info] CallbackBenchmark.onComplete_8192    stdlib     fjp          1  thrpt   10  38.602 ± 0.251  ops/us
[info] CallbackBenchmark.onComplete_8192  improved     fjp          1  thrpt   10  49.861 ± 5.720  ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1024_impl=improved_pool=fjp_threads=1 53      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1024_impl=stdlib_pool=fjp_threads=1   38      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_16_impl=improved_pool=fjp_threads=1   39      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_16_impl=stdlib_pool=fjp_threads=1     37      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1_impl=improved_pool=fjp_threads=1    26      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_1_impl=stdlib_pool=fjp_threads=1      21      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_2_impl=improved_pool=fjp_threads=1    34      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_2_impl=stdlib_pool=fjp_threads=1      27      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_4_impl=improved_pool=fjp_threads=1    34      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_4_impl=stdlib_pool=fjp_threads=1      32      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_64_impl=improved_pool=fjp_threads=1   51      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_64_impl=stdlib_pool=fjp_threads=1     39      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_8192_impl=improved_pool=fjp_threads=1 50      ops/us
[info]  scala.future.CallbackBenchmark.onComplete_8192_impl=stdlib_pool=fjp_threads=1   39      ops/us

[info] Result "scala.future.CompletionWithBenchmark.tryCompleteWith_8192":
[info]   7.556 ±(99.9%) 0.035 ops/us [Average]
[info]   (min, avg, max) = (7.525, 7.556, 7.598), stdev = 0.023
[info]   CI (99.9%): [7.522, 7.591] (assumes normal distribution)
[info] 
[info] 
[info] # Run complete. Total time: 00:11:55
[info] 
[info] Benchmark                                       (impl)  (result)   Mode  Cnt  Score   Error   Units
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   success  thrpt   10  3.465 ± 0.020  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1       stdlib   failure  thrpt   10  3.025 ± 0.022  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   success  thrpt   10  4.846 ± 0.040  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1     improved   failure  thrpt   10  4.038 ± 0.035  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   success  thrpt   10  4.644 ± 0.057  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024    stdlib   failure  thrpt   10  4.329 ± 0.030  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   success  thrpt   10  7.660 ± 0.050  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_1024  improved   failure  thrpt   10  7.724 ± 0.045  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   success  thrpt   10  4.618 ± 0.040  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16      stdlib   failure  thrpt   10  4.105 ± 0.014  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   success  thrpt   10  7.344 ± 0.042  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_16    improved   failure  thrpt   10  7.380 ± 0.030  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   success  thrpt   10  4.040 ± 0.018  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2       stdlib   failure  thrpt   10  3.443 ± 0.035  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   success  thrpt   10  5.969 ± 0.034  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_2     improved   failure  thrpt   10  5.169 ± 0.037  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   success  thrpt   10  4.240 ± 0.024  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4       stdlib   failure  thrpt   10  3.743 ± 0.031  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   success  thrpt   10  6.788 ± 0.037  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_4     improved   failure  thrpt   10  6.189 ± 0.059  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   success  thrpt   10  4.714 ± 0.041  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64      stdlib   failure  thrpt   10  4.090 ± 0.027  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   success  thrpt   10  7.521 ± 0.044  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_64    improved   failure  thrpt   10  7.393 ± 0.032  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   success  thrpt   10  4.630 ± 0.045  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192    stdlib   failure  thrpt   10  4.345 ± 0.032  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   success  thrpt   10  7.599 ± 0.023  ops/us
[info] CompletionWithBenchmark.tryCompleteWith_8192  improved   failure  thrpt   10  7.556 ± 0.035  ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=failure	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=improved_result=success	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1024_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=failure	7	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=improved_result=success	7	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_16_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=improved_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=failure	3	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_1_impl=stdlib_result=success	3	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=failure	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=improved_result=success	6	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=failure	3	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_2_impl=stdlib_result=success	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=failure	6	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=improved_result=success	7	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_4_impl=stdlib_result=success	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=failure	7	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=improved_result=success	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_64_impl=stdlib_result=success	5	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=failure	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=improved_result=success	8	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=failure	4	ops/us
[info] 	scala.future.CompletionWithBenchmark.tryCompleteWith_8192_impl=stdlib_result=success	5	ops/us

[info] Result "scala.future.CompletionBenchmark.tryComplete_8192":
[info]   687.949 ±(99.9%) 0.456 ops/us [Average]
[info]   (min, avg, max) = (687.437, 687.949, 688.570), stdev = 0.301
[info]   CI (99.9%): [687.493, 688.405] (assumes normal distribution)
[info] 
[info] 
[info] # Run complete. Total time: 00:11:48
[info] 
[info] Benchmark                               (impl)  (result)   Mode  Cnt    Score    Error   Units
[info] CompletionBenchmark.tryComplete_1       stdlib   success  thrpt   10   33.644 ±  0.110  ops/us
[info] CompletionBenchmark.tryComplete_1       stdlib   failure  thrpt   10   17.823 ±  0.110  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   success  thrpt   10   31.379 ±  0.155  ops/us
[info] CompletionBenchmark.tryComplete_1     improved   failure  thrpt   10   19.834 ±  0.121  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   success  thrpt   10  378.529 ±  2.911  ops/us
[info] CompletionBenchmark.tryComplete_1024    stdlib   failure  thrpt   10   39.280 ±  0.331  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   success  thrpt   10  826.627 ± 10.282  ops/us
[info] CompletionBenchmark.tryComplete_1024  improved   failure  thrpt   10  820.172 ±  5.641  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   success  thrpt   10  251.321 ±  1.813  ops/us
[info] CompletionBenchmark.tryComplete_16      stdlib   failure  thrpt   10   36.846 ±  0.224  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   success  thrpt   10  289.859 ±  0.921  ops/us
[info] CompletionBenchmark.tryComplete_16    improved   failure  thrpt   10  223.847 ±  1.592  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   success  thrpt   10   51.896 ±  0.144  ops/us
[info] CompletionBenchmark.tryComplete_2       stdlib   failure  thrpt   10   24.898 ±  0.301  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   success  thrpt   10   51.125 ±  0.127  ops/us
[info] CompletionBenchmark.tryComplete_2     improved   failure  thrpt   10   36.193 ±  0.439  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   success  thrpt   10   94.477 ±  0.316  ops/us
[info] CompletionBenchmark.tryComplete_4       stdlib   failure  thrpt   10   30.565 ±  0.197  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   success  thrpt   10   97.251 ±  0.335  ops/us
[info] CompletionBenchmark.tryComplete_4     improved   failure  thrpt   10   69.855 ±  0.128  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   success  thrpt   10  355.271 ±  4.243  ops/us
[info] CompletionBenchmark.tryComplete_64      stdlib   failure  thrpt   10   38.420 ±  0.216  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   success  thrpt   10  575.297 ±  5.536  ops/us
[info] CompletionBenchmark.tryComplete_64    improved   failure  thrpt   10  501.714 ±  6.928  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   success  thrpt   10  382.756 ±  1.102  ops/us
[info] CompletionBenchmark.tryComplete_8192    stdlib   failure  thrpt   10   41.690 ±  2.324  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   success  thrpt   10  687.765 ±  1.608  ops/us
[info] CompletionBenchmark.tryComplete_8192  improved   failure  thrpt   10  687.949 ±  0.456  ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=failure	820	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=improved_result=success	827	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=failure	39	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1024_impl=stdlib_result=success	379	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=failure	224	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=improved_result=success	290	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=failure	37	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_16_impl=stdlib_result=success	251	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=failure	20	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=improved_result=success	31	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=failure	18	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_1_impl=stdlib_result=success	34	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=failure	36	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=improved_result=success	51	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=failure	25	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_2_impl=stdlib_result=success	52	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=failure	70	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=improved_result=success	97	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=failure	31	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_4_impl=stdlib_result=success	94	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=failure	502	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=improved_result=success	575	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=failure	38	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_64_impl=stdlib_result=success	355	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=failure	688	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=improved_result=success	688	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=failure	42	ops/us
[info] 	scala.future.CompletionBenchmark.tryComplete_8192_impl=stdlib_result=success	383	ops/us

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment