JMH Benchmark Test Results

binary_search_results

> mvn package && java -jar target/microbenchmarks.jar ".*MapBenchmarks.*BinarySearch.*" -f 1 -i 10 -wi 10 -r 3 -tu s
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building reactor-benchmark 1.0.0.BUILD-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ reactor-benchmark ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO]
[INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @ reactor-benchmark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ reactor-benchmark ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /Users/jbrisbin/Development/Projects/reactor/master/reactor-benchmark/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.0:testCompile (default-testCompile) @ reactor-benchmark ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ reactor-benchmark ---
[INFO] Surefire report directory: /Users/jbrisbin/Development/Projects/reactor/master/reactor-benchmark/target/surefire-reports

-------------------------------------------------------
 T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO]
[INFO] --- maven-jar-plugin:2.3.2:jar (default-jar) @ reactor-benchmark ---
[INFO] Building jar: /Users/jbrisbin/Development/Projects/reactor/master/reactor-benchmark/target/reactor-benchmark-1.0.0.BUILD-SNAPSHOT.jar
[INFO]
[INFO] --- maven-shade-plugin:2.0:shade (default) @ reactor-benchmark ---
[INFO] Including ch.qos.logback:logback-classic:jar:1.1.1 in the shaded jar.
[INFO] Including ch.qos.logback:logback-core:jar:1.1.1 in the shaded jar.
[INFO] Including org.slf4j:slf4j-api:jar:1.7.6 in the shaded jar.
[INFO] Including org.openjdk.jmh:jmh-core:jar:0.3.2 in the shaded jar.
[INFO] Including net.sf.jopt-simple:jopt-simple:jar:4.6 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.2 in the shaded jar.
[INFO] Including org.projectreactor:reactor-core:jar:1.1.0.BUILD-SNAPSHOT in the shaded jar.
[INFO] Including com.lmax:disruptor:jar:3.2.0 in the shaded jar.
[INFO] Replacing /Users/jbrisbin/Development/Projects/reactor/master/reactor-benchmark/target/microbenchmarks.jar with /Users/jbrisbin/Development/Projects/reactor/master/reactor-benchmark/target/reactor-benchmark-1.0.0.BUILD-SNAPSHOT-shaded.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.212s
[INFO] Finished at: Mon Feb 24 16:35:34 CST 2014
[INFO] Final Memory: 17M/322M
[INFO] ------------------------------------------------------------------------
# Run progress: 0.00% complete, ETA 00:02:00
# VM invoker: /Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/bin/java
# VM options: <none>
# Fork: 1 of 1
# Warmup: 10 iterations, 1 s each
# Measurement: 10 iterations, 3 s each
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: org.projectreactor.bench.reactor.MapBenchmarks.bogStandardBinarySearch
# Warmup Iteration   1: 48.600 ops/s
# Warmup Iteration   2: 47.183 ops/s
# Warmup Iteration   3: 48.550 ops/s
# Warmup Iteration   4: 48.117 ops/s
# Warmup Iteration   5: 48.717 ops/s
# Warmup Iteration   6: 48.383 ops/s
# Warmup Iteration   7: 47.983 ops/s
# Warmup Iteration   8: 48.533 ops/s
# Warmup Iteration   9: 48.550 ops/s
# Warmup Iteration  10: 48.900 ops/s
Iteration   1: 48.433 ops/s
Iteration   2: 48.700 ops/s
Iteration   3: 48.667 ops/s
Iteration   4: 48.700 ops/s
Iteration   5: 48.850 ops/s
Iteration   6: 37.817 ops/s
Iteration   7: 48.767 ops/s
Iteration   8: 44.883 ops/s
Iteration   9: 48.617 ops/s
Iteration  10: 48.683 ops/s

Result : 47.212 ±(99.9%) 5.309 ops/s
  Statistics: (min, avg, max) = (37.817, 47.212, 48.850), stdev = 3.511
  Confidence interval (99.9%): [41.903, 52.520]


# Run progress: 33.33% complete, ETA 00:01:21
# VM invoker: /Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/bin/java
# VM options: <none>
# Fork: 1 of 1
# Warmup: 10 iterations, 1 s each
# Measurement: 10 iterations, 3 s each
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: org.projectreactor.bench.reactor.MapBenchmarks.optimizedBinarySearch
# Warmup Iteration   1: 512.767 ops/s
# Warmup Iteration   2: 514.117 ops/s
# Warmup Iteration   3: 513.050 ops/s
# Warmup Iteration   4: 512.967 ops/s
# Warmup Iteration   5: 513.233 ops/s
# Warmup Iteration   6: 512.383 ops/s
# Warmup Iteration   7: 514.050 ops/s
# Warmup Iteration   8: 505.733 ops/s
# Warmup Iteration   9: 515.967 ops/s
# Warmup Iteration  10: 516.400 ops/s
Iteration   1: 514.517 ops/s
Iteration   2: 514.300 ops/s
Iteration   3: 514.283 ops/s
Iteration   4: 513.333 ops/s
Iteration   5: 510.717 ops/s
Iteration   6: 513.983 ops/s
Iteration   7: 516.100 ops/s
Iteration   8: 511.800 ops/s
Iteration   9: 513.783 ops/s
Iteration  10: 514.767 ops/s

Result : 513.758 ±(99.9%) 2.307 ops/s
  Statistics: (min, avg, max) = (510.717, 513.758, 516.100), stdev = 1.526
  Confidence interval (99.9%): [511.451, 516.066]


# Run progress: 66.67% complete, ETA 00:00:40
# VM invoker: /Library/Java/JavaVirtualMachines/jdk1.8.0.jdk/Contents/Home/jre/bin/java
# VM options: <none>
# Fork: 1 of 1
# Warmup: 10 iterations, 1 s each
# Measurement: 10 iterations, 3 s each
# Threads: 1 thread, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark: org.projectreactor.bench.reactor.MapBenchmarks.partitionedOptimizedBinarySearch
# Warmup Iteration   1: 122.600 ops/s
# Warmup Iteration   2: 122.867 ops/s
# Warmup Iteration   3: 122.417 ops/s
# Warmup Iteration   4: 123.100 ops/s
# Warmup Iteration   5: 121.533 ops/s
# Warmup Iteration   6: 122.417 ops/s
# Warmup Iteration   7: 121.633 ops/s
# Warmup Iteration   8: 121.450 ops/s
# Warmup Iteration   9: 122.283 ops/s
# Warmup Iteration  10: 122.833 ops/s
Iteration   1: 122.200 ops/s
Iteration   2: 123.083 ops/s
Iteration   3: 122.267 ops/s
Iteration   4: 123.217 ops/s
Iteration   5: 123.283 ops/s
Iteration   6: 123.133 ops/s
Iteration   7: 121.850 ops/s
Iteration   8: 122.150 ops/s
Iteration   9: 122.350 ops/s
Iteration  10: 122.700 ops/s

Result : 122.623 ±(99.9%) 0.792 ops/s
  Statistics: (min, avg, max) = (121.850, 122.623, 123.283), stdev = 0.524
  Confidence interval (99.9%): [121.832, 123.415]


Benchmark                                                  Mode   Samples         Mean   Mean error    Units
o.p.b.r.MapBenchmarks.bogStandardBinarySearch             thrpt        10       47.212        5.309    ops/s
o.p.b.r.MapBenchmarks.optimizedBinarySearch               thrpt        10      513.758        2.307    ops/s
o.p.b.r.MapBenchmarks.partitionedOptimizedBinarySearch    thrpt        10      122.623        0.792    ops/s