quick microbench of JRedisPipeline and JRedisChunkedPipeline

pipeline-chunking

old MBP (2 core) running Redis 2.2.6, the benchmark (in Eclipse) and The Clash on iTunes ;) 

The bench loops and async INCRs a key 100,000 times and then blocks on the last INCR future to get the value, and emits the time for the 100000 INCRs.
Single threaded.  The chunk pipeline actually saturates more fully with more threads.  

Code in (chunk-pipeline) branch. This is the first cut so hope to push the performance a bit more, and definitely want to squeeze that jitter (must be the GC).

This is a grab of both runs from the same point in their respective runs.  
--- new JRedisChunkedPipeline ---

01326953296642 Thu Jan 19 01:08:16 EST 2012 JRedis[tid:10] <INFO>: counter: 24100000  msec:333 ops/msecs:300.000000  [q-delta:247893000] [delta:333793000]
01326953296983 Thu Jan 19 01:08:16 EST 2012 JRedis[tid:10] <INFO>: counter: 24200000  msec:340 ops/msecs:294.000000  [q-delta:255671000] [delta:340514000]
01326953297415 Thu Jan 19 01:08:17 EST 2012 JRedis[tid:10] <INFO>: counter: 24300000  msec:431 ops/msecs:232.000000  [q-delta:402212000] [delta:431491000]
01326953297759 Thu Jan 19 01:08:17 EST 2012 JRedis[tid:10] <INFO>: counter: 24400000  msec:343 ops/msecs:291.000000  [q-delta:257305000] [delta:343995000]
01326953298099 Thu Jan 19 01:08:18 EST 2012 JRedis[tid:10] <INFO>: counter: 24500000  msec:339 ops/msecs:294.000000  [q-delta:255144000] [delta:339075000]
01326953298443 Thu Jan 19 01:08:18 EST 2012 JRedis[tid:10] <INFO>: counter: 24600000  msec:343 ops/msecs:291.000000  [q-delta:259568000] [delta:343664000]
01326953298787 Thu Jan 19 01:08:18 EST 2012 JRedis[tid:10] <INFO>: counter: 24700000  msec:343 ops/msecs:291.000000  [q-delta:256863000] [delta:343260000]
01326953299246 Thu Jan 19 01:08:19 EST 2012 JRedis[tid:10] <INFO>: counter: 24800000  msec:458 ops/msecs:218.000000  [q-delta:369860000] [delta:458645000]
01326953299593 Thu Jan 19 01:08:19 EST 2012 JRedis[tid:10] <INFO>: counter: 24900000  msec:346 ops/msecs:289.000000  [q-delta:259776000] [delta:346856000]
01326953299931 Thu Jan 19 01:08:19 EST 2012 JRedis[tid:10] <INFO>: counter: 25000000  msec:337 ops/msecs:296.000000  [q-delta:249980000] [delta:337401000]
01326953300287 Thu Jan 19 01:08:20 EST 2012 JRedis[tid:10] <INFO>: counter: 25100000  msec:355 ops/msecs:281.000000  [q-delta:268970000] [delta:355515000]
01326953300781 Thu Jan 19 01:08:20 EST 2012 JRedis[tid:10] <INFO>: counter: 25200000  msec:493 ops/msecs:202.000000  [q-delta:358262000] [delta:493067000]
01326953301119 Thu Jan 19 01:08:21 EST 2012 JRedis[tid:10] <INFO>: counter: 25300000  msec:338 ops/msecs:295.000000  [q-delta:257309000] [delta:338385000]
01326953301456 Thu Jan 19 01:08:21 EST 2012 JRedis[tid:10] <INFO>: counter: 25400000  msec:335 ops/msecs:298.000000  [q-delta:249758000] [delta:335839000]
01326953301843 Thu Jan 19 01:08:21 EST 2012 JRedis[tid:10] <INFO>: counter: 25500000  msec:386 ops/msecs:259.000000  [q-delta:301579000] [delta:386779000]
01326953302242 Thu Jan 19 01:08:22 EST 2012 JRedis[tid:10] <INFO>: counter: 25600000  msec:397 ops/msecs:251.000000  [q-delta:353295000] [delta:397875000]
01326953302584 Thu Jan 19 01:08:22 EST 2012 JRedis[tid:10] <INFO>: counter: 25700000  msec:341 ops/msecs:293.000000  [q-delta:258861000] [delta:341962000]
01326953302929 Thu Jan 19 01:08:22 EST 2012 JRedis[tid:10] <INFO>: counter: 25800000  msec:344 ops/msecs:290.000000  [q-delta:258862000] [delta:344585000]
01326953303262 Thu Jan 19 01:08:23 EST 2012 JRedis[tid:10] <INFO>: counter: 25900000  msec:332 ops/msecs:301.000000  [q-delta:246410000] [delta:332621000]
01326953303600 Thu Jan 19 01:08:23 EST 2012 JRedis[tid:10] <INFO>: counter: 26000000  msec:337 ops/msecs:296.000000  [q-delta:252131000] [delta:337497000]
01326953304095 Thu Jan 19 01:08:24 EST 2012 JRedis[tid:10] <INFO>: counter: 26100000  msec:494 ops/msecs:202.000000  [q-delta:404461000] [delta:494351000]
01326953304434 Thu Jan 19 01:08:24 EST 2012 JRedis[tid:10] <INFO>: counter: 26200000  msec:338 ops/msecs:295.000000  [q-delta:252905000] [delta:338825000]
01326953304778 Thu Jan 19 01:08:24 EST 2012 JRedis[tid:10] <INFO>: counter: 26300000  msec:343 ops/msecs:291.000000  [q-delta:260987000] [delta:343363000]
01326953305127 Thu Jan 19 01:08:25 EST 2012 JRedis[tid:10] <INFO>: counter: 26400000  msec:348 ops/msecs:287.000000  [q-delta:259302000] [delta:348578000]
01326953305528 Thu Jan 19 01:08:25 EST 2012 JRedis[tid:10] <INFO>: counter: 26500000  msec:400 ops/msecs:250.000000  [q-delta:313196000] [delta:400209000]
01326953305867 Thu Jan 19 01:08:25 EST 2012 JRedis[tid:10] <INFO>: counter: 26600000  msec:338 ops/msecs:295.000000  [q-delta:255811000] [delta:338174000]
01326953306204 Thu Jan 19 01:08:26 EST 2012 JRedis[tid:10] <INFO>: counter: 26700000  msec:336 ops/msecs:297.000000  [q-delta:251762000] [delta:336638000]
01326953306546 Thu Jan 19 01:08:26 EST 2012 JRedis[tid:10] <INFO>: counter: 26800000  msec:341 ops/msecs:293.000000  [q-delta:257271000] [delta:341443000]
01326953307032 Thu Jan 19 01:08:27 EST 2012 JRedis[tid:10] <INFO>: counter: 26900000  msec:485 ops/msecs:206.000000  [q-delta:409607000] [delta:485656000]
01326953307376 Thu Jan 19 01:08:27 EST 2012 JRedis[tid:10] <INFO>: counter: 27000000  msec:344 ops/msecs:290.000000  [q-delta:259180000] [delta:344000000]
01326953307723 Thu Jan 19 01:08:27 EST 2012 JRedis[tid:10] <INFO>: counter: 27100000  msec:346 ops/msecs:289.000000  [q-delta:261690000] [delta:346233000]
01326953308071 Thu Jan 19 01:08:28 EST 2012 JRedis[tid:10] <INFO>: counter: 27200000  msec:347 ops/msecs:288.000000  [q-delta:260501000] [delta:347230000]
01326953308459 Thu Jan 19 01:08:28 EST 2012 JRedis[tid:10] <INFO>: counter: 27300000  msec:388 ops/msecs:257.000000  [q-delta:248672000] [delta:388014000]
01326953308797 Thu Jan 19 01:08:28 EST 2012 JRedis[tid:10] <INFO>: counter: 27400000  msec:337 ops/msecs:296.000000  [q-delta:250965000] [delta:337035000]
01326953309147 Thu Jan 19 01:08:29 EST 2012 JRedis[tid:10] <INFO>: counter: 27500000  msec:349 ops/msecs:286.000000  [q-delta:265637000] [delta:349380000]
01326953309486 Thu Jan 19 01:08:29 EST 2012 JRedis[tid:10] <INFO>: counter: 27600000  msec:338 ops/msecs:295.000000  [q-delta:251714000] [delta:338724000]
01326953309828 Thu Jan 19 01:08:29 EST 2012 JRedis[tid:10] <INFO>: counter: 27700000  msec:341 ops/msecs:293.000000  [q-delta:255463000] [delta:341423000]
01326953310282 Thu Jan 19 01:08:30 EST 2012 JRedis[tid:10] <INFO>: counter: 27800000  msec:453 ops/msecs:220.000000  [q-delta:361370000] [delta:453359000]
01326953310619 Thu Jan 19 01:08:30 EST 2012 JRedis[tid:10] <INFO>: counter: 27900000  msec:336 ops/msecs:297.000000  [q-delta:251921000] [delta:336934000]
01326953310971 Thu Jan 19 01:08:30 EST 2012 JRedis[tid:10] <INFO>: counter: 28000000  msec:351 ops/msecs:284.000000  [q-delta:256152000] [delta:351563000]
01326953311328 Thu Jan 19 01:08:31 EST 2012 JRedis[tid:10] <INFO>: counter: 28100000  msec:348 ops/msecs:287.000000  [q-delta:262213000] [delta:348167000]
01326953311770 Thu Jan 19 01:08:31 EST 2012 JRedis[tid:10] <INFO>: counter: 28200000  msec:440 ops/msecs:227.000000  [q-delta:323753000] [delta:440931000]
01326953312108 Thu Jan 19 01:08:32 EST 2012 JRedis[tid:10] <INFO>: counter: 28300000  msec:337 ops/msecs:296.000000  [q-delta:252639000] [delta:337997000]
01326953312452 Thu Jan 19 01:08:32 EST 2012 JRedis[tid:10] <INFO>: counter: 28400000  msec:343 ops/msecs:291.000000  [q-delta:254951000] [delta:343105000]
01326953312804 Thu Jan 19 01:08:32 EST 2012 JRedis[tid:10] <INFO>: counter: 28500000  msec:351 ops/msecs:284.000000  [q-delta:265836000] [delta:351868000]
01326953313292 Thu Jan 19 01:08:33 EST 2012 JRedis[tid:10] <INFO>: counter: 28600000  msec:487 ops/msecs:205.000000  [q-delta:442793000] [delta:487262000]
01326953313641 Thu Jan 19 01:08:33 EST 2012 JRedis[tid:10] <INFO>: counter: 28700000  msec:348 ops/msecs:287.000000  [q-delta:261266000] [delta:348991000]
01326953313988 Thu Jan 19 01:08:33 EST 2012 JRedis[tid:10] <INFO>: counter: 28800000  msec:346 ops/msecs:289.000000  [q-delta:258406000] [delta:346378000]
01326953314345 Thu Jan 19 01:08:34 EST 2012 JRedis[tid:10] <INFO>: counter: 28900000  msec:356 ops/msecs:280.000000  [q-delta:268135000] [delta:356729000]
01326953314710 Thu Jan 19 01:08:34 EST 2012 JRedis[tid:10] <INFO>: counter: 29000000  msec:363 ops/msecs:275.000000  [q-delta:275426000] [delta:363773000]
01326953315150 Thu Jan 19 01:08:35 EST 2012 JRedis[tid:10] <INFO>: counter: 29100000  msec:439 ops/msecs:227.000000  [q-delta:348698000] [delta:439585000]

-- JRedisPipeline --

01326953673752 Thu Jan 19 01:14:33 EST 2012 JRedis[tid:10] <INFO>: counter: 24200000  msec:865 ops/msecs:115.000000  [q-delta:860418000] [delta:865025000]
01326953674553 Thu Jan 19 01:14:34 EST 2012 JRedis[tid:10] <INFO>: counter: 24300000  msec:801 ops/msecs:124.000000  [q-delta:795942000] [delta:801095000]
01326953675469 Thu Jan 19 01:14:35 EST 2012 JRedis[tid:10] <INFO>: counter: 24400000  msec:915 ops/msecs:109.000000  [q-delta:912429000] [delta:915006000]
01326953676295 Thu Jan 19 01:14:36 EST 2012 JRedis[tid:10] <INFO>: counter: 24500000  msec:825 ops/msecs:121.000000  [q-delta:823102000] [delta:825622000]
01326953677112 Thu Jan 19 01:14:37 EST 2012 JRedis[tid:10] <INFO>: counter: 24600000  msec:816 ops/msecs:122.000000  [q-delta:728044000] [delta:816448000]
01326953677856 Thu Jan 19 01:14:37 EST 2012 JRedis[tid:10] <INFO>: counter: 24700000  msec:744 ops/msecs:134.000000  [q-delta:647338000] [delta:744072000]
01326953678608 Thu Jan 19 01:14:38 EST 2012 JRedis[tid:10] <INFO>: counter: 24800000  msec:751 ops/msecs:133.000000  [q-delta:721506000] [delta:751038000]
01326953679512 Thu Jan 19 01:14:39 EST 2012 JRedis[tid:10] <INFO>: counter: 24900000  msec:903 ops/msecs:110.000000  [q-delta:843653000] [delta:903639000]
01326953680253 Thu Jan 19 01:14:40 EST 2012 JRedis[tid:10] <INFO>: counter: 25000000  msec:740 ops/msecs:135.000000  [q-delta:736495000] [delta:740053000]
01326953681047 Thu Jan 19 01:14:41 EST 2012 JRedis[tid:10] <INFO>: counter: 25100000  msec:793 ops/msecs:126.000000  [q-delta:778388000] [delta:793904000]
01326953681902 Thu Jan 19 01:14:41 EST 2012 JRedis[tid:10] <INFO>: counter: 25200000  msec:854 ops/msecs:117.000000  [q-delta:848393000] [delta:854217000]
01326953682715 Thu Jan 19 01:14:42 EST 2012 JRedis[tid:10] <INFO>: counter: 25300000  msec:812 ops/msecs:123.000000  [q-delta:808341000] [delta:812516000]
01326953683637 Thu Jan 19 01:14:43 EST 2012 JRedis[tid:10] <INFO>: counter: 25400000  msec:921 ops/msecs:108.000000  [q-delta:875189000] [delta:921997000]
01326953684515 Thu Jan 19 01:14:44 EST 2012 JRedis[tid:10] <INFO>: counter: 25500000  msec:877 ops/msecs:114.000000  [q-delta:872637000] [delta:877129000]
01326953685308 Thu Jan 19 01:14:45 EST 2012 JRedis[tid:10] <INFO>: counter: 25600000  msec:792 ops/msecs:126.000000  [q-delta:791722000] [delta:792319000]
01326953686167 Thu Jan 19 01:14:46 EST 2012 JRedis[tid:10] <INFO>: counter: 25700000  msec:859 ops/msecs:116.000000  [q-delta:858154000] [delta:859240000]
01326953686997 Thu Jan 19 01:14:46 EST 2012 JRedis[tid:10] <INFO>: counter: 25800000  msec:828 ops/msecs:120.000000  [q-delta:822374000] [delta:828722000]
01326953687999 Thu Jan 19 01:14:47 EST 2012 JRedis[tid:10] <INFO>: counter: 25900000  msec:1002 ops/msecs:99.000000  [q-delta:961158000] [delta:1002283000]
01326953688815 Thu Jan 19 01:14:48 EST 2012 JRedis[tid:10] <INFO>: counter: 26000000  msec:815 ops/msecs:122.000000  [q-delta:809134000] [delta:815594000]
01326953689628 Thu Jan 19 01:14:49 EST 2012 JRedis[tid:10] <INFO>: counter: 26100000  msec:811 ops/msecs:123.000000  [q-delta:783004000] [delta:811494000]
01326953690427 Thu Jan 19 01:14:50 EST 2012 JRedis[tid:10] <INFO>: counter: 26200000  msec:798 ops/msecs:125.000000  [q-delta:796445000] [delta:798665000]
01326953691300 Thu Jan 19 01:14:51 EST 2012 JRedis[tid:10] <INFO>: counter: 26300000  msec:872 ops/msecs:114.000000  [q-delta:872183000] [delta:872749000]
01326953692338 Thu Jan 19 01:14:52 EST 2012 JRedis[tid:10] <INFO>: counter: 26400000  msec:1037 ops/msecs:96.000000  [q-delta:1033982000] [delta:1037266000]
01326953693200 Thu Jan 19 01:14:53 EST 2012 JRedis[tid:10] <INFO>: counter: 26500000  msec:861 ops/msecs:116.000000  [q-delta:860620000] [delta:861344000]
01326953694030 Thu Jan 19 01:14:54 EST 2012 JRedis[tid:10] <INFO>: counter: 26600000  msec:829 ops/msecs:120.000000  [q-delta:827669000] [delta:829928000]
01326953694820 Thu Jan 19 01:14:54 EST 2012 JRedis[tid:10] <INFO>: counter: 26700000  msec:789 ops/msecs:126.000000  [q-delta:781593000] [delta:789182000]
01326953695671 Thu Jan 19 01:14:55 EST 2012 JRedis[tid:10] <INFO>: counter: 26800000  msec:851 ops/msecs:117.000000  [q-delta:849641000] [delta:851163000]
01326953696635 Thu Jan 19 01:14:56 EST 2012 JRedis[tid:10] <INFO>: counter: 26900000  msec:962 ops/msecs:103.000000  [q-delta:962428000] [delta:962723000]
01326953697600 Thu Jan 19 01:14:57 EST 2012 JRedis[tid:10] <INFO>: counter: 27000000  msec:965 ops/msecs:103.000000  [q-delta:964296000] [delta:965398000]
01326953698496 Thu Jan 19 01:14:58 EST 2012 JRedis[tid:10] <INFO>: counter: 27100000  msec:895 ops/msecs:111.000000  [q-delta:891207000] [delta:895298000]
01326953699342 Thu Jan 19 01:14:59 EST 2012 JRedis[tid:10] <INFO>: counter: 27200000  msec:845 ops/msecs:118.000000  [q-delta:831669000] [delta:845272000]
01326953700265 Thu Jan 19 01:15:00 EST 2012 JRedis[tid:10] <INFO>: counter: 27300000  msec:922 ops/msecs:108.000000  [q-delta:922283000] [delta:922664000]
01326953701118 Thu Jan 19 01:15:01 EST 2012 JRedis[tid:10] <INFO>: counter: 27400000  msec:852 ops/msecs:117.000000  [q-delta:844719000] [delta:852617000]
01326953702087 Thu Jan 19 01:15:02 EST 2012 JRedis[tid:10] <INFO>: counter: 27500000  msec:968 ops/msecs:103.000000  [q-delta:968056000] [delta:968678000]
01326953702951 Thu Jan 19 01:15:02 EST 2012 JRedis[tid:10] <INFO>: counter: 27600000  msec:862 ops/msecs:116.000000  [q-delta:859601000] [delta:862570000]
01326953703856 Thu Jan 19 01:15:03 EST 2012 JRedis[tid:10] <INFO>: counter: 27700000  msec:904 ops/msecs:110.000000  [q-delta:904086000] [delta:904834000]
01326953704698 Thu Jan 19 01:15:04 EST 2012 JRedis[tid:10] <INFO>: counter: 27800000  msec:841 ops/msecs:118.000000  [q-delta:841348000] [delta:841902000]
01326953705533 Thu Jan 19 01:15:05 EST 2012 JRedis[tid:10] <INFO>: counter: 27900000  msec:834 ops/msecs:119.000000  [q-delta:833179000] [delta:834291000]
01326953706552 Thu Jan 19 01:15:06 EST 2012 JRedis[tid:10] <INFO>: counter: 28000000  msec:1018 ops/msecs:98.000000  [q-delta:1015649000] [delta:1018207000]
01326953707383 Thu Jan 19 01:15:07 EST 2012 JRedis[tid:10] <INFO>: counter: 28100000  msec:830 ops/msecs:120.000000  [q-delta:827884000] [delta:830458000]
01326953708265 Thu Jan 19 01:15:08 EST 2012 JRedis[tid:10] <INFO>: counter: 28200000  msec:881 ops/msecs:113.000000  [q-delta:869684000] [delta:881568000]
01326953709078 Thu Jan 19 01:15:09 EST 2012 JRedis[tid:10] <INFO>: counter: 28300000  msec:812 ops/msecs:123.000000  [q-delta:807656000] [delta:812953000]
01326953709995 Thu Jan 19 01:15:09 EST 2012 JRedis[tid:10] <INFO>: counter: 28400000  msec:916 ops/msecs:109.000000  [q-delta:915522000] [delta:916819000]
01326953710934 Thu Jan 19 01:15:10 EST 2012 JRedis[tid:10] <INFO>: counter: 28500000  msec:938 ops/msecs:106.000000  [q-delta:937538000] [delta:938239000]
01326953711765 Thu Jan 19 01:15:11 EST 2012 JRedis[tid:10] <INFO>: counter: 28600000  msec:830 ops/msecs:120.000000  [q-delta:827999000] [delta:830779000]
01326953712606 Thu Jan 19 01:15:12 EST 2012 JRedis[tid:10] <INFO>: counter: 28700000  msec:840 ops/msecs:119.000000  [q-delta:840101000] [delta:840378000]
01326953713455 Thu Jan 19 01:15:13 EST 2012 JRedis[tid:10] <INFO>: counter: 28800000  msec:848 ops/msecs:117.000000  [q-delta:841398000] [delta:848286000]
01326953714303 Thu Jan 19 01:15:14 EST 2012 JRedis[tid:10] <INFO>: counter: 28900000  msec:847 ops/msecs:118.000000  [q-delta:845919000] [delta:847463000]
01326953715343 Thu Jan 19 01:15:15 EST 2012 JRedis[tid:10] <INFO>: counter: 29000000  msec:1040 ops/msecs:96.000000  [q-delta:1033572000] [delta:1040036000]
01326953716179 Thu Jan 19 01:15:16 EST 2012 JRedis[tid:10] <INFO>: counter: 29100000  msec:834 ops/msecs:119.000000  [q-delta:834222000] [delta:834643000]