Skip to content

Instantly share code, notes, and snippets.

@jfarcand

jfarcand/gist:796731

Created January 26, 2011 14:08
Show Gist options
  • Save jfarcand/796731 to your computer and use it in GitHub Desktop.
Save jfarcand/796731 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.html
Client: Mac Pro OS X, 2.8Ghz Quad-Core Intel Xeon, 8 GB 1066 Mhz DDR3
Server: lighttpd/1.4.26 -> Ubuntu, 2.8Ghz Duo-Core Intel Xeon, 6 1066 Mhz DDR3
50 threads that does 50 requests, done 50 times.
Async Http Client 1.5.0 (Config http://is.gd/7rGGWU)
=============================================================
BenchmarkResult{requestsPerSecond=1578.96, threads=50, batches=50, targetRequests=125000, successfulRequests=125000, failedRequests=0, averageRequestTime=0.63ms, averageBatchTime=1583.32ms, totalBenchmarkTime=79166.03ms}
(last 5 runs)
Batch 45 finished: BatchResult{requestsPerSecond=2220.19, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=49358.35ms, averageTimePerThread=987.16ms, averageTimePerRequest=0.45ms, totalBatchTime=1126.02ms}
Batch 46 finished: BatchResult{requestsPerSecond=1847.48, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=45927.16ms, averageTimePerThread=918.54ms, averageTimePerRequest=0.54ms, totalBatchTime=1353.19ms}
Batch 47 finished: BatchResult{requestsPerSecond=1523.45, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=62574.15ms, averageTimePerThread=1251.48ms, averageTimePerRequest=0.65ms, totalBatchTime=1641.01ms}
Batch 48 finished: BatchResult{requestsPerSecond=1980.73, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=50148.37ms, averageTimePerThread=1002.96ms, averageTimePerRequest=0.50ms, totalBatchTime=1262.15ms}
Batch 49 finished: BatchResult{requestsPerSecond=1510.32, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=51729.24ms, averageTimePerThread=1034.58ms, averageTimePerRequest=0.66ms, totalBatchTime=1655.27ms}
A very popular Java Client - latest version (Config: http://is.gd/BqM3JH)
===================
BenchmarkResult{requestsPerSecond=856.00, threads=50, batches=50, targetRequests=125000, successfulRequests=125000, failedRequests=0, averageRequestTime=1.16ms, averageBatchTime=2920.55ms, totalBenchmarkTime=146027.83ms}
(last 5 runs)
Batch 45 finished: BatchResult{requestsPerSecond=799.71, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=153900.78ms, averageTimePerThread=3078.01ms, averageTimePerRequest=1.25ms, totalBatchTime=3126.11ms}
Batch 46 finished: BatchResult{requestsPerSecond=1886.16, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=60684.17ms, averageTimePerThread=1213.68ms, averageTimePerRequest=0.53ms, totalBatchTime=1325.43ms}
Batch 47 finished: BatchResult{requestsPerSecond=485.49, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=250634.72ms, averageTimePerThread=5012.69ms, averageTimePerRequest=2.05ms, totalBatchTime=5149.40ms}
Batch 48 finished: BatchResult{requestsPerSecond=1696.43, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=71352.48ms, averageTimePerThread=1427.04ms, averageTimePerRequest=0.58ms, totalBatchTime=1473.67ms}
Batch 49 finished: BatchResult{requestsPerSecond=1087.18, batchTargetRequests=2500, batchSuccessfulRequests=2500, totalTimeForAllThreads=107878.19ms, averageTimePerThread=2157.56ms, averageTimePerRequest=0.91ms, totalBatchTime=2299.52ms}
100 threads that does 100 requests, done 100 times.
Async Http Client 1.5.0 (Config http://is.gd/7rGGWU)
=================
BenchmarkResult{requestsPerSecond=2102.54, threads=100, batches=100, targetRequests=1000000, successfulRequests=1000000, failedRequests=0, averageRequestTime=0.47ms, averageBatchTime=4756.14ms, totalBenchmarkTime=475614.22ms}
(last 5 runs)
Batch 95 finished: BatchResult{requestsPerSecond=2285.68, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=344172.97ms, averageTimePerThread=3441.72ms, averageTimePerRequest=0.43ms, totalBatchTime=4375.05ms}
Batch 96 finished: BatchResult{requestsPerSecond=2154.99, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=355337.0ms, averageTimePerThread=3553.37ms, averageTimePerRequest=0.46ms, totalBatchTime=4640.37ms}
Batch 97 finished: BatchResult{requestsPerSecond=2212.12, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=339305.38ms, averageTimePerThread=3393.05ms, averageTimePerRequest=0.45ms, totalBatchTime=4520.53ms}
Batch 98 finished: BatchResult{requestsPerSecond=2101.99, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=349676.4ms, averageTimePerThread=3496.76ms, averageTimePerRequest=0.47ms, totalBatchTime=4757.37ms}
Batch 99 finished: BatchResult{requestsPerSecond=2170.78, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=351736.94ms, averageTimePerThread=3517.36ms, averageTimePerRequest=0.46ms, totalBatchTime=4606.63ms}
Test finished, shutting down and calculating results...
A very popular Java Client - latest version (Config: http://is.gd/BqM3JH)
===================
BenchmarkResult{requestsPerSecond=838.82, threads=100, batches=100, targetRequests=1000000, successfulRequests=1000000, failedRequests=0, averageRequestTime=1.19ms, averageBatchTime=11921.43ms, totalBenchmarkTime=1192143.9ms}
(last 5 runs (**))
Batch 95 finished: BatchResult{requestsPerSecond=1612.37, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=608494.56ms, averageTimePerThread=6084.94ms, averageTimePerRequest=0.62ms, totalBatchTime=6202.03ms}
Batch 96 finished: BatchResult{requestsPerSecond=1465.76, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=614807.25ms, averageTimePerThread=6148.07ms, averageTimePerRequest=0.68ms, totalBatchTime=6822.37ms}
Batch 97 finished: BatchResult{requestsPerSecond=1586.89, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=617420.7ms, averageTimePerThread=6174.20ms, averageTimePerRequest=0.63ms, totalBatchTime=6301.60ms}
Batch 98 finished: BatchResult{requestsPerSecond=1521.13, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=645955.75ms, averageTimePerThread=6459.55ms, averageTimePerRequest=0.65ms, totalBatchTime=6574.03ms}
Batch 99 finished: BatchResult{requestsPerSecond=1453.62, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=675761.1ms, averageTimePerThread=6757.61ms, averageTimePerRequest=0.68ms, totalBatchTime=6879.36ms}
(**) Seems to suffer some GC at some point in time and produce many outlier results:
Batch 80 finished: BatchResult{requestsPerSecond=1585.98, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=618702.3ms, averageTimePerThread=6187.02ms, averageTimePerRequest=0.63ms, totalBatchTime=6305.22ms}
Batch 81 finished: BatchResult{requestsPerSecond=1534.06, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=641328.5ms, averageTimePerThread=6413.28ms, averageTimePerRequest=0.65ms, totalBatchTime=6518.62ms}
Batch 82 finished: BatchResult{requestsPerSecond=369.03, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=2642348.2ms, averageTimePerThread=26423.48ms, averageTimePerRequest=2.70ms, totalBatchTime=27097.42ms}
Batch 83 finished: BatchResult{requestsPerSecond=246.40, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=4037461.5ms, averageTimePerThread=40374.61ms, averageTimePerRequest=4.05ms, totalBatchTime=40584.2ms}
Batch 91 finished: BatchResult{requestsPerSecond=900.70, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=798519.25ms, averageTimePerThread=7985.19ms, averageTimePerRequest=1.11ms, totalBatchTime=11102.39ms}
Batch 92 finished: BatchResult{requestsPerSecond=186.41, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=5298173.0ms, averageTimePerThread=52981.73ms, averageTimePerRequest=5.36ms, totalBatchTime=53644.84ms}
Batch 93 finished: BatchResult{requestsPerSecond=1557.65, batchTargetRequests=10000, batchSuccessfulRequests=10000, totalTimeForAllThreads=616130.2ms, averageTimePerThread=6161.30ms, averageTimePerRequest=0.64ms, totalBatchTime=6419.90ms}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment