Benchmark a flask hello world app

gunicorn vs bjoern

apt-get install python-setuptools python-pip
pip install Flask gunicorn


ab -n 5000 -c 50 http://ec2-50-16-28-212.compute-1.amazonaws.com/

worker = 1

Concurrency Level:      50
Time taken for tests:   53.365 seconds
Complete requests:      5000
Failed requests:        0
Write errors:           0
Total transferred:      855000 bytes
HTML transferred:       55000 bytes
Requests per second:    93.69 [#/sec] (mean)
Time per request:       533.647 [ms] (mean)
Time per request:       10.673 [ms] (mean, across all concurrent requests)
Transfer rate:          15.65 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       98  396 927.0    132    7067
Processing:    98  130  19.6    128     216
Waiting:       98  130  19.6    128     216
Total:        196  526 923.1    278    7207

Percentage of the requests served within a certain time (ms)
  50%    278
  66%    281
  75%    286
  80%    294
  90%   1159
  95%   2216
  98%   4228
  99%   5147
 100%   7207 (longest request)


worker = 4

Concurrency Level:      50
Time taken for tests:   54.019 seconds
Complete requests:      5000
Failed requests:        0
Write errors:           0
Total transferred:      855000 bytes
HTML transferred:       55000 bytes
Requests per second:    92.56 [#/sec] (mean)
Time per request:       540.187 [ms] (mean)
Time per request:       10.804 [ms] (mean, across all concurrent requests)
Transfer rate:          15.46 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       98  392 846.3    138    5152
Processing:    98  134  19.3    135     208
Waiting:       98  134  19.3    135     208
Total:        197  526 840.6    280    5280

Percentage of the requests served within a certain time (ms)
  50%    280
  66%    282
  75%    285
  80%    295
  90%   1173
  95%   3159
  98%   3270
  99%   5121
 100%   5280 (longest request)



bjoern  (can only start one process on one port)

Concurrency Level:      50
Time taken for tests:   55.861 seconds
Complete requests:      5000
Failed requests:        0
Write errors:           0
Total transferred:      450000 bytes
HTML transferred:       55000 bytes
Requests per second:    89.51 [#/sec] (mean)
Time per request:       558.614 [ms] (mean)
Time per request:       11.172 [ms] (mean, across all concurrent requests)
Transfer rate:          7.87 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       98  419 1131.2    123    7145
Processing:    98  122  13.1    121     185
Waiting:       98  122  13.1    121     185
Total:        197  541 1128.8    251    7263

Percentage of the requests served within a certain time (ms)
  50%    251
  66%    253
  75%    257
  80%    263
  90%    282
  95%   3174
  98%   5196
  99%   7186
 100%   7263 (longest request)