Benchmarks for Cowboy, Saloon and Vibed

benchmarks.txt

# 1000 concurrent, 100 000 request at all, no tweaks

# Cowboy

Server Software:        Cowboy
Server Hostname:        127.0.0.1
Server Port:            55555

Document Path:          /?value=5555
Document Length:        42 bytes

Concurrency Level:      1000
Time taken for tests:   13.614 seconds
Complete requests:      100000
Failed requests:        30
   (Connect: 0, Receive: 10, Length: 10, Exceptions: 10)
Write errors:           0
Total transferred:      15798420 bytes
HTML transferred:       4199580 bytes
Requests per second:    7345.41 [#/sec] (mean)
Time per request:       136.139 [ms] (mean)
Time per request:       0.136 [ms] (mean, across all concurrent requests)
Transfer rate:          1133.26 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   89 399.8      0    7023
Processing:     0   41 141.7     28    5195
Waiting:        0   41 137.8     27    5195
Total:          3  130 466.3     28    8757

Percentage of the requests served within a certain time (ms)
  50%     28
  66%     33
  75%     36
  80%     38
  90%     45
  95%   1028
  98%   1254
  99%   3026
 100%   8757 (longest request)

# Saloon


Server Software:        Cowboy
Server Hostname:        127.0.0.1
Server Port:            55556

Document Path:          /?value=5555
Document Length:        43 bytes

Concurrency Level:      1000
Time taken for tests:   15.582 seconds
Complete requests:      100000
Failed requests:        0
Write errors:           0
Total transferred:      15900000 bytes
HTML transferred:       4300000 bytes
Requests per second:    6417.63 [#/sec] (mean)
Time per request:       155.821 [ms] (mean)
Time per request:       0.156 [ms] (mean, across all concurrent requests)
Transfer rate:          996.49 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   78 324.2      0    3012
Processing:     1   73  42.4     70    3317
Waiting:        1   73  42.4     69    3317
Total:          4  151 335.4     71    3317

Percentage of the requests served within a certain time (ms)
  50%     71
  66%     81
  75%     88
  80%     92
  90%    115
  95%   1070
  98%   1104
  99%   1293
 100%   3317 (longest request)

# Vibe.d


Server Software:        vibe.d/0.7.7
Server Hostname:        127.0.0.1
Server Port:            8080

Document Path:          /?value=5555
Document Length:        42 bytes

Concurrency Level:      1000
Time taken for tests:   10.782 seconds
Complete requests:      100000
Failed requests:        426
   (Connect: 0, Receive: 142, Length: 142, Exceptions: 142)
Write errors:           0
Total transferred:      16576428 bytes
HTML transferred:       4194036 bytes
Requests per second:    9274.32 [#/sec] (mean)
Time per request:       107.825 [ms] (mean)
Time per request:       0.108 [ms] (mean, across all concurrent requests)
Transfer rate:          1501.32 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   36 261.2      0    7020
Processing:     0   30 286.5      9    6799
Waiting:        0   21 152.7      9    6799
Total:          6   66 460.3      9    9759

Percentage of the requests served within a certain time (ms)
  50%      9
  66%      9
  75%     10
  80%     11
  90%     40
  95%     59
  98%   1012
  99%   1230
 100%   9759 (longest request)

# nginx static file


Server Software:        nginx/1.2.3
Server Hostname:        127.0.0.1
Server Port:            80

Document Path:          /?value=5555
Document Length:        151 bytes

Concurrency Level:      1000
Time taken for tests:   7.035 seconds
Complete requests:      100000
Failed requests:        1016
   (Connect: 0, Receive: 0, Length: 1016, Exceptions: 0)
Write errors:           0
Non-2xx responses:      1016
Total transferred:      36168043 bytes
HTML transferred:       15173517 bytes
Requests per second:    14215.37 [#/sec] (mean)
Time per request:       70.346 [ms] (mean)
Time per request:       0.070 [ms] (mean, across all concurrent requests)
Transfer rate:          5020.92 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0   55 232.1      8    3017
Processing:     3   13  46.4     11    3219
Waiting:        2   11  46.4      8    3216
Total:          7   68 243.3     19    4228

Percentage of the requests served within a certain time (ms)
  50%     19
  66%     24
  75%     26
  80%     27
  90%     29
  95%     40
  98%   1029
  99%   1033
 100%   4228 (longest request)