Benchmarks

local-vm-benchmarks.md

#Vagrant benchmarks VMP2

The following benchmarks were run before and after the recommendations by Stefan Wrobel were applied. https://stefanwrobel.com/how-to-make-vagrant-performance-not-suck

• use NFS
• use all cpu cores and 1/4 system memory
• vagrant package (Note: we already do this)

Web benchmarks

Before

Running 2m test @ http://thump.local:8000/
  2 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     5.59s   412.42ms   6.39s    80.00%
    Req/Sec     0.30      0.48     1.00     70.00%
  212 requests in 2.00m, 71.22KB read
  Socket errors: connect 0, read 0, write 0, timeout 384
Requests/sec:      1.76
Transfer/sec:     606.91B

Thread Stats	Avg	Stdev	Max	+/- Stdev
Latency	5.59s	412.42ms	6.39s	80.00%
Req/Sec	0.30	0.48	1.00	70.00%

After

Running 2m test @ http://thump.local:8000/
  2 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    49.81ms   18.41ms 214.46ms   78.35%
    Req/Sec   102.42     19.74   157.00     70.64%
  24593 requests in 2.00m, 8.07MB read
Requests/sec:    204.93
Transfer/sec:     68.84KB

Thread Stats	Avg	Stdev	Max	+/- Stdev
Latency	49.81ms	18.41ms	214.46ms	78.35%
Req/Sec	102.42	19.74	157.00	70.64%

Conclusion: It seems that subsequent calls to the homepage are fulfilled better after the recommendations were applied.

API benchmarks

Before

Running 2m test @ http://api-thump.local:8000/v1/articles
  2 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.00m     0.00us   1.00m   100.00%
    Req/Sec     0.00      0.00     0.00    100.00%
  19 requests in 2.00m, 4.19MB read
  Socket errors: connect 0, read 0, write 0, timeout 581
  Non-2xx or 3xx responses: 5
Requests/sec:      0.16
Transfer/sec:     35.75KB

Thread Stats	Avg	Stdev	Max	+/- Stdev
Latency	1.00m	0.00us	1.00m	100.00%
Req/Sec	0.00	0.00	0.00	100.00%

After

Running 2m test @ http://api-thump.local:8000/v1/articles
  2 threads and 10 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    44.72s     0.00us  44.72s   100.00%
    Req/Sec     0.00      0.00     0.00    100.00%
  23 requests in 2.00m, 6.86MB read
  Socket errors: connect 0, read 0, write 0, timeout 577
Requests/sec:      0.19
Transfer/sec:     58.48KB

Thread Stats	Avg	Stdev	Max	+/- Stdev
Latency	44.72s	0.00us	44.72s	100%
Req/Sec	0.00	0.00	00.00	100%