Skip to content

Instantly share code, notes, and snippets.

@leereilly
Created August 8, 2011 19:16
Show Gist options
  • Save leereilly/1132487 to your computer and use it in GitHub Desktop.
Save leereilly/1132487 to your computer and use it in GitHub Desktop.
Google vs. Parker Load vs. ImageStacks Load Tests

Simple load testing with ab -n [TOTAL_NUMBER_OF_REQUESTS] -c [NUMBER_OF_CONCURRENT_REQUESTS] [URI]

Summary

  • ImageStacks TEST can't can't handle more than 10 concurrent requests for large images (it will timeout for most users and be slow for a handful of users).
  • Tiled images are fine (fast response time and can handle over 50 concurrent requests), unless another ImageStacks request e.g. thumbnail view or large view is blocking.

Recommendation

  • Don't use thumbnails - this will reduce the load on ImageStacks. They're unnecessary if the training session is to demonstrate the ZPR viewer.
  • If DM/T-PEN can serve the images locally... that'll be better for both the users and the presenters.

100 total requests; 10 concurrent requests

GOOGLE (FOR REFERENCE)

Server Software:        gws
Server Hostname:        www.google.com
Server Port:            80

Document Path:          /
Document Length:        9748 bytes

Concurrency Level:      10
Time taken for tests:   0.721 seconds
Complete requests:      100
Failed requests:        75
   (Connect: 0, Receive: 0, Length: 75, Exceptions: 0)
Write errors:           0
Total transferred:      1034136 bytes
HTML transferred:       976336 bytes
Requests per second:    138.62 [#/sec] (mean)
Time per request:       72.141 [ms] (mean)
Time per request:       7.214 [ms] (mean, across all concurrent requests)
Transfer rate:          1399.90 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        3   19  12.2     15      63
Processing:    33   51  14.0     48     114
Waiting:       31   47  12.9     44      95
Total:         42   70  20.9     61     126

Percentage of the requests served within a certain time (ms)
  50%     61
  66%     75
  75%     80
  80%     88
  90%    106
  95%    117
  98%    126
  99%    126
 100%    126 (longest request)

PARKER DMSTECH PROTOTYPE

Server Software:        Apache/2.2.3
Server Hostname:        dms-dev.stanford.edu
Server Port:            80

Document Path:          /
Document Length:        129777 bytes

Concurrency Level:      10
Time taken for tests:   32.258 seconds
Complete requests:      100
Failed requests:        0
Write errors:           0
Total transferred:      13039723 bytes
HTML transferred:       12977700 bytes
Requests per second:    3.10 [#/sec] (mean)
Time per request:       3225.831 [ms] (mean)
Time per request:       322.583 [ms] (mean, across all concurrent requests)
Transfer rate:          394.75 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        2    3   1.8      3      12
Processing:   485 3134 4339.7   2042   29969
Waiting:      451 2879 4003.8   1890   27754
Total:        487 3137 4339.7   2044   29973

Percentage of the requests served within a certain time (ms)
  50%   2044
  66%   2495
  75%   2730
  80%   2913
  90%   4067
  95%   9512
  98%  22436
  99%  29973
 100%  29973 (longest request)

IMAGESTACKS (THUMBNAIL)

Server Software:        Apache/2.2.3
Server Hostname:        stacks-test.stanford.edu
Server Port:            443
SSL/TLS Protocol:       TLSv1/SSLv3,DHE-RSA-AES256-SHA,2048,256

Document Path:          /image/xq532gb5056/524_fob_TC_46_thumb
Document Length:        7652 bytes

Concurrency Level:      10
Time taken for tests:   26.214 seconds
Complete requests:      100
Failed requests:        0
Write errors:           0
Total transferred:      798000 bytes
HTML transferred:       765200 bytes
Requests per second:    3.81 [#/sec] (mean)
Time per request:       2621.398 [ms] (mean)
Time per request:       262.140 [ms] (mean, across all concurrent requests)
Transfer rate:          29.73 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       26   75  69.9     47     266
Processing:   182 2534 5957.5    573   23400
Waiting:      181 2532 5955.9    571   23377
Total:        213 2609 6020.6    611   23664

Percentage of the requests served within a certain time (ms)
  50%    611
  66%    729
  75%    881
  80%    980
  90%  17818
  95%  20142
  98%  23664
  99%  23664
 100%  23664 (longest request)

ImageStacks Full-Size Image

Timeout even when cached.

dn0a203930:~ lreilly$ ab -n 100 -c 10 https://stacks-test.stanford.edu/image/xq532gb5056/524_fob_TC_46.png
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking stacks-test.stanford.edu (be patient)...apr_poll: The timeout specified has expired (70007)

NAGIOS notifies listeners to the following errors:

NAGIOS

100 total requests; 25 concurrent requests

GOOGLE (FOR REFERENCE)

Server Software:        gws
Server Hostname:        www.google.com
Server Port:            80

Document Path:          /
Document Length:        9748 bytes

Concurrency Level:      25
Time taken for tests:   0.466 seconds
Complete requests:      100
Failed requests:        79
   (Connect: 0, Receive: 0, Length: 79, Exceptions: 0)
Write errors:           0
Total transferred:      1037375 bytes
HTML transferred:       979575 bytes
Requests per second:    214.55 [#/sec] (mean)
Time per request:       116.524 [ms] (mean)
Time per request:       4.661 [ms] (mean, across all concurrent requests)
Transfer rate:          2173.50 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        4   12   6.8     12      34
Processing:    31   76  97.1     39     370
Waiting:       29   41  14.9     35      95
Total:         37   88  97.5     51     382

Percentage of the requests served within a certain time (ms)
  50%     51
  66%     58
  75%     62
  80%     68
  90%    312
  95%    354
  98%    382
  99%    382
 100%    382 (longest request)

DMSTECH

Server Software:        Apache/2.2.3
Server Hostname:        dms-dev.stanford.edu
Server Port:            80

Document Path:          /
Document Length:        129777 bytes

Concurrency Level:      25
Time taken for tests:   28.004 seconds
Complete requests:      100
Failed requests:        0
Write errors:           0
Total transferred:      13039769 bytes
HTML transferred:       12977700 bytes
Requests per second:    3.57 [#/sec] (mean)
Time per request:       7000.997 [ms] (mean)
Time per request:       280.040 [ms] (mean, across all concurrent requests)
Transfer rate:          454.73 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        2    4   2.0      3      12
Processing:   652 6305 3701.7   5989   16478
Waiting:      598 6030 3535.5   5889   16441
Total:        657 6309 3701.2   5992   16479

Percentage of the requests served within a certain time (ms)
  50%   5992
  66%   7050
  75%   7897
  80%   8914
  90%  11817
  95%  14579
  98%  15544
  99%  16479
 100%  16479 (longest request)

IMAGESTACKS (THUMBNAIL)

     Server Software:        Apache/2.2.3
     Server Hostname:        stacks-test.stanford.edu
     Server Port:            443
     SSL/TLS Protocol:       TLSv1/SSLv3,DHE-RSA-AES256-SHA,2048,256

     Document Path:          /image/xq532gb5056/524_fob_TC_46_thumb
     Document Length:        7652 bytes

     Concurrency Level:      25
     Time taken for tests:   101.411 seconds
     Complete requests:      100
     Failed requests:        0
     Write errors:           0
     Total transferred:      798328 bytes
     HTML transferred:       765200 bytes
     Requests per second:    0.99 [#/sec] (mean)
     Time per request:       25352.867 [ms] (mean)
     Time per request:       1014.115 [ms] (mean, across all concurrent requests)
     Transfer rate:          7.69 [Kbytes/sec] received

     Connection Times (ms)
                   min  mean[+/-sd] median   max
     Connect:       27  695 1339.9     80    4589
     Processing:   128 23433 17333.3  20228   61985
     Waiting:      127 21152 17906.9  17035   53115
     Total:        173 24128 18385.6  20263   66558

     Percentage of the requests served within a certain time (ms)
       50%  20263
       66%  27775
       75%  35221
       80%  41618
       90%  56109
       95%  56530
       98%  56705
       99%  66558
      100%  66558 (longest request) 

IMAGESTACKS (FULL-SIZE IMAGE)

Timeout even when cached.

dn0a203930:~ lreilly$ ab -n 100 -c 25 https://stacks-test.stanford.edu/image/xq532gb5056/524_fob_TC_46.png
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking stacks-test.stanford.edu (be patient)...apr_poll: The timeout specified has expired (70007)

NAGIOS notifies listeners to the following errors:

NAGIOS

800 requests; 50 concurrent requests

TILED IMAGES

Server Software:        Apache/2.2.3
Server Hostname:        stacks-test.stanford.edu
Server Port:            443
SSL/TLS Protocol:       TLSv1/SSLv3,DHE-RSA-AES256-SHA,2048,256

Document Path:          /image/auth/nm203xw8381/002I_002_V_TC_46.jpg?zoom=6.25000&region=256,0,256,256&rotate=0
Document Length:        820 bytes

Concurrency Level:      100
Time taken for tests:   9.732 seconds
Complete requests:      800
Failed requests:        0
Write errors:           0
Non-2xx responses:      801
Total transferred:      1391337 bytes
HTML transferred:       656820 bytes
Requests per second:    82.20 [#/sec] (mean)
Time per request:       1216.478 [ms] (mean)
Time per request:       12.165 [ms] (mean, across all concurrent requests)
Transfer rate:          139.62 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:       78  933 283.9   1018    1694
Processing:     3  230 253.0    124    1010
Waiting:        3  154 156.2     79     661
Total:        277 1163 278.8   1150    1942

Percentage of the requests served within a certain time (ms)
  50%   1150
  66%   1249
  75%   1275
  80%   1289
  90%   1402
  95%   1652
  98%   1902
  99%   1918
 100%   1942 (longest request)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment