Skip to content

Instantly share code, notes, and snippets.

@daiaji

daiaji/gist:0a507140e0a8a441e6b9de6bc2e66469

Created August 13, 2021 14:36
Show Gist options
  • Save daiaji/0a507140e0a8a441e6b9de6bc2e66469 to your computer and use it in GitHub Desktop.
Save daiaji/0a507140e0a8a441e6b9de6bc2e66469 to your computer and use it in GitHub Desktop.
Download ZIP
PM1733.log
Raw
gistfile1.txt
random-read: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=posixaio, iodepth=32
...
fio-3.27
Starting 512 processes
random-read: (groupid=0, jobs=1): err= 0: pid=11662: Fri Aug 13 21:22:57 2021
read: IOPS=2781, BW=10.9MiB/s (11.4MB/s)(652MiB/60007msec)
slat (nsec): min=110, max=273644, avg=321.85, stdev=1094.51
clat (usec): min=6, max=201241, avg=11265.88, stdev=5531.94
lat (usec): min=279, max=201242, avg=11266.20, stdev=5531.96
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 65], 99.95th=[ 87],
| 99.99th=[ 201]
bw ( KiB/s): min= 3832, max=15872, per=0.20%, avg=11324.07, stdev=2122.99, samples=117
iops : min= 958, max= 3968, avg=2830.94, stdev=530.75, samples=117
lat (usec) : 10=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=48.35%, 20=48.04%, 50=3.22%
lat (msec) : 100=0.19%, 250=0.04%
cpu : usr=0.46%, sys=0.36%, ctx=64854, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.2%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=166910,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11663: Fri Aug 13 21:22:57 2021
read: IOPS=2925, BW=11.4MiB/s (12.0MB/s)(686MiB/60004msec)
slat (nsec): min=100, max=2777.3k, avg=339.10, stdev=7506.34
clat (usec): min=77, max=79959, avg=10699.80, stdev=3671.57
lat (usec): min=253, max=79959, avg=10700.14, stdev=3671.65
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14222], 95.00th=[16581],
| 99.00th=[23987], 99.50th=[28443], 99.90th=[44303], 99.95th=[49021],
| 99.99th=[77071]
bw ( KiB/s): min= 5365, max=15384, per=0.21%, avg=11921.57, stdev=1823.15, samples=117
iops : min= 1341, max= 3846, avg=2980.34, stdev=455.79, samples=117
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=53.01%, 20=44.55%, 50=2.32%
lat (msec) : 100=0.04%
cpu : usr=0.54%, sys=0.28%, ctx=64646, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.4%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=175558,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11664: Fri Aug 13 21:22:57 2021
read: IOPS=2672, BW=10.4MiB/s (10.9MB/s)(626MiB/60006msec)
slat (nsec): min=109, max=131436, avg=310.43, stdev=589.01
clat (usec): min=283, max=175271, avg=11708.36, stdev=5078.27
lat (usec): min=289, max=175271, avg=11708.67, stdev=5078.30
clat percentiles (usec):
| 1.00th=[ 6783], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12125], 80.00th=[13698], 90.00th=[16581], 95.00th=[20055],
| 99.00th=[30016], 99.50th=[35390], 99.90th=[62129], 99.95th=[85459],
| 99.99th=[96994]
bw ( KiB/s): min= 5109, max=15648, per=0.19%, avg=10882.23, stdev=1989.15, samples=117
iops : min= 1277, max= 3912, avg=2720.49, stdev=497.31, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=43.78%, 20=51.15%, 50=4.83%
lat (msec) : 100=0.20%, 250=0.01%
cpu : usr=0.50%, sys=0.29%, ctx=65732, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.7%, 16=50.4%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160348,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11665: Fri Aug 13 21:22:57 2021
read: IOPS=2860, BW=11.2MiB/s (11.7MB/s)(671MiB/60009msec)
slat (nsec): min=110, max=13246k, avg=602.05, stdev=47331.57
clat (usec): min=69, max=128027, avg=11150.76, stdev=5117.01
lat (usec): min=634, max=128028, avg=11151.36, stdev=5116.97
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 65], 99.95th=[ 70],
| 99.99th=[ 129]
bw ( KiB/s): min= 4608, max=29620, per=0.20%, avg=11444.74, stdev=2659.66, samples=119
iops : min= 1152, max= 7405, avg=2861.12, stdev=664.92, samples=119
lat (usec) : 100=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=2.06%, 10=48.10%, 20=45.63%, 50=4.02%
lat (msec) : 100=0.17%, 250=0.02%
cpu : usr=0.57%, sys=0.25%, ctx=65155, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.1%, 16=56.0%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=171648,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11666: Fri Aug 13 21:22:57 2021
read: IOPS=2961, BW=11.6MiB/s (12.1MB/s)(694MiB/60010msec)
slat (nsec): min=110, max=915271, avg=323.62, stdev=2424.52
clat (usec): min=1477, max=247010, avg=10772.38, stdev=4926.27
lat (usec): min=1477, max=247011, avg=10772.70, stdev=4926.28
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 29], 99.90th=[ 44], 99.95th=[ 57],
| 99.99th=[ 245]
bw ( KiB/s): min= 6928, max=23744, per=0.21%, avg=11867.64, stdev=2126.08, samples=119
iops : min= 1732, max= 5936, avg=2966.84, stdev=531.52, samples=119
lat (msec) : 2=0.01%, 4=2.58%, 10=49.01%, 20=45.56%, 50=2.78%
lat (msec) : 100=0.05%, 250=0.02%
cpu : usr=0.53%, sys=0.31%, ctx=66168, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.1%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=177748,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11667: Fri Aug 13 21:22:57 2021
read: IOPS=2933, BW=11.5MiB/s (12.0MB/s)(688MiB/60010msec)
slat (nsec): min=110, max=1853.5k, avg=336.37, stdev=5879.78
clat (usec): min=251, max=151606, avg=10882.33, stdev=5552.52
lat (usec): min=371, max=151606, avg=10882.67, stdev=5552.50
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 40], 99.90th=[ 77], 99.95th=[ 99],
| 99.99th=[ 102]
bw ( KiB/s): min= 6144, max=30914, per=0.21%, avg=11749.71, stdev=3071.04, samples=119
iops : min= 1536, max= 7728, avg=2937.34, stdev=767.72, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=3.57%, 10=49.31%, 20=43.53%, 50=3.24%
lat (msec) : 100=0.32%, 250=0.02%
cpu : usr=0.52%, sys=0.32%, ctx=65309, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=176017,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11668: Fri Aug 13 21:22:57 2021
read: IOPS=2528, BW=9.88MiB/s (10.4MB/s)(593MiB/60010msec)
slat (nsec): min=119, max=999599, avg=326.89, stdev=3121.22
clat (msec): min=2, max=160, avg=12.42, stdev= 6.99
lat (msec): min=2, max=160, avg=12.42, stdev= 6.99
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 39], 99.50th=[ 47], 99.90th=[ 95], 99.95th=[ 113],
| 99.99th=[ 159]
bw ( KiB/s): min= 4896, max=14592, per=0.18%, avg=10300.88, stdev=1927.45, samples=117
iops : min= 1224, max= 3648, avg=2575.15, stdev=481.87, samples=117
lat (msec) : 4=0.08%, 10=39.02%, 20=54.12%, 50=6.32%, 100=0.37%
lat (msec) : 250=0.09%
cpu : usr=0.47%, sys=0.31%, ctx=67755, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.1%, 16=62.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=94.6%, 8=3.4%, 16=0.7%, 32=1.3%, 64=0.0%, >=64=0.0%
issued rwts: total=151744,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11669: Fri Aug 13 21:22:57 2021
read: IOPS=2786, BW=10.9MiB/s (11.4MB/s)(653MiB/60004msec)
slat (nsec): min=110, max=2117.6k, avg=346.20, stdev=5915.74
clat (usec): min=127, max=232572, avg=11247.28, stdev=5926.87
lat (usec): min=232, max=232573, avg=11247.62, stdev=5927.15
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 59], 99.95th=[ 146],
| 99.99th=[ 232]
bw ( KiB/s): min= 4040, max=15592, per=0.20%, avg=11341.75, stdev=2084.28, samples=117
iops : min= 1010, max= 3898, avg=2835.37, stdev=521.08, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 4=0.08%, 10=48.92%, 20=47.55%, 50=3.24%, 100=0.15%
lat (msec) : 250=0.06%
cpu : usr=0.53%, sys=0.27%, ctx=63496, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.1%, 16=51.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167203,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11670: Fri Aug 13 21:22:57 2021
read: IOPS=2899, BW=11.3MiB/s (11.9MB/s)(680MiB/60004msec)
slat (nsec): min=110, max=47715, avg=313.92, stdev=543.51
clat (usec): min=345, max=273157, avg=11014.94, stdev=5985.11
lat (usec): min=345, max=273158, avg=11015.26, stdev=5985.13
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 68], 99.95th=[ 82],
| 99.99th=[ 275]
bw ( KiB/s): min= 5240, max=32702, per=0.20%, avg=11605.24, stdev=2895.09, samples=119
iops : min= 1310, max= 8175, avg=2901.23, stdev=723.74, samples=119
lat (usec) : 500=0.01%
lat (msec) : 4=2.35%, 10=49.88%, 20=44.37%, 50=3.12%, 100=0.26%
lat (msec) : 250=0.01%, 500=0.02%
cpu : usr=0.50%, sys=0.30%, ctx=62775, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=0.7%, 16=0.9%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=173972,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11671: Fri Aug 13 21:22:57 2021
read: IOPS=2913, BW=11.4MiB/s (11.9MB/s)(683MiB/60008msec)
slat (nsec): min=110, max=270250, avg=331.66, stdev=882.25
clat (usec): min=841, max=147569, avg=10949.71, stdev=4624.85
lat (usec): min=841, max=147570, avg=10950.04, stdev=4624.86
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 34], 99.90th=[ 52], 99.95th=[ 66],
| 99.99th=[ 148]
bw ( KiB/s): min= 6512, max=23760, per=0.20%, avg=11665.24, stdev=2084.00, samples=119
iops : min= 1628, max= 5940, avg=2916.24, stdev=521.00, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=1.86%, 10=48.31%, 20=46.39%, 50=3.32%
lat (msec) : 100=0.09%, 250=0.02%
cpu : usr=0.55%, sys=0.29%, ctx=63402, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.5%, 16=59.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.8%, 16=0.3%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=174835,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11672: Fri Aug 13 21:22:57 2021
read: IOPS=2996, BW=11.7MiB/s (12.3MB/s)(703MiB/60026msec)
slat (nsec): min=110, max=4579.7k, avg=367.73, stdev=11955.85
clat (usec): min=48, max=118640, avg=10645.15, stdev=5532.66
lat (usec): min=321, max=118640, avg=10645.51, stdev=5532.61
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 75], 99.95th=[ 95],
| 99.99th=[ 117]
bw ( KiB/s): min= 3840, max=33213, per=0.21%, avg=12008.66, stdev=3266.26, samples=119
iops : min= 960, max= 8303, avg=3002.11, stdev=816.53, samples=119
lat (usec) : 50=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=3.83%, 10=52.69%, 20=40.05%, 50=3.08%
lat (msec) : 100=0.31%, 250=0.03%
cpu : usr=0.51%, sys=0.32%, ctx=67396, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=179872,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11673: Fri Aug 13 21:22:57 2021
read: IOPS=2718, BW=10.6MiB/s (11.1MB/s)(637MiB/60005msec)
slat (nsec): min=110, max=999753, avg=358.17, stdev=4050.25
clat (usec): min=1278, max=129695, avg=11521.59, stdev=5813.30
lat (usec): min=1278, max=129696, avg=11521.95, stdev=5813.31
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 75], 99.95th=[ 91],
| 99.99th=[ 115]
bw ( KiB/s): min= 6416, max=14808, per=0.19%, avg=11068.83, stdev=2161.91, samples=117
iops : min= 1604, max= 3702, avg=2767.13, stdev=540.50, samples=117
lat (msec) : 2=0.01%, 4=0.09%, 10=50.57%, 20=44.20%, 50=4.78%
lat (msec) : 100=0.33%, 250=0.02%
cpu : usr=0.50%, sys=0.29%, ctx=64885, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.2%, 16=59.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.2%, 16=0.8%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=163137,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11674: Fri Aug 13 21:22:57 2021
read: IOPS=2728, BW=10.7MiB/s (11.2MB/s)(640MiB/60012msec)
slat (nsec): min=119, max=1914.6k, avg=345.33, stdev=4959.58
clat (usec): min=21, max=109056, avg=11528.44, stdev=5037.55
lat (usec): min=165, max=109056, avg=11528.78, stdev=5037.53
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 63], 99.95th=[ 68],
| 99.99th=[ 103]
bw ( KiB/s): min= 1277, max=16095, per=0.19%, avg=11012.52, stdev=2145.35, samples=118
iops : min= 319, max= 4023, avg=2753.06, stdev=536.33, samples=118
lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=46.10%, 20=49.24%, 50=4.37%
lat (msec) : 100=0.20%, 250=0.01%
cpu : usr=0.51%, sys=0.32%, ctx=62816, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.7%, 16=59.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.7%, 16=0.8%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=163768,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11675: Fri Aug 13 21:22:57 2021
read: IOPS=2771, BW=10.8MiB/s (11.4MB/s)(650MiB/60012msec)
slat (nsec): min=110, max=6842.5k, avg=380.71, stdev=17164.05
clat (usec): min=182, max=100867, avg=11360.57, stdev=4893.64
lat (usec): min=724, max=100867, avg=11360.95, stdev=4893.58
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 40], 99.90th=[ 59], 99.95th=[ 70],
| 99.99th=[ 101]
bw ( KiB/s): min= 4846, max=14896, per=0.20%, avg=11195.39, stdev=1964.09, samples=118
iops : min= 1211, max= 3724, avg=2798.79, stdev=491.03, samples=118
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=47.48%, 20=48.75%, 50=3.44%
lat (msec) : 100=0.23%, 250=0.02%
cpu : usr=0.47%, sys=0.35%, ctx=64289, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.3%, 16=57.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.4%, 16=1.2%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=166350,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11676: Fri Aug 13 21:22:57 2021
read: IOPS=2989, BW=11.7MiB/s (12.2MB/s)(701MiB/60008msec)
slat (nsec): min=100, max=1126.4k, avg=321.40, stdev=2760.44
clat (msec): min=2, max=130, avg=10.48, stdev= 4.05
lat (msec): min=2, max=130, avg=10.48, stdev= 4.05
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 25], 99.50th=[ 29], 99.90th=[ 46], 99.95th=[ 74],
| 99.99th=[ 128]
bw ( KiB/s): min= 7120, max=15616, per=0.21%, avg=12167.79, stdev=1884.31, samples=117
iops : min= 1780, max= 3904, avg=3041.89, stdev=471.08, samples=117
lat (msec) : 4=0.20%, 10=58.20%, 20=39.11%, 50=2.42%, 100=0.06%
lat (msec) : 250=0.02%
cpu : usr=0.50%, sys=0.32%, ctx=63587, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.4%, 16=51.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=179411,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11677: Fri Aug 13 21:22:57 2021
read: IOPS=2752, BW=10.8MiB/s (11.3MB/s)(645MiB/60014msec)
slat (nsec): min=119, max=247674, avg=333.41, stdev=953.14
clat (usec): min=1552, max=146308, avg=11398.13, stdev=5855.49
lat (usec): min=1552, max=146308, avg=11398.47, stdev=5855.54
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 48], 99.90th=[ 71], 99.95th=[ 79],
| 99.99th=[ 144]
bw ( KiB/s): min= 6456, max=15616, per=0.20%, avg=11219.09, stdev=2207.18, samples=117
iops : min= 1614, max= 3904, avg=2804.71, stdev=551.78, samples=117
lat (msec) : 2=0.01%, 4=0.05%, 10=49.73%, 20=45.79%, 50=3.99%
lat (msec) : 100=0.42%, 250=0.02%
cpu : usr=0.48%, sys=0.37%, ctx=67611, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.3%, 16=61.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.4%, 16=1.7%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=165212,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11678: Fri Aug 13 21:22:57 2021
read: IOPS=2712, BW=10.6MiB/s (11.1MB/s)(636MiB/60015msec)
slat (nsec): min=100, max=2806.5k, avg=401.56, stdev=9972.45
clat (usec): min=356, max=146647, avg=11590.92, stdev=5981.40
lat (usec): min=413, max=146647, avg=11591.32, stdev=5981.56
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 72], 99.95th=[ 107],
| 99.99th=[ 146]
bw ( KiB/s): min= 4392, max=14848, per=0.19%, avg=11038.58, stdev=2226.77, samples=117
iops : min= 1098, max= 3712, avg=2759.56, stdev=556.69, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=47.78%, 20=47.16%, 50=4.50%
lat (msec) : 100=0.32%, 250=0.06%
cpu : usr=0.52%, sys=0.28%, ctx=62954, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.3%, 16=63.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.2%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162792,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11679: Fri Aug 13 21:22:57 2021
read: IOPS=2629, BW=10.3MiB/s (10.8MB/s)(616MiB/60007msec)
slat (nsec): min=110, max=1033.7k, avg=348.98, stdev=2997.18
clat (usec): min=1686, max=150049, avg=12025.52, stdev=6356.50
lat (usec): min=1687, max=150049, avg=12025.87, stdev=6356.52
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 47], 99.90th=[ 80], 99.95th=[ 91],
| 99.99th=[ 146]
bw ( KiB/s): min= 3800, max=15121, per=0.19%, avg=10616.81, stdev=2101.85, samples=118
iops : min= 950, max= 3780, avg=2654.13, stdev=525.48, samples=118
lat (msec) : 2=0.01%, 4=0.03%, 10=44.45%, 20=49.45%, 50=5.66%
lat (msec) : 100=0.40%, 250=0.02%
cpu : usr=0.53%, sys=0.21%, ctx=62185, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=157769,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11680: Fri Aug 13 21:22:57 2021
read: IOPS=2619, BW=10.2MiB/s (10.7MB/s)(614MiB/60017msec)
slat (nsec): min=110, max=913432, avg=358.76, stdev=3361.94
clat (usec): min=752, max=99449, avg=11950.66, stdev=5798.92
lat (usec): min=753, max=99449, avg=11951.02, stdev=5798.93
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7635], 10.00th=[ 8029], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12125], 80.00th=[13566], 90.00th=[17171], 95.00th=[21627],
| 99.00th=[36439], 99.50th=[45351], 99.90th=[65274], 99.95th=[73925],
| 99.99th=[94897]
bw ( KiB/s): min= 5120, max=15616, per=0.19%, avg=10652.75, stdev=2153.37, samples=117
iops : min= 1280, max= 3904, avg=2663.12, stdev=538.34, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=43.94%, 20=49.31%, 50=6.26%
lat (msec) : 100=0.35%
cpu : usr=0.46%, sys=0.33%, ctx=66345, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.2%, 16=63.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=157220,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11681: Fri Aug 13 21:22:57 2021
read: IOPS=2633, BW=10.3MiB/s (10.8MB/s)(617MiB/60014msec)
slat (nsec): min=119, max=1083.7k, avg=359.36, stdev=4373.92
clat (usec): min=142, max=255546, avg=11944.87, stdev=6662.60
lat (usec): min=191, max=255546, avg=11945.23, stdev=6662.66
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 44], 99.90th=[ 72], 99.95th=[ 99],
| 99.99th=[ 251]
bw ( KiB/s): min= 6584, max=15096, per=0.19%, avg=10725.59, stdev=1927.46, samples=117
iops : min= 1646, max= 3774, avg=2681.33, stdev=481.86, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=42.74%, 20=52.33%, 50=4.49%
lat (msec) : 100=0.35%, 250=0.02%, 500=0.02%
cpu : usr=0.45%, sys=0.36%, ctx=65189, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.2%, 16=0.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=158017,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11682: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(634MiB/60047msec)
slat (nsec): min=110, max=1572.8k, avg=347.77, stdev=4234.11
clat (usec): min=123, max=183298, avg=11617.74, stdev=6077.55
lat (usec): min=147, max=183298, avg=11618.09, stdev=6077.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 70], 99.95th=[ 102],
| 99.99th=[ 180]
bw ( KiB/s): min= 6608, max=14616, per=0.19%, avg=11016.78, stdev=2134.81, samples=117
iops : min= 1652, max= 3654, avg=2754.14, stdev=533.76, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=48.11%, 20=46.23%, 50=5.22%
lat (msec) : 100=0.23%, 250=0.06%
cpu : usr=0.47%, sys=0.35%, ctx=65037, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162179,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11683: Fri Aug 13 21:22:57 2021
read: IOPS=2931, BW=11.5MiB/s (12.0MB/s)(687MiB/60024msec)
slat (nsec): min=110, max=137247, avg=324.05, stdev=818.26
clat (usec): min=1822, max=290904, avg=10819.09, stdev=5882.17
lat (usec): min=1823, max=290904, avg=10819.41, stdev=5882.20
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 36], 99.90th=[ 64], 99.95th=[ 79],
| 99.99th=[ 288]
bw ( KiB/s): min= 4352, max=15104, per=0.21%, avg=11847.25, stdev=1981.07, samples=118
iops : min= 1088, max= 3776, avg=2961.75, stdev=495.28, samples=118
lat (msec) : 2=0.01%, 4=0.20%, 10=56.46%, 20=40.52%, 50=2.65%
lat (msec) : 100=0.15%, 250=0.02%, 500=0.02%
cpu : usr=0.51%, sys=0.33%, ctx=63331, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.3%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=0.6%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=175983,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11684: Fri Aug 13 21:22:57 2021
read: IOPS=2868, BW=11.2MiB/s (11.7MB/s)(673MiB/60040msec)
slat (nsec): min=110, max=5738.9k, avg=434.78, stdev=20578.79
clat (usec): min=138, max=117355, avg=10908.60, stdev=4373.37
lat (usec): min=180, max=117358, avg=10909.03, stdev=4373.48
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12518], 90.00th=[14615], 95.00th=[17433],
| 99.00th=[26870], 99.50th=[33424], 99.90th=[54264], 99.95th=[72877],
| 99.99th=[85459]
bw ( KiB/s): min= 1532, max=15616, per=0.21%, avg=11709.92, stdev=1961.12, samples=117
iops : min= 383, max= 3904, avg=2927.44, stdev=490.28, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=52.84%, 20=44.06%, 50=2.75%
lat (msec) : 100=0.19%, 250=0.01%
cpu : usr=0.54%, sys=0.26%, ctx=66821, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.6%, 16=56.5%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=172197,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11685: Fri Aug 13 21:22:57 2021
read: IOPS=2837, BW=11.1MiB/s (11.6MB/s)(665MiB/60011msec)
slat (nsec): min=110, max=217156, avg=323.90, stdev=800.36
clat (usec): min=372, max=112363, avg=11236.16, stdev=5553.63
lat (usec): min=372, max=112364, avg=11236.48, stdev=5553.64
clat percentiles (usec):
| 1.00th=[ 2966], 5.00th=[ 7111], 10.00th=[ 7767], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11600], 80.00th=[13042], 90.00th=[15664], 95.00th=[19530],
| 99.00th=[33817], 99.50th=[41681], 99.90th=[70779], 99.95th=[83362],
| 99.99th=[98042]
bw ( KiB/s): min= 4608, max=27935, per=0.20%, avg=11372.59, stdev=2523.27, samples=119
iops : min= 1152, max= 6983, avg=2843.12, stdev=630.77, samples=119
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=2.22%, 10=49.52%, 20=43.62%, 50=4.35%
lat (msec) : 100=0.28%, 250=0.01%
cpu : usr=0.52%, sys=0.29%, ctx=66261, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=170273,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11686: Fri Aug 13 21:22:57 2021
read: IOPS=2578, BW=10.1MiB/s (10.6MB/s)(605MiB/60052msec)
slat (nsec): min=100, max=257736, avg=332.58, stdev=957.97
clat (usec): min=1660, max=244298, avg=12171.40, stdev=7226.89
lat (usec): min=1660, max=244299, avg=12171.73, stdev=7226.91
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 49], 99.90th=[ 100], 99.95th=[ 105],
| 99.99th=[ 218]
bw ( KiB/s): min= 4128, max=14592, per=0.18%, avg=10525.50, stdev=2105.16, samples=117
iops : min= 1032, max= 3648, avg=2631.31, stdev=526.30, samples=117
lat (msec) : 2=0.01%, 4=0.05%, 10=40.34%, 20=53.83%, 50=5.29%
lat (msec) : 100=0.41%, 250=0.08%
cpu : usr=0.49%, sys=0.30%, ctx=63623, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.5%, 16=59.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.5%, 16=1.4%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=154816,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11687: Fri Aug 13 21:22:57 2021
read: IOPS=2762, BW=10.8MiB/s (11.3MB/s)(648MiB/60010msec)
slat (nsec): min=110, max=742401, avg=339.28, stdev=2270.61
clat (usec): min=194, max=177941, avg=11333.92, stdev=5838.95
lat (usec): min=215, max=177941, avg=11334.26, stdev=5839.01
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 71], 99.95th=[ 83],
| 99.99th=[ 176]
bw ( KiB/s): min= 2299, max=15368, per=0.20%, avg=11236.62, stdev=2172.87, samples=117
iops : min= 574, max= 3842, avg=2809.09, stdev=543.22, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=50.57%, 20=45.25%, 50=3.73%
lat (msec) : 100=0.35%, 250=0.02%
cpu : usr=0.52%, sys=0.28%, ctx=66508, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165790,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11688: Fri Aug 13 21:22:57 2021
read: IOPS=2821, BW=11.0MiB/s (11.6MB/s)(662MiB/60041msec)
slat (nsec): min=110, max=262594, avg=329.06, stdev=1081.13
clat (usec): min=667, max=212531, avg=11233.68, stdev=5630.57
lat (usec): min=667, max=212532, avg=11234.01, stdev=5630.59
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 68], 99.95th=[ 85],
| 99.99th=[ 197]
bw ( KiB/s): min= 5480, max=22227, per=0.20%, avg=11417.61, stdev=2198.47, samples=118
iops : min= 1370, max= 5556, avg=2854.34, stdev=549.58, samples=118
lat (usec) : 750=0.01%
lat (msec) : 4=1.81%, 10=47.26%, 20=47.35%, 50=3.32%, 100=0.24%
lat (msec) : 250=0.02%
cpu : usr=0.54%, sys=0.20%, ctx=65279, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.5%, 16=53.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=169422,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11689: Fri Aug 13 21:22:57 2021
read: IOPS=2789, BW=10.9MiB/s (11.4MB/s)(654MiB/60011msec)
slat (nsec): min=109, max=166683, avg=315.98, stdev=798.94
clat (usec): min=672, max=178707, avg=11359.89, stdev=6110.81
lat (usec): min=673, max=178708, avg=11360.21, stdev=6110.84
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 78], 99.95th=[ 89],
| 99.99th=[ 180]
bw ( KiB/s): min= 5376, max=27321, per=0.20%, avg=11292.31, stdev=2607.05, samples=118
iops : min= 1344, max= 6830, avg=2822.99, stdev=651.75, samples=118
lat (usec) : 750=0.01%
lat (msec) : 4=1.89%, 10=48.07%, 20=45.19%, 50=4.50%, 100=0.31%
lat (msec) : 250=0.04%
cpu : usr=0.52%, sys=0.22%, ctx=67318, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.4%, 16=55.6%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.5%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167420,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11690: Fri Aug 13 21:22:57 2021
read: IOPS=2728, BW=10.7MiB/s (11.2MB/s)(640MiB/60010msec)
slat (nsec): min=100, max=167754, avg=341.05, stdev=876.80
clat (usec): min=441, max=154379, avg=11536.35, stdev=5495.23
lat (usec): min=463, max=154380, avg=11536.69, stdev=5495.25
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 66], 99.95th=[ 75],
| 99.99th=[ 144]
bw ( KiB/s): min= 1788, max=16351, per=0.19%, avg=11021.39, stdev=2193.08, samples=118
iops : min= 447, max= 4087, avg=2755.27, stdev=548.24, samples=118
lat (usec) : 500=0.01%
lat (msec) : 4=0.10%, 10=46.73%, 20=48.58%, 50=4.35%, 100=0.21%
lat (msec) : 250=0.03%
cpu : usr=0.45%, sys=0.39%, ctx=64045, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.6%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.1%, 16=2.2%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=163716,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11691: Fri Aug 13 21:22:57 2021
read: IOPS=2809, BW=11.0MiB/s (11.5MB/s)(659MiB/60006msec)
slat (nsec): min=119, max=4853.3k, avg=461.58, stdev=19028.51
clat (usec): min=230, max=146160, avg=11210.14, stdev=4613.98
lat (usec): min=243, max=146160, avg=11210.61, stdev=4614.14
clat percentiles (usec):
| 1.00th=[ 5997], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10159], 60.00th=[10814],
| 70.00th=[11731], 80.00th=[13042], 90.00th=[15139], 95.00th=[18220],
| 99.00th=[28705], 99.50th=[34341], 99.90th=[54264], 99.95th=[78119],
| 99.99th=[81265]
bw ( KiB/s): min= 4598, max=15368, per=0.20%, avg=11341.85, stdev=1852.84, samples=118
iops : min= 1149, max= 3842, avg=2835.38, stdev=463.25, samples=118
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.32%, 10=47.34%, 20=48.86%, 50=3.32%
lat (msec) : 100=0.15%, 250=0.01%
cpu : usr=0.54%, sys=0.28%, ctx=66708, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168589,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11692: Fri Aug 13 21:22:57 2021
read: IOPS=2758, BW=10.8MiB/s (11.3MB/s)(647MiB/60007msec)
slat (nsec): min=100, max=2038.1k, avg=337.83, stdev=5071.25
clat (usec): min=351, max=145507, avg=11398.20, stdev=6098.07
lat (usec): min=579, max=145507, avg=11398.54, stdev=6098.23
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 89], 99.95th=[ 107],
| 99.99th=[ 144]
bw ( KiB/s): min= 3608, max=14600, per=0.20%, avg=11234.93, stdev=2112.77, samples=117
iops : min= 902, max= 3650, avg=2808.68, stdev=528.18, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=49.80%, 20=45.82%, 50=3.90%
lat (msec) : 100=0.32%, 250=0.08%
cpu : usr=0.47%, sys=0.37%, ctx=61879, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.2%, 16=61.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.4%, 16=1.7%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165555,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11693: Fri Aug 13 21:22:57 2021
read: IOPS=3009, BW=11.8MiB/s (12.3MB/s)(705MiB/60014msec)
slat (nsec): min=110, max=1043.8k, avg=312.00, stdev=2537.10
clat (usec): min=927, max=89567, avg=10607.09, stdev=4875.74
lat (usec): min=927, max=89567, avg=10607.41, stdev=4875.76
clat percentiles (usec):
| 1.00th=[ 2802], 5.00th=[ 6456], 10.00th=[ 7504], 20.00th=[ 8225],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14353], 95.00th=[17695],
| 99.00th=[29492], 99.50th=[36439], 99.90th=[57410], 99.95th=[73925],
| 99.99th=[87557]
bw ( KiB/s): min= 4095, max=31632, per=0.21%, avg=12050.38, stdev=3107.97, samples=119
iops : min= 1023, max= 7908, avg=3012.53, stdev=776.99, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=3.65%, 10=53.03%, 20=39.95%, 50=3.12%
lat (msec) : 100=0.23%
cpu : usr=0.50%, sys=0.33%, ctx=64374, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=180587,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11694: Fri Aug 13 21:22:57 2021
read: IOPS=2570, BW=10.0MiB/s (10.5MB/s)(603MiB/60045msec)
slat (nsec): min=110, max=2598.6k, avg=374.78, stdev=8241.34
clat (usec): min=153, max=188023, avg=12216.12, stdev=6307.75
lat (usec): min=186, max=188027, avg=12216.50, stdev=6307.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 46], 99.90th=[ 72], 99.95th=[ 97],
| 99.99th=[ 159]
bw ( KiB/s): min= 5620, max=14080, per=0.18%, avg=10482.61, stdev=2008.80, samples=117
iops : min= 1405, max= 3520, avg=2620.59, stdev=502.22, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=39.48%, 20=54.22%, 50=5.80%
lat (msec) : 100=0.33%, 250=0.04%
cpu : usr=0.48%, sys=0.32%, ctx=63588, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.0%, 16=60.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=154335,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11695: Fri Aug 13 21:22:57 2021
read: IOPS=2683, BW=10.5MiB/s (11.0MB/s)(629MiB/60031msec)
slat (nsec): min=119, max=1519.0k, avg=354.61, stdev=4629.40
clat (usec): min=124, max=120535, avg=11678.91, stdev=5879.84
lat (usec): min=195, max=120535, avg=11679.26, stdev=5879.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 85], 99.95th=[ 100],
| 99.99th=[ 108]
bw ( KiB/s): min= 4608, max=15104, per=0.19%, avg=10961.74, stdev=2174.08, samples=117
iops : min= 1152, max= 3776, avg=2740.37, stdev=543.50, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=46.68%, 20=47.97%, 50=4.82%
lat (msec) : 100=0.34%, 250=0.04%
cpu : usr=0.50%, sys=0.29%, ctx=64940, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.1%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=161118,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11696: Fri Aug 13 21:22:57 2021
read: IOPS=2634, BW=10.3MiB/s (10.8MB/s)(618MiB/60010msec)
slat (nsec): min=110, max=2576.3k, avg=347.62, stdev=7063.20
clat (usec): min=683, max=105142, avg=11900.68, stdev=5566.79
lat (usec): min=690, max=105143, avg=11901.03, stdev=5566.86
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 42], 99.90th=[ 62], 99.95th=[ 88],
| 99.99th=[ 101]
bw ( KiB/s): min= 4880, max=14624, per=0.19%, avg=10725.51, stdev=1926.79, samples=117
iops : min= 1220, max= 3656, avg=2681.32, stdev=481.71, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=41.77%, 20=52.72%, 50=5.23%
lat (msec) : 100=0.21%, 250=0.01%
cpu : usr=0.47%, sys=0.33%, ctx=63799, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.8%, 16=52.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158084,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11697: Fri Aug 13 21:22:57 2021
read: IOPS=2886, BW=11.3MiB/s (11.8MB/s)(677MiB/60010msec)
slat (nsec): min=110, max=282323, avg=321.56, stdev=898.81
clat (usec): min=121, max=207010, avg=11042.26, stdev=5967.70
lat (usec): min=176, max=207010, avg=11042.59, stdev=5967.71
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 65], 99.95th=[ 92],
| 99.99th=[ 207]
bw ( KiB/s): min= 4662, max=33972, per=0.20%, avg=11560.53, stdev=2896.12, samples=119
iops : min= 1165, max= 8493, avg=2890.07, stdev=724.04, samples=119
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=2.67%, 10=47.20%, 20=46.70%, 50=3.23%
lat (msec) : 100=0.15%, 250=0.04%
cpu : usr=0.51%, sys=0.32%, ctx=68202, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.1%, 16=53.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=173203,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11698: Fri Aug 13 21:22:57 2021
read: IOPS=2964, BW=11.6MiB/s (12.1MB/s)(695MiB/60007msec)
slat (nsec): min=110, max=839918, avg=323.28, stdev=2193.01
clat (usec): min=448, max=132226, avg=10745.33, stdev=4262.25
lat (usec): min=449, max=132227, avg=10745.66, stdev=4262.26
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 33], 99.90th=[ 45], 99.95th=[ 53],
| 99.99th=[ 130]
bw ( KiB/s): min= 6656, max=17580, per=0.21%, avg=11861.67, stdev=1875.36, samples=119
iops : min= 1664, max= 4395, avg=2965.34, stdev=468.86, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=1.22%, 10=53.51%, 20=42.45%, 50=2.74%
lat (msec) : 100=0.06%, 250=0.02%
cpu : usr=0.58%, sys=0.18%, ctx=61067, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=177893,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11699: Fri Aug 13 21:22:57 2021
read: IOPS=2640, BW=10.3MiB/s (10.8MB/s)(619MiB/60012msec)
slat (nsec): min=110, max=6433.3k, avg=406.28, stdev=16781.33
clat (usec): min=427, max=122908, avg=11868.55, stdev=6421.24
lat (usec): min=440, max=122908, avg=11868.95, stdev=6421.33
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 49], 99.90th=[ 94], 99.95th=[ 101],
| 99.99th=[ 120]
bw ( KiB/s): min= 2666, max=15072, per=0.19%, avg=10750.80, stdev=2054.74, samples=117
iops : min= 666, max= 3768, avg=2687.64, stdev=513.69, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=45.04%, 20=49.56%, 50=4.87%
lat (msec) : 100=0.39%, 250=0.07%
cpu : usr=0.49%, sys=0.30%, ctx=65425, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.5%, 16=61.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.3%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=158458,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11700: Fri Aug 13 21:22:57 2021
read: IOPS=2916, BW=11.4MiB/s (11.9MB/s)(684MiB/60007msec)
slat (nsec): min=110, max=626232, avg=331.28, stdev=1672.96
clat (usec): min=145, max=82842, avg=10918.41, stdev=4659.42
lat (usec): min=169, max=82842, avg=10918.74, stdev=4659.45
clat percentiles (usec):
| 1.00th=[ 4228], 5.00th=[ 7242], 10.00th=[ 7767], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14746], 95.00th=[17957],
| 99.00th=[30802], 99.50th=[36963], 99.90th=[55313], 99.95th=[66323],
| 99.99th=[81265]
bw ( KiB/s): min= 6432, max=16416, per=0.21%, avg=11669.36, stdev=2069.46, samples=119
iops : min= 1608, max= 4104, avg=2917.29, stdev=517.34, samples=119
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.80%, 10=52.93%, 20=42.66%, 50=3.46%
lat (msec) : 100=0.15%
cpu : usr=0.55%, sys=0.29%, ctx=68119, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.8%, 16=54.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=174984,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11701: Fri Aug 13 21:22:57 2021
read: IOPS=2575, BW=10.1MiB/s (10.5MB/s)(604MiB/60046msec)
slat (nsec): min=110, max=989779, avg=355.82, stdev=3078.34
clat (usec): min=384, max=119598, avg=12193.87, stdev=6522.35
lat (usec): min=409, max=119599, avg=12194.22, stdev=6522.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 50], 99.90th=[ 85], 99.95th=[ 94],
| 99.99th=[ 121]
bw ( KiB/s): min= 6408, max=15368, per=0.18%, avg=10523.48, stdev=2005.23, samples=117
iops : min= 1602, max= 3842, avg=2630.79, stdev=501.33, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=41.60%, 20=51.68%, 50=6.09%
lat (msec) : 100=0.46%, 250=0.04%
cpu : usr=0.47%, sys=0.31%, ctx=63770, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.3%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=154626,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11702: Fri Aug 13 21:22:57 2021
read: IOPS=2854, BW=11.2MiB/s (11.7MB/s)(670MiB/60039msec)
slat (nsec): min=120, max=404206, avg=345.78, stdev=1867.43
clat (usec): min=26, max=104399, avg=10965.79, stdev=4524.03
lat (usec): min=296, max=104400, avg=10966.14, stdev=4524.03
clat percentiles (usec):
| 1.00th=[ 6456], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12518], 90.00th=[14746], 95.00th=[17957],
| 99.00th=[27919], 99.50th=[35390], 99.90th=[55313], 99.95th=[78119],
| 99.99th=[93848]
bw ( KiB/s): min= 5672, max=15400, per=0.20%, avg=11629.23, stdev=2042.68, samples=117
iops : min= 1418, max= 3850, avg=2907.26, stdev=510.69, samples=117
lat (usec) : 50=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=52.39%, 20=44.04%, 50=3.28%
lat (msec) : 100=0.17%, 250=0.01%
cpu : usr=0.52%, sys=0.27%, ctx=60919, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=8.9%, 16=66.2%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.3%, 16=1.0%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=171396,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11703: Fri Aug 13 21:22:57 2021
read: IOPS=2824, BW=11.0MiB/s (11.6MB/s)(662MiB/60007msec)
slat (nsec): min=119, max=267281, avg=337.05, stdev=906.16
clat (usec): min=152, max=271805, avg=11146.35, stdev=5877.06
lat (usec): min=250, max=271840, avg=11146.69, stdev=5877.16
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 39], 99.90th=[ 61], 99.95th=[ 77],
| 99.99th=[ 271]
bw ( KiB/s): min= 5632, max=15104, per=0.20%, avg=11486.69, stdev=1991.33, samples=117
iops : min= 1408, max= 3776, avg=2871.61, stdev=497.84, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=51.01%, 20=45.51%, 50=3.14%
lat (msec) : 100=0.21%, 500=0.02%
cpu : usr=0.49%, sys=0.33%, ctx=65298, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.5%, 16=61.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.3%, 16=1.1%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=169470,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11704: Fri Aug 13 21:22:57 2021
read: IOPS=2681, BW=10.5MiB/s (11.0MB/s)(629MiB/60010msec)
slat (nsec): min=110, max=222159, avg=344.43, stdev=1205.15
clat (usec): min=265, max=405552, avg=11668.30, stdev=8305.95
lat (usec): min=266, max=405553, avg=11668.64, stdev=8306.01
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 46], 99.90th=[ 106], 99.95th=[ 140],
| 99.99th=[ 397]
bw ( KiB/s): min= 2810, max=15608, per=0.19%, avg=10997.71, stdev=2129.30, samples=116
iops : min= 702, max= 3902, avg=2749.37, stdev=532.34, samples=116
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=46.18%, 20=49.47%, 50=3.81%
lat (msec) : 100=0.35%, 250=0.09%, 500=0.02%
cpu : usr=0.46%, sys=0.32%, ctx=61643, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=62.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.5%, 16=1.8%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=160908,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11705: Fri Aug 13 21:22:57 2021
read: IOPS=2670, BW=10.4MiB/s (10.9MB/s)(626MiB/60008msec)
slat (nsec): min=110, max=1797.9k, avg=339.32, stdev=4643.99
clat (usec): min=693, max=206434, avg=11803.38, stdev=6635.79
lat (usec): min=715, max=206436, avg=11803.72, stdev=6635.90
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 51], 99.90th=[ 91], 99.95th=[ 104],
| 99.99th=[ 190]
bw ( KiB/s): min= 3321, max=14568, per=0.19%, avg=10770.55, stdev=2102.96, samples=118
iops : min= 830, max= 3642, avg=2692.57, stdev=525.75, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=43.90%, 20=51.06%, 50=4.43%
lat (msec) : 100=0.46%, 250=0.06%
cpu : usr=0.47%, sys=0.35%, ctx=66495, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160227,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11706: Fri Aug 13 21:22:57 2021
read: IOPS=2787, BW=10.9MiB/s (11.4MB/s)(654MiB/60054msec)
slat (nsec): min=110, max=460545, avg=335.14, stdev=1591.69
clat (msec): min=2, max=151, avg=11.28, stdev= 4.70
lat (msec): min=2, max=151, avg=11.28, stdev= 4.70
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 36], 99.90th=[ 57], 99.95th=[ 64],
| 99.99th=[ 148]
bw ( KiB/s): min= 6752, max=15872, per=0.20%, avg=11359.91, stdev=1851.15, samples=117
iops : min= 1688, max= 3968, avg=2839.94, stdev=462.79, samples=117
lat (msec) : 4=0.10%, 10=47.60%, 20=48.71%, 50=3.44%, 100=0.12%
lat (msec) : 250=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=62020, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.2%, 16=0.7%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=167430,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11707: Fri Aug 13 21:22:57 2021
read: IOPS=2756, BW=10.8MiB/s (11.3MB/s)(646MiB/60011msec)
slat (nsec): min=110, max=105359, avg=321.30, stdev=666.66
clat (usec): min=140, max=125561, avg=11366.25, stdev=5567.47
lat (usec): min=200, max=125562, avg=11366.57, stdev=5567.49
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 44], 99.90th=[ 70], 99.95th=[ 105],
| 99.99th=[ 126]
bw ( KiB/s): min= 6472, max=15104, per=0.20%, avg=11218.20, stdev=1909.15, samples=117
iops : min= 1618, max= 3776, avg=2804.47, stdev=477.34, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.10%, 10=49.49%, 20=46.16%, 50=3.94%, 100=0.25%
lat (msec) : 250=0.05%
cpu : usr=0.51%, sys=0.29%, ctx=66453, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.4%, 16=55.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=165437,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11708: Fri Aug 13 21:22:57 2021
read: IOPS=2695, BW=10.5MiB/s (11.0MB/s)(632MiB/60008msec)
slat (nsec): min=110, max=438523, avg=331.21, stdev=1752.67
clat (usec): min=437, max=118591, avg=11612.96, stdev=5373.56
lat (usec): min=459, max=118591, avg=11613.29, stdev=5373.58
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 79], 99.95th=[ 92],
| 99.99th=[ 120]
bw ( KiB/s): min= 3792, max=14848, per=0.19%, avg=10980.97, stdev=1960.67, samples=117
iops : min= 948, max= 3712, avg=2745.18, stdev=490.18, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 4=0.08%, 10=44.32%, 20=51.38%, 50=3.94%, 100=0.26%
lat (msec) : 250=0.02%
cpu : usr=0.48%, sys=0.32%, ctx=67111, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.6%, 16=55.4%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=161734,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11709: Fri Aug 13 21:22:57 2021
read: IOPS=2597, BW=10.1MiB/s (10.6MB/s)(609MiB/60041msec)
slat (nsec): min=119, max=1600.9k, avg=341.29, stdev=4095.09
clat (usec): min=1636, max=140287, avg=12122.17, stdev=5674.48
lat (usec): min=1636, max=140287, avg=12122.51, stdev=5674.59
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 70], 99.95th=[ 87],
| 99.99th=[ 106]
bw ( KiB/s): min= 2299, max=14600, per=0.18%, avg=10508.17, stdev=2053.46, samples=118
iops : min= 574, max= 3650, avg=2626.97, stdev=513.40, samples=118
lat (msec) : 2=0.01%, 4=0.07%, 10=40.56%, 20=53.74%, 50=5.34%
lat (msec) : 100=0.27%, 250=0.02%
cpu : usr=0.50%, sys=0.27%, ctx=61929, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.2%, 16=55.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=155968,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11710: Fri Aug 13 21:22:57 2021
read: IOPS=2992, BW=11.7MiB/s (12.3MB/s)(701MiB/60006msec)
slat (nsec): min=110, max=156163, avg=317.11, stdev=735.80
clat (usec): min=643, max=284785, avg=10663.24, stdev=5744.42
lat (usec): min=668, max=284941, avg=10663.56, stdev=5744.48
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 35], 99.90th=[ 57], 99.95th=[ 82],
| 99.99th=[ 284]
bw ( KiB/s): min= 5888, max=33205, per=0.21%, avg=11996.49, stdev=2682.53, samples=119
iops : min= 1472, max= 8301, avg=2999.05, stdev=670.59, samples=119
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=2.83%, 10=52.31%, 20=41.93%, 50=2.77%
lat (msec) : 100=0.14%, 500=0.02%
cpu : usr=0.51%, sys=0.33%, ctx=65863, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.4%, 16=53.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=179568,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11711: Fri Aug 13 21:22:57 2021
read: IOPS=2880, BW=11.3MiB/s (11.8MB/s)(676MiB/60048msec)
slat (nsec): min=119, max=507730, avg=321.94, stdev=1402.75
clat (usec): min=739, max=131214, avg=10864.09, stdev=4961.87
lat (usec): min=739, max=131214, avg=10864.42, stdev=4961.89
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 67], 99.95th=[ 105],
| 99.99th=[ 129]
bw ( KiB/s): min= 4087, max=15360, per=0.21%, avg=11767.44, stdev=1904.39, samples=117
iops : min= 1021, max= 3840, avg=2941.79, stdev=476.15, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=54.21%, 20=42.74%, 50=2.73%
lat (msec) : 100=0.16%, 250=0.06%
cpu : usr=0.53%, sys=0.28%, ctx=66114, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=172976,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11712: Fri Aug 13 21:22:57 2021
read: IOPS=2713, BW=10.6MiB/s (11.1MB/s)(636MiB/60005msec)
slat (nsec): min=100, max=2045.6k, avg=339.79, stdev=5356.45
clat (usec): min=1033, max=135230, avg=11561.14, stdev=5520.76
lat (usec): min=1033, max=135230, avg=11561.48, stdev=5520.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 43], 99.90th=[ 70], 99.95th=[ 99],
| 99.99th=[ 112]
bw ( KiB/s): min= 6610, max=14872, per=0.19%, avg=11050.53, stdev=1944.87, samples=117
iops : min= 1652, max= 3718, avg=2762.49, stdev=486.27, samples=117
lat (msec) : 2=0.01%, 4=0.13%, 10=46.25%, 20=49.32%, 50=3.95%
lat (msec) : 100=0.31%, 250=0.04%
cpu : usr=0.46%, sys=0.35%, ctx=62987, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.4%, 8=1.9%, 16=1.3%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162797,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11713: Fri Aug 13 21:22:57 2021
read: IOPS=2785, BW=10.9MiB/s (11.4MB/s)(653MiB/60008msec)
slat (nsec): min=110, max=2954.0k, avg=356.78, stdev=7264.73
clat (usec): min=1458, max=235798, avg=11280.00, stdev=5528.09
lat (usec): min=1458, max=235798, avg=11280.36, stdev=5528.34
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 26], 99.50th=[ 31], 99.90th=[ 74], 99.95th=[ 125],
| 99.99th=[ 234]
bw ( KiB/s): min= 5604, max=15104, per=0.20%, avg=11333.35, stdev=1776.00, samples=117
iops : min= 1401, max= 3776, avg=2833.30, stdev=444.00, samples=117
lat (msec) : 2=0.01%, 4=0.05%, 10=47.56%, 20=49.33%, 50=2.88%
lat (msec) : 100=0.11%, 250=0.06%
cpu : usr=0.54%, sys=0.28%, ctx=63107, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=9.1%, 16=65.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.8%, 8=0.3%, 16=2.8%, 32=1.1%, 64=0.0%, >=64=0.0%
issued rwts: total=167181,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11714: Fri Aug 13 21:22:57 2021
read: IOPS=2713, BW=10.6MiB/s (11.1MB/s)(636MiB/60010msec)
slat (nsec): min=119, max=1155.9k, avg=366.72, stdev=5191.01
clat (usec): min=44, max=192660, avg=11550.21, stdev=6311.03
lat (usec): min=263, max=192660, avg=11550.58, stdev=6311.04
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 44], 99.90th=[ 93], 99.95th=[ 133],
| 99.99th=[ 144]
bw ( KiB/s): min= 4096, max=15049, per=0.19%, avg=11054.32, stdev=2140.99, samples=117
iops : min= 1024, max= 3762, avg=2763.45, stdev=535.23, samples=117
lat (usec) : 50=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=47.20%, 20=48.72%, 50=3.63%
lat (msec) : 100=0.33%, 250=0.08%
cpu : usr=0.46%, sys=0.33%, ctx=64948, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.6%, 16=59.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.9%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162865,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11715: Fri Aug 13 21:22:57 2021
read: IOPS=2789, BW=10.9MiB/s (11.4MB/s)(654MiB/60051msec)
slat (nsec): min=110, max=1936.5k, avg=365.06, stdev=6698.88
clat (usec): min=337, max=247615, avg=11263.19, stdev=6028.51
lat (usec): min=360, max=247615, avg=11263.56, stdev=6028.80
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 35], 99.90th=[ 63], 99.95th=[ 113],
| 99.99th=[ 241]
bw ( KiB/s): min= 4656, max=15088, per=0.20%, avg=11366.86, stdev=1969.15, samples=117
iops : min= 1164, max= 3772, avg=2841.57, stdev=492.31, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=49.44%, 20=47.06%, 50=3.15%
lat (msec) : 100=0.20%, 250=0.05%
cpu : usr=0.50%, sys=0.30%, ctx=62542, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.9%, 16=51.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167525,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11716: Fri Aug 13 21:22:57 2021
read: IOPS=2652, BW=10.4MiB/s (10.9MB/s)(622MiB/60029msec)
slat (nsec): min=119, max=1018.8k, avg=346.95, stdev=4334.58
clat (usec): min=626, max=147550, avg=11814.76, stdev=5794.55
lat (usec): min=626, max=147550, avg=11815.10, stdev=5794.58
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 78], 99.95th=[ 90],
| 99.99th=[ 144]
bw ( KiB/s): min= 5376, max=14848, per=0.19%, avg=10814.54, stdev=1908.38, samples=117
iops : min= 1344, max= 3712, avg=2703.51, stdev=477.12, samples=117
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 4=0.05%, 10=42.35%, 20=53.02%, 50=4.21%, 100=0.32%
lat (msec) : 250=0.04%
cpu : usr=0.50%, sys=0.30%, ctx=64367, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.4%, 16=55.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=159250,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11717: Fri Aug 13 21:22:57 2021
read: IOPS=2824, BW=11.0MiB/s (11.6MB/s)(662MiB/60007msec)
slat (nsec): min=110, max=7834.5k, avg=470.88, stdev=23948.56
clat (usec): min=29, max=149344, avg=11096.38, stdev=4707.17
lat (usec): min=461, max=149344, avg=11096.85, stdev=4707.34
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 33], 99.90th=[ 61], 99.95th=[ 90],
| 99.99th=[ 146]
bw ( KiB/s): min= 7384, max=15360, per=0.20%, avg=11511.09, stdev=1806.22, samples=117
iops : min= 1846, max= 3840, avg=2877.65, stdev=451.54, samples=117
lat (usec) : 50=0.01%, 100=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=50.12%, 20=46.50%, 50=3.17%
lat (msec) : 100=0.10%, 250=0.02%
cpu : usr=0.51%, sys=0.29%, ctx=63595, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.1%, 16=56.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.5%, 16=1.1%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=169509,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11718: Fri Aug 13 21:22:57 2021
read: IOPS=2781, BW=10.9MiB/s (11.4MB/s)(652MiB/60004msec)
slat (nsec): min=119, max=2775.5k, avg=347.89, stdev=6822.85
clat (usec): min=1715, max=148605, avg=11310.50, stdev=5479.76
lat (usec): min=1716, max=148605, avg=11310.85, stdev=5479.78
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 78], 99.95th=[ 111],
| 99.99th=[ 148]
bw ( KiB/s): min= 255, max=14848, per=0.20%, avg=11248.33, stdev=2118.66, samples=118
iops : min= 63, max= 3712, avg=2812.02, stdev=529.68, samples=118
lat (msec) : 2=0.01%, 4=0.08%, 10=48.20%, 20=48.35%, 50=3.13%
lat (msec) : 100=0.14%, 250=0.09%
cpu : usr=0.51%, sys=0.31%, ctx=60500, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.8%, 16=60.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.2%, 16=1.8%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=166920,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11719: Fri Aug 13 21:22:57 2021
read: IOPS=2633, BW=10.3MiB/s (10.8MB/s)(617MiB/60014msec)
slat (nsec): min=110, max=15392k, avg=700.97, stdev=49400.82
clat (usec): min=313, max=118452, avg=11880.12, stdev=5813.00
lat (usec): min=353, max=118453, avg=11880.82, stdev=5813.25
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 78], 99.95th=[ 88],
| 99.99th=[ 110]
bw ( KiB/s): min= 6392, max=14592, per=0.19%, avg=10753.41, stdev=1754.97, samples=117
iops : min= 1598, max= 3648, avg=2688.29, stdev=438.74, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=42.68%, 20=52.16%, 50=4.75%
lat (msec) : 100=0.32%, 250=0.04%
cpu : usr=0.43%, sys=0.37%, ctx=63837, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.9%, 16=57.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.6%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=158049,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11720: Fri Aug 13 21:22:57 2021
read: IOPS=2703, BW=10.6MiB/s (11.1MB/s)(634MiB/60022msec)
slat (nsec): min=110, max=312630, avg=327.46, stdev=1313.49
clat (usec): min=388, max=126169, avg=11567.75, stdev=5819.83
lat (usec): min=700, max=126169, avg=11568.08, stdev=5819.85
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 83], 99.95th=[ 102],
| 99.99th=[ 122]
bw ( KiB/s): min= 4598, max=15000, per=0.19%, avg=11014.73, stdev=2073.09, samples=117
iops : min= 1149, max= 3750, avg=2753.56, stdev=518.30, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.17%, 10=47.96%, 20=47.23%, 50=4.33%, 100=0.25%
lat (msec) : 250=0.06%
cpu : usr=0.40%, sys=0.40%, ctx=64564, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162244,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11721: Fri Aug 13 21:22:57 2021
read: IOPS=2767, BW=10.8MiB/s (11.3MB/s)(649MiB/60013msec)
slat (nsec): min=110, max=421947, avg=323.01, stdev=1444.25
clat (usec): min=112, max=159841, avg=11437.69, stdev=5701.10
lat (usec): min=290, max=159842, avg=11438.02, stdev=5701.11
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 77], 99.95th=[ 87],
| 99.99th=[ 155]
bw ( KiB/s): min= 6144, max=18650, per=0.20%, avg=11185.81, stdev=2075.47, samples=118
iops : min= 1536, max= 4662, avg=2796.32, stdev=518.87, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 4=1.08%, 10=45.84%, 20=48.50%, 50=4.32%, 100=0.22%
lat (msec) : 250=0.04%
cpu : usr=0.51%, sys=0.24%, ctx=65006, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.8%, 16=52.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166113,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11722: Fri Aug 13 21:22:57 2021
read: IOPS=2760, BW=10.8MiB/s (11.3MB/s)(647MiB/60004msec)
slat (nsec): min=110, max=270772, avg=332.14, stdev=1004.13
clat (msec): min=2, max=181, avg=11.37, stdev= 5.34
lat (msec): min=2, max=181, avg=11.37, stdev= 5.34
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10814],
| 70.00th=[11731], 80.00th=[13042], 90.00th=[15401], 95.00th=[18482],
| 99.00th=[31851], 99.50th=[41681], 99.90th=[65799], 99.95th=[83362],
| 99.99th=[96994]
bw ( KiB/s): min= 6448, max=15073, per=0.20%, avg=11234.66, stdev=1968.40, samples=117
iops : min= 1612, max= 3768, avg=2808.61, stdev=492.09, samples=117
lat (msec) : 4=0.10%, 10=48.05%, 20=47.97%, 50=3.58%, 100=0.29%
lat (msec) : 250=0.01%
cpu : usr=0.51%, sys=0.31%, ctx=68525, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.7%, 16=54.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165638,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11723: Fri Aug 13 21:22:57 2021
read: IOPS=2613, BW=10.2MiB/s (10.7MB/s)(613MiB/60014msec)
slat (nsec): min=100, max=259972, avg=321.74, stdev=863.34
clat (usec): min=971, max=101601, avg=11988.51, stdev=5917.42
lat (usec): min=971, max=101602, avg=11988.83, stdev=5917.45
clat percentiles (usec):
| 1.00th=[ 6849], 5.00th=[ 7635], 10.00th=[ 8029], 20.00th=[ 8717],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[11207],
| 70.00th=[12387], 80.00th=[13829], 90.00th=[16909], 95.00th=[21627],
| 99.00th=[36439], 99.50th=[46924], 99.90th=[67634], 99.95th=[79168],
| 99.99th=[93848]
bw ( KiB/s): min= 3688, max=15360, per=0.19%, avg=10638.13, stdev=2218.04, samples=117
iops : min= 922, max= 3840, avg=2659.48, stdev=554.53, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=45.22%, 20=48.39%, 50=5.99%
lat (msec) : 100=0.37%, 250=0.01%
cpu : usr=0.43%, sys=0.34%, ctx=62351, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.5%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.7%, 8=1.8%, 16=0.5%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=156871,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11724: Fri Aug 13 21:22:57 2021
read: IOPS=2765, BW=10.8MiB/s (11.3MB/s)(649MiB/60048msec)
slat (nsec): min=109, max=10481k, avg=517.53, stdev=33503.20
clat (usec): min=56, max=105556, avg=11318.35, stdev=4959.19
lat (usec): min=541, max=105557, avg=11318.87, stdev=4959.10
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7504], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10683],
| 70.00th=[11731], 80.00th=[13042], 90.00th=[15795], 95.00th=[19268],
| 99.00th=[29492], 99.50th=[36963], 99.90th=[62129], 99.95th=[68682],
| 99.99th=[87557]
bw ( KiB/s): min= 6144, max=15328, per=0.20%, avg=11270.36, stdev=2075.13, samples=117
iops : min= 1536, max= 3832, avg=2817.54, stdev=518.79, samples=117
lat (usec) : 100=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=50.72%, 20=44.87%, 50=4.09%
lat (msec) : 100=0.24%, 250=0.01%
cpu : usr=0.49%, sys=0.32%, ctx=62918, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.9%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166072,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11725: Fri Aug 13 21:22:57 2021
read: IOPS=2726, BW=10.6MiB/s (11.2MB/s)(639MiB/60011msec)
slat (nsec): min=100, max=2802.5k, avg=383.39, stdev=11707.86
clat (usec): min=477, max=196731, avg=11547.66, stdev=5967.84
lat (usec): min=851, max=196732, avg=11548.04, stdev=5968.00
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 49], 99.90th=[ 80], 99.95th=[ 85],
| 99.99th=[ 111]
bw ( KiB/s): min= 4391, max=15568, per=0.19%, avg=10995.91, stdev=2084.36, samples=118
iops : min= 1097, max= 3892, avg=2748.90, stdev=521.14, samples=118
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=48.16%, 20=47.22%, 50=4.06%
lat (msec) : 100=0.45%, 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=65262, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163598,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11726: Fri Aug 13 21:22:57 2021
read: IOPS=2670, BW=10.4MiB/s (10.9MB/s)(626MiB/60003msec)
slat (nsec): min=100, max=1225.7k, avg=352.97, stdev=5030.70
clat (usec): min=163, max=144122, avg=11787.06, stdev=5653.68
lat (usec): min=287, max=144123, avg=11787.41, stdev=5653.68
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 72], 99.95th=[ 89],
| 99.99th=[ 144]
bw ( KiB/s): min= 2299, max=14080, per=0.19%, avg=10774.43, stdev=1921.80, samples=118
iops : min= 574, max= 3520, avg=2693.52, stdev=480.47, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=41.76%, 20=53.50%, 50=4.36%
lat (msec) : 100=0.28%, 250=0.04%
cpu : usr=0.51%, sys=0.31%, ctx=67241, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.7%, 16=51.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160224,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11727: Fri Aug 13 21:22:57 2021
read: IOPS=2646, BW=10.3MiB/s (10.8MB/s)(620MiB/60013msec)
slat (nsec): min=119, max=964617, avg=335.37, stdev=2502.72
clat (usec): min=395, max=91362, avg=11839.56, stdev=5563.70
lat (usec): min=403, max=91363, avg=11839.90, stdev=5563.71
clat percentiles (usec):
| 1.00th=[ 6849], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[12125], 80.00th=[13698], 90.00th=[16450], 95.00th=[20841],
| 99.00th=[34866], 99.50th=[43779], 99.90th=[67634], 99.95th=[70779],
| 99.99th=[91751]
bw ( KiB/s): min= 6424, max=15056, per=0.19%, avg=10795.02, stdev=2049.83, samples=117
iops : min= 1606, max= 3764, avg=2698.69, stdev=512.47, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=45.60%, 20=48.63%, 50=5.37%
lat (msec) : 100=0.32%
cpu : usr=0.49%, sys=0.28%, ctx=61501, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.5%, 16=56.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.9%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158847,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11728: Fri Aug 13 21:22:57 2021
read: IOPS=2726, BW=10.7MiB/s (11.2MB/s)(639MiB/60002msec)
slat (nsec): min=110, max=3829.6k, avg=341.31, stdev=9532.78
clat (usec): min=363, max=115900, avg=11518.78, stdev=5466.83
lat (usec): min=364, max=115901, avg=11519.12, stdev=5467.14
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 77], 99.95th=[ 91],
| 99.99th=[ 116]
bw ( KiB/s): min= 5888, max=14864, per=0.20%, avg=11120.69, stdev=2033.57, samples=117
iops : min= 1472, max= 3716, avg=2780.11, stdev=508.38, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=48.36%, 20=46.66%, 50=4.61%
lat (msec) : 100=0.21%, 250=0.04%
cpu : usr=0.49%, sys=0.31%, ctx=64292, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.7%, 16=54.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163614,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11729: Fri Aug 13 21:22:57 2021
read: IOPS=2740, BW=10.7MiB/s (11.2MB/s)(642MiB/60007msec)
slat (nsec): min=110, max=4001.0k, avg=359.69, stdev=10100.06
clat (usec): min=17, max=342675, avg=11428.78, stdev=5232.37
lat (usec): min=325, max=342675, avg=11429.14, stdev=5232.35
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 27], 99.50th=[ 34], 99.90th=[ 57], 99.95th=[ 90],
| 99.99th=[ 150]
bw ( KiB/s): min= 2048, max=14544, per=0.20%, avg=11161.67, stdev=1781.30, samples=117
iops : min= 512, max= 3636, avg=2790.36, stdev=445.32, samples=117
lat (usec) : 20=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=44.50%, 20=52.27%, 50=3.10%
lat (msec) : 100=0.08%, 250=0.03%, 500=0.01%
cpu : usr=0.48%, sys=0.32%, ctx=62914, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.7%, 16=55.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.3%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164446,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11730: Fri Aug 13 21:22:57 2021
read: IOPS=2775, BW=10.8MiB/s (11.4MB/s)(651MiB/60018msec)
slat (nsec): min=100, max=3218.8k, avg=334.03, stdev=7938.53
clat (usec): min=124, max=179363, avg=11456.61, stdev=6012.34
lat (usec): min=232, max=179363, avg=11456.94, stdev=6012.35
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 80], 99.95th=[ 113],
| 99.99th=[ 133]
bw ( KiB/s): min= 1280, max=23992, per=0.20%, avg=11106.56, stdev=2602.34, samples=119
iops : min= 320, max= 5998, avg=2776.58, stdev=650.60, samples=119
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=1.29%, 10=47.23%, 20=46.87%, 50=4.30%
lat (msec) : 100=0.24%, 250=0.08%
cpu : usr=0.45%, sys=0.36%, ctx=64781, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.5%, 16=54.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=166576,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11731: Fri Aug 13 21:22:57 2021
read: IOPS=2862, BW=11.2MiB/s (11.7MB/s)(671MiB/60009msec)
slat (nsec): min=110, max=3021.8k, avg=437.33, stdev=13482.57
clat (usec): min=19, max=182131, avg=11113.00, stdev=5507.09
lat (usec): min=256, max=182131, avg=11113.44, stdev=5507.04
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 63], 99.95th=[ 69],
| 99.99th=[ 182]
bw ( KiB/s): min= 480, max=14864, per=0.20%, avg=11446.75, stdev=2143.98, samples=119
iops : min= 120, max= 3716, avg=2861.62, stdev=536.00, samples=119
lat (usec) : 20=0.01%, 50=0.01%, 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=52.35%, 20=43.90%, 50=3.38%
lat (msec) : 100=0.19%, 250=0.04%
cpu : usr=0.51%, sys=0.32%, ctx=62411, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.4%, 16=61.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.7%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=171795,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11732: Fri Aug 13 21:22:57 2021
read: IOPS=3004, BW=11.7MiB/s (12.3MB/s)(705MiB/60037msec)
slat (nsec): min=110, max=259283, avg=312.66, stdev=925.60
clat (usec): min=1766, max=75183, avg=10614.10, stdev=4041.39
lat (usec): min=1766, max=75183, avg=10614.41, stdev=4041.40
clat percentiles (usec):
| 1.00th=[ 3195], 5.00th=[ 7177], 10.00th=[ 7701], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14353], 95.00th=[16909],
| 99.00th=[26084], 99.50th=[31327], 99.90th=[53740], 99.95th=[56886],
| 99.99th=[73925]
bw ( KiB/s): min= 7424, max=22216, per=0.21%, avg=12051.29, stdev=1914.19, samples=119
iops : min= 1856, max= 5554, avg=3012.76, stdev=478.53, samples=119
lat (msec) : 2=0.01%, 4=1.47%, 10=54.00%, 20=41.84%, 50=2.59%
lat (msec) : 100=0.11%
cpu : usr=0.56%, sys=0.28%, ctx=65215, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=180360,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11733: Fri Aug 13 21:22:57 2021
read: IOPS=2953, BW=11.5MiB/s (12.1MB/s)(692MiB/60021msec)
slat (nsec): min=100, max=110418, avg=313.73, stdev=616.38
clat (usec): min=127, max=100164, avg=10801.98, stdev=4714.85
lat (usec): min=173, max=100165, avg=10802.29, stdev=4714.88
clat percentiles (usec):
| 1.00th=[ 2900], 5.00th=[ 5538], 10.00th=[ 7570], 20.00th=[ 8291],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[15270], 95.00th=[18482],
| 99.00th=[27919], 99.50th=[35390], 99.90th=[55837], 99.95th=[60556],
| 99.99th=[68682]
bw ( KiB/s): min= 7168, max=32950, per=0.21%, avg=11871.70, stdev=3119.25, samples=119
iops : min= 1792, max= 8237, avg=2967.87, stdev=779.78, samples=119
lat (usec) : 250=0.01%
lat (msec) : 4=3.70%, 10=50.22%, 20=42.26%, 50=3.65%, 100=0.17%
lat (msec) : 250=0.01%
cpu : usr=0.53%, sys=0.30%, ctx=63262, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.6%, 16=57.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.7%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=177270,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11734: Fri Aug 13 21:22:57 2021
read: IOPS=2754, BW=10.8MiB/s (11.3MB/s)(646MiB/60007msec)
slat (nsec): min=110, max=442097, avg=318.18, stdev=1420.82
clat (usec): min=879, max=154826, avg=11432.19, stdev=5666.19
lat (usec): min=879, max=154826, avg=11432.51, stdev=5666.20
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 72], 99.95th=[ 92],
| 99.99th=[ 130]
bw ( KiB/s): min= 4368, max=19169, per=0.20%, avg=11113.19, stdev=2431.80, samples=118
iops : min= 1092, max= 4792, avg=2778.25, stdev=607.97, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 4=0.50%, 10=49.13%, 20=45.46%, 50=4.64%, 100=0.23%
lat (msec) : 250=0.03%
cpu : usr=0.45%, sys=0.34%, ctx=63742, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.3%, 16=53.7%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165281,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11735: Fri Aug 13 21:22:57 2021
read: IOPS=2745, BW=10.7MiB/s (11.2MB/s)(644MiB/60048msec)
slat (nsec): min=100, max=135785, avg=325.15, stdev=729.96
clat (usec): min=184, max=89035, avg=11420.90, stdev=4836.50
lat (usec): min=191, max=89036, avg=11421.23, stdev=4836.51
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10814],
| 70.00th=[11731], 80.00th=[13173], 90.00th=[15926], 95.00th=[19530],
| 99.00th=[32113], 99.50th=[38011], 99.90th=[52691], 99.95th=[54264],
| 99.99th=[64226]
bw ( KiB/s): min= 6088, max=14848, per=0.20%, avg=11208.46, stdev=2096.57, samples=117
iops : min= 1522, max= 3712, avg=2802.03, stdev=524.13, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.21%, 10=49.13%, 20=46.08%, 50=4.42%, 100=0.16%
cpu : usr=0.50%, sys=0.28%, ctx=63398, majf=0, minf=30
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.3%, 16=55.7%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164861,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11736: Fri Aug 13 21:22:57 2021
read: IOPS=2926, BW=11.4MiB/s (12.0MB/s)(686MiB/60016msec)
slat (nsec): min=109, max=196890, avg=311.33, stdev=722.38
clat (usec): min=1412, max=207993, avg=10841.28, stdev=4628.67
lat (usec): min=1412, max=207993, avg=10841.59, stdev=4628.69
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 26], 99.50th=[ 30], 99.90th=[ 48], 99.95th=[ 53],
| 99.99th=[ 205]
bw ( KiB/s): min= 6904, max=15576, per=0.21%, avg=11836.07, stdev=1709.44, samples=118
iops : min= 1726, max= 3894, avg=2958.94, stdev=427.35, samples=118
lat (msec) : 2=0.01%, 4=0.05%, 10=53.40%, 20=43.46%, 50=3.02%
lat (msec) : 100=0.05%, 250=0.02%
cpu : usr=0.50%, sys=0.32%, ctx=64105, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.7%, 16=59.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.8%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=175626,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11737: Fri Aug 13 21:22:57 2021
read: IOPS=2930, BW=11.4MiB/s (12.0MB/s)(687MiB/60005msec)
slat (nsec): min=110, max=4599.0k, avg=361.73, stdev=12745.16
clat (usec): min=94, max=81471, avg=10709.80, stdev=3732.82
lat (usec): min=133, max=83402, avg=10710.16, stdev=3733.30
clat percentiles (usec):
| 1.00th=[ 6456], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14615], 95.00th=[16712],
| 99.00th=[24511], 99.50th=[28443], 99.90th=[45351], 99.95th=[65799],
| 99.99th=[74974]
bw ( KiB/s): min= 7744, max=15360, per=0.21%, avg=11931.60, stdev=1658.20, samples=117
iops : min= 1936, max= 3840, avg=2982.85, stdev=414.57, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=54.06%, 20=43.70%, 50=2.08%
lat (msec) : 100=0.07%
cpu : usr=0.50%, sys=0.33%, ctx=65379, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.8%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=175826,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11738: Fri Aug 13 21:22:57 2021
read: IOPS=2810, BW=11.0MiB/s (11.5MB/s)(659MiB/60015msec)
slat (nsec): min=110, max=4178.6k, avg=425.85, stdev=16247.31
clat (usec): min=4, max=213355, avg=11157.52, stdev=5196.66
lat (usec): min=184, max=213355, avg=11157.95, stdev=5196.64
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 61], 99.95th=[ 80],
| 99.99th=[ 209]
bw ( KiB/s): min= 6144, max=15552, per=0.20%, avg=11464.16, stdev=1836.13, samples=117
iops : min= 1536, max= 3888, avg=2865.98, stdev=459.04, samples=117
lat (usec) : 10=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=49.55%, 20=47.19%, 50=3.03%
lat (msec) : 100=0.12%, 250=0.04%
cpu : usr=0.51%, sys=0.29%, ctx=65398, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.9%, 16=0.7%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=168653,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11739: Fri Aug 13 21:22:57 2021
read: IOPS=2854, BW=11.1MiB/s (11.7MB/s)(669MiB/60009msec)
slat (nsec): min=110, max=100080, avg=313.19, stdev=685.03
clat (usec): min=214, max=160469, avg=11086.08, stdev=5942.10
lat (usec): min=241, max=160469, avg=11086.39, stdev=5942.12
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 43], 99.90th=[ 84], 99.95th=[ 111],
| 99.99th=[ 157]
bw ( KiB/s): min= 5944, max=18139, per=0.20%, avg=11538.97, stdev=2243.77, samples=118
iops : min= 1486, max= 4534, avg=2884.65, stdev=560.96, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=1.17%, 10=51.72%, 20=42.96%, 50=3.88%
lat (msec) : 100=0.20%, 250=0.07%
cpu : usr=0.49%, sys=0.26%, ctx=66569, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.8%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=171279,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11740: Fri Aug 13 21:22:57 2021
read: IOPS=2838, BW=11.1MiB/s (11.6MB/s)(665MiB/60006msec)
slat (nsec): min=110, max=1077.4k, avg=327.57, stdev=2683.57
clat (usec): min=235, max=111606, avg=11051.18, stdev=4748.05
lat (usec): min=262, max=111607, avg=11051.50, stdev=4748.15
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[14877], 95.00th=[17957],
| 99.00th=[30016], 99.50th=[34866], 99.90th=[64226], 99.95th=[74974],
| 99.99th=[95945]
bw ( KiB/s): min= 3768, max=14592, per=0.20%, avg=11576.32, stdev=1991.48, samples=117
iops : min= 942, max= 3648, avg=2894.03, stdev=497.85, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=51.30%, 20=45.05%, 50=3.26%
lat (msec) : 100=0.19%, 250=0.01%
cpu : usr=0.55%, sys=0.26%, ctx=61902, majf=0, minf=31
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.7%, 16=62.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=0.5%, 16=1.9%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=170327,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11741: Fri Aug 13 21:22:57 2021
read: IOPS=2794, BW=10.9MiB/s (11.4MB/s)(655MiB/60012msec)
slat (nsec): min=110, max=2475.7k, avg=331.80, stdev=6074.54
clat (usec): min=764, max=165456, avg=11358.90, stdev=5733.43
lat (usec): min=771, max=165530, avg=11359.23, stdev=5733.45
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 74], 99.95th=[ 80],
| 99.99th=[ 165]
bw ( KiB/s): min= 5876, max=15384, per=0.20%, avg=11280.11, stdev=2101.81, samples=118
iops : min= 1469, max= 3846, avg=2819.94, stdev=525.45, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 4=0.06%, 10=49.73%, 20=45.77%, 50=4.15%, 100=0.27%
lat (msec) : 250=0.02%
cpu : usr=0.58%, sys=0.23%, ctx=65664, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.9%, 16=60.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.1%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=167708,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11742: Fri Aug 13 21:22:57 2021
read: IOPS=2765, BW=10.8MiB/s (11.3MB/s)(649MiB/60046msec)
slat (nsec): min=110, max=33905k, avg=538.36, stdev=83454.39
clat (usec): min=603, max=110320, avg=11344.93, stdev=5347.17
lat (usec): min=1582, max=110320, avg=11345.47, stdev=5349.76
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 68], 99.95th=[ 84],
| 99.99th=[ 109]
bw ( KiB/s): min= 6944, max=15632, per=0.20%, avg=11296.51, stdev=1989.82, samples=117
iops : min= 1736, max= 3908, avg=2824.08, stdev=497.47, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=50.13%, 20=45.43%, 50=4.08%
lat (msec) : 100=0.27%, 250=0.02%
cpu : usr=0.47%, sys=0.33%, ctx=65335, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.1%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166030,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11743: Fri Aug 13 21:22:57 2021
read: IOPS=2784, BW=10.9MiB/s (11.4MB/s)(653MiB/60041msec)
slat (nsec): min=110, max=131247, avg=320.28, stdev=717.19
clat (usec): min=436, max=210230, avg=11369.57, stdev=6520.50
lat (usec): min=558, max=210230, avg=11369.89, stdev=6520.52
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 84], 99.95th=[ 103],
| 99.99th=[ 194]
bw ( KiB/s): min= 5376, max=24526, per=0.20%, avg=11289.83, stdev=2497.87, samples=118
iops : min= 1344, max= 6131, avg=2822.41, stdev=624.45, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=1.91%, 10=46.81%, 20=46.48%, 50=4.42%
lat (msec) : 100=0.32%, 250=0.06%
cpu : usr=0.50%, sys=0.25%, ctx=65412, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.8%, 16=56.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.3%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=167187,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11744: Fri Aug 13 21:22:57 2021
read: IOPS=2859, BW=11.2MiB/s (11.7MB/s)(670MiB/60015msec)
slat (nsec): min=110, max=331096, avg=311.84, stdev=1023.48
clat (usec): min=650, max=101522, avg=11082.84, stdev=5055.49
lat (usec): min=666, max=101522, avg=11083.15, stdev=5055.51
clat percentiles (usec):
| 1.00th=[ 4883], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[15008], 95.00th=[18220],
| 99.00th=[30016], 99.50th=[40109], 99.90th=[64750], 99.95th=[81265],
| 99.99th=[94897]
bw ( KiB/s): min= 6144, max=18395, per=0.20%, avg=11558.10, stdev=2138.11, samples=118
iops : min= 1536, max= 4598, avg=2889.47, stdev=534.51, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.59%, 10=51.23%, 20=44.37%, 50=3.53%
lat (msec) : 100=0.27%, 250=0.01%
cpu : usr=0.55%, sys=0.26%, ctx=66198, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.3%, 16=51.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=171619,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11745: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60034msec)
slat (nsec): min=110, max=791395, avg=327.83, stdev=2075.90
clat (usec): min=810, max=163940, avg=11593.68, stdev=6150.59
lat (usec): min=811, max=163941, avg=11594.01, stdev=6150.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 44], 99.90th=[ 86], 99.95th=[ 102],
| 99.99th=[ 161]
bw ( KiB/s): min= 4112, max=15816, per=0.19%, avg=11009.56, stdev=2183.55, samples=117
iops : min= 1028, max= 3954, avg=2752.32, stdev=545.91, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=46.29%, 20=48.86%, 50=4.40%
lat (msec) : 100=0.26%, 250=0.06%
cpu : usr=0.50%, sys=0.28%, ctx=61554, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.5%, 16=56.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162149,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11746: Fri Aug 13 21:22:57 2021
read: IOPS=2711, BW=10.6MiB/s (11.1MB/s)(636MiB/60009msec)
slat (nsec): min=110, max=1871.4k, avg=328.03, stdev=4715.49
clat (usec): min=513, max=150143, avg=11538.47, stdev=5918.57
lat (usec): min=513, max=150143, avg=11538.80, stdev=5918.74
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[10028], 60.00th=[10814],
| 70.00th=[11863], 80.00th=[13173], 90.00th=[15795], 95.00th=[19792],
| 99.00th=[34341], 99.50th=[47449], 99.90th=[77071], 99.95th=[90702],
| 99.99th=[94897]
bw ( KiB/s): min= 766, max=15104, per=0.19%, avg=11030.34, stdev=2353.08, samples=117
iops : min= 191, max= 3776, avg=2757.53, stdev=588.31, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=49.24%, 20=45.89%, 50=4.32%
lat (msec) : 100=0.43%, 250=0.01%
cpu : usr=0.45%, sys=0.34%, ctx=63676, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.7%, 16=54.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162704,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11747: Fri Aug 13 21:22:57 2021
read: IOPS=2632, BW=10.3MiB/s (10.8MB/s)(617MiB/60015msec)
slat (nsec): min=100, max=4842.5k, avg=366.11, stdev=12550.75
clat (usec): min=232, max=130182, avg=12053.46, stdev=6829.76
lat (usec): min=255, max=130183, avg=12053.83, stdev=6829.73
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 41], 99.50th=[ 56], 99.90th=[ 90], 99.95th=[ 99],
| 99.99th=[ 128]
bw ( KiB/s): min= 5656, max=22994, per=0.19%, avg=10632.53, stdev=2332.67, samples=118
iops : min= 1414, max= 5748, avg=2658.08, stdev=583.14, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=1.47%, 10=39.23%, 20=53.48%, 50=5.19%
lat (msec) : 100=0.58%, 250=0.03%
cpu : usr=0.50%, sys=0.22%, ctx=65499, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.1%, 16=59.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.6%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=158004,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11748: Fri Aug 13 21:22:57 2021
read: IOPS=2727, BW=10.7MiB/s (11.2MB/s)(640MiB/60034msec)
slat (nsec): min=110, max=1677.4k, avg=337.43, stdev=4431.91
clat (usec): min=174, max=165699, avg=11521.63, stdev=5214.54
lat (usec): min=218, max=165699, avg=11521.97, stdev=5214.85
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 55], 99.95th=[ 88],
| 99.99th=[ 163]
bw ( KiB/s): min= 6560, max=15104, per=0.20%, avg=11139.71, stdev=1711.27, samples=117
iops : min= 1640, max= 3776, avg=2784.86, stdev=427.81, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.03%, 10=45.64%, 20=49.83%, 50=4.31%, 100=0.15%
lat (msec) : 250=0.03%
cpu : usr=0.51%, sys=0.32%, ctx=66993, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.2%, 16=61.8%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=1.0%, 16=0.9%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=163766,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11749: Fri Aug 13 21:22:57 2021
read: IOPS=2808, BW=11.0MiB/s (11.5MB/s)(659MiB/60035msec)
slat (nsec): min=110, max=1939.6k, avg=359.49, stdev=7436.96
clat (usec): min=198, max=147482, avg=11190.37, stdev=4857.38
lat (usec): min=273, max=147482, avg=11190.73, stdev=4857.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 58], 99.95th=[ 69],
| 99.99th=[ 146]
bw ( KiB/s): min= 5888, max=15480, per=0.20%, avg=11451.72, stdev=1897.91, samples=117
iops : min= 1472, max= 3870, avg=2862.87, stdev=474.48, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=49.06%, 20=47.08%, 50=3.54%
lat (msec) : 100=0.14%, 250=0.02%
cpu : usr=0.47%, sys=0.33%, ctx=63249, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.6%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=168584,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11750: Fri Aug 13 21:22:57 2021
read: IOPS=2925, BW=11.4MiB/s (12.0MB/s)(686MiB/60044msec)
slat (nsec): min=109, max=648413, avg=323.45, stdev=1920.45
clat (usec): min=868, max=159933, avg=10888.32, stdev=5377.17
lat (usec): min=868, max=159934, avg=10888.65, stdev=5377.18
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 39], 99.90th=[ 78], 99.95th=[ 86],
| 99.99th=[ 159]
bw ( KiB/s): min= 4526, max=31169, per=0.21%, avg=11737.18, stdev=2791.15, samples=119
iops : min= 1131, max= 7792, avg=2934.24, stdev=697.79, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=1.52%, 10=52.50%, 20=42.77%, 50=2.97%
lat (msec) : 100=0.20%, 250=0.03%
cpu : usr=0.50%, sys=0.32%, ctx=62776, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.7%, 16=59.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=175659,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11751: Fri Aug 13 21:22:57 2021
read: IOPS=2837, BW=11.1MiB/s (11.6MB/s)(665MiB/60024msec)
slat (nsec): min=110, max=1204.2k, avg=331.02, stdev=3029.93
clat (usec): min=28, max=91825, avg=11037.88, stdev=4530.39
lat (usec): min=237, max=91825, avg=11038.21, stdev=4530.45
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11469], 80.00th=[12780], 90.00th=[14746], 95.00th=[17433],
| 99.00th=[27657], 99.50th=[33162], 99.90th=[62653], 99.95th=[71828],
| 99.99th=[85459]
bw ( KiB/s): min= 6112, max=15104, per=0.20%, avg=11604.82, stdev=1956.91, samples=117
iops : min= 1528, max= 3776, avg=2901.15, stdev=489.23, samples=117
lat (usec) : 50=0.01%, 1000=0.01%
lat (msec) : 4=0.16%, 10=50.83%, 20=45.84%, 50=2.96%, 100=0.21%
cpu : usr=0.50%, sys=0.29%, ctx=64528, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.9%, 16=56.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.7%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=170344,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11752: Fri Aug 13 21:22:57 2021
read: IOPS=2899, BW=11.3MiB/s (11.9MB/s)(680MiB/60013msec)
slat (nsec): min=109, max=4147.1k, avg=368.89, stdev=11428.17
clat (usec): min=348, max=108738, avg=11006.68, stdev=5131.56
lat (usec): min=367, max=108739, avg=11007.05, stdev=5131.54
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 37], 99.90th=[ 70], 99.95th=[ 80],
| 99.99th=[ 109]
bw ( KiB/s): min= 5888, max=17699, per=0.20%, avg=11605.93, stdev=2296.09, samples=119
iops : min= 1472, max= 4424, avg=2901.41, stdev=574.00, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=1.19%, 10=52.06%, 20=43.16%, 50=3.29%
lat (msec) : 100=0.28%, 250=0.02%
cpu : usr=0.50%, sys=0.23%, ctx=64045, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.5%, 16=54.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=173994,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11753: Fri Aug 13 21:22:57 2021
read: IOPS=2777, BW=10.8MiB/s (11.4MB/s)(651MiB/60035msec)
slat (nsec): min=110, max=2278.3k, avg=346.00, stdev=6206.55
clat (usec): min=218, max=118867, avg=11294.25, stdev=5328.40
lat (usec): min=230, max=118868, avg=11294.60, stdev=5328.39
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 75], 99.95th=[ 97],
| 99.99th=[ 115]
bw ( KiB/s): min= 5376, max=15073, per=0.20%, avg=11311.38, stdev=1862.33, samples=117
iops : min= 1344, max= 3768, avg=2827.79, stdev=465.60, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=48.60%, 20=47.68%, 50=3.24%
lat (msec) : 100=0.26%, 250=0.04%
cpu : usr=0.48%, sys=0.33%, ctx=67563, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.5%, 16=53.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166752,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11754: Fri Aug 13 21:22:57 2021
read: IOPS=2927, BW=11.4MiB/s (12.0MB/s)(686MiB/60020msec)
slat (nsec): min=99, max=80002, avg=326.99, stdev=583.60
clat (usec): min=379, max=82090, avg=10859.81, stdev=4153.58
lat (usec): min=385, max=82090, avg=10860.14, stdev=4153.59
clat percentiles (usec):
| 1.00th=[ 6063], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290],
| 70.00th=[11207], 80.00th=[12518], 90.00th=[15139], 95.00th=[18220],
| 99.00th=[26608], 99.50th=[31589], 99.90th=[44303], 99.95th=[60031],
| 99.99th=[80217]
bw ( KiB/s): min= 5386, max=14608, per=0.21%, avg=11726.38, stdev=2040.98, samples=119
iops : min= 1346, max= 3652, avg=2931.53, stdev=510.30, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=55.01%, 20=41.53%, 50=3.27%
lat (msec) : 100=0.05%
cpu : usr=0.53%, sys=0.23%, ctx=61312, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.0%, 16=59.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.7%, 16=1.1%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=175721,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11755: Fri Aug 13 21:22:57 2021
read: IOPS=2863, BW=11.2MiB/s (11.7MB/s)(671MiB/60005msec)
slat (nsec): min=110, max=1850.7k, avg=330.12, stdev=4614.82
clat (usec): min=237, max=328761, avg=10976.91, stdev=5209.20
lat (usec): min=256, max=328762, avg=10977.24, stdev=5209.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 31], 99.90th=[ 64], 99.95th=[ 110],
| 99.99th=[ 134]
bw ( KiB/s): min= 3321, max=15616, per=0.20%, avg=11564.41, stdev=2200.63, samples=118
iops : min= 830, max= 3904, avg=2891.03, stdev=550.17, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=53.18%, 20=43.53%, 50=3.10%
lat (msec) : 100=0.06%, 250=0.05%, 500=0.01%
cpu : usr=0.51%, sys=0.31%, ctx=64626, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=171808,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11756: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60009msec)
slat (nsec): min=110, max=6266.5k, avg=352.03, stdev=15697.38
clat (usec): min=222, max=148695, avg=11599.42, stdev=6403.07
lat (usec): min=233, max=148695, avg=11599.77, stdev=6403.03
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 46], 99.90th=[ 90], 99.95th=[ 127],
| 99.99th=[ 144]
bw ( KiB/s): min= 4598, max=15328, per=0.19%, avg=10988.34, stdev=2290.76, samples=117
iops : min= 1149, max= 3832, avg=2747.02, stdev=572.75, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=49.56%, 20=45.01%, 50=4.98%
lat (msec) : 100=0.28%, 250=0.08%
cpu : usr=0.46%, sys=0.31%, ctx=64121, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=51.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162080,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11757: Fri Aug 13 21:22:57 2021
read: IOPS=2853, BW=11.1MiB/s (11.7MB/s)(669MiB/60013msec)
slat (nsec): min=110, max=365365, avg=323.48, stdev=1157.73
clat (usec): min=323, max=144424, avg=11062.25, stdev=5031.06
lat (usec): min=344, max=144425, avg=11062.57, stdev=5031.08
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 63], 99.95th=[ 74],
| 99.99th=[ 144]
bw ( KiB/s): min= 5104, max=15768, per=0.20%, avg=11516.89, stdev=1942.83, samples=118
iops : min= 1276, max= 3942, avg=2879.15, stdev=485.73, samples=118
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=51.31%, 20=44.85%, 50=3.52%
lat (msec) : 100=0.14%, 250=0.04%
cpu : usr=0.55%, sys=0.25%, ctx=64608, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.7%, 16=59.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=171240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11758: Fri Aug 13 21:22:57 2021
read: IOPS=2648, BW=10.3MiB/s (10.8MB/s)(621MiB/60010msec)
slat (nsec): min=110, max=847438, avg=337.65, stdev=2609.41
clat (usec): min=345, max=155172, avg=11846.28, stdev=5755.04
lat (usec): min=386, max=155172, avg=11846.61, stdev=5755.06
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 66], 99.95th=[ 99],
| 99.99th=[ 142]
bw ( KiB/s): min= 4272, max=15104, per=0.19%, avg=10767.53, stdev=2150.54, samples=117
iops : min= 1068, max= 3776, avg=2691.82, stdev=537.64, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=42.94%, 20=52.07%, 50=4.63%
lat (msec) : 100=0.22%, 250=0.04%
cpu : usr=0.53%, sys=0.24%, ctx=61102, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=158922,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11759: Fri Aug 13 21:22:57 2021
read: IOPS=2746, BW=10.7MiB/s (11.2MB/s)(644MiB/60042msec)
slat (nsec): min=110, max=231737, avg=307.85, stdev=861.40
clat (usec): min=1099, max=103832, avg=11470.33, stdev=5369.82
lat (usec): min=1100, max=103833, avg=11470.64, stdev=5369.83
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 41], 99.90th=[ 69], 99.95th=[ 83],
| 99.99th=[ 105]
bw ( KiB/s): min= 2762, max=16128, per=0.19%, avg=11093.48, stdev=2349.36, samples=118
iops : min= 690, max= 4032, avg=2773.31, stdev=587.35, samples=118
lat (msec) : 2=0.01%, 4=0.06%, 10=48.05%, 20=47.31%, 50=4.34%
lat (msec) : 100=0.23%, 250=0.02%
cpu : usr=0.45%, sys=0.36%, ctx=65477, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.4%, 16=50.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=164897,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11760: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60048msec)
slat (nsec): min=110, max=2147.6k, avg=351.60, stdev=6339.29
clat (usec): min=1349, max=123956, avg=11101.20, stdev=5477.00
lat (usec): min=1349, max=123957, avg=11101.55, stdev=5477.00
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 65], 99.95th=[ 85],
| 99.99th=[ 124]
bw ( KiB/s): min= 5056, max=33405, per=0.20%, avg=11537.55, stdev=3207.01, samples=119
iops : min= 1264, max= 8351, avg=2884.32, stdev=801.76, samples=119
lat (msec) : 2=0.02%, 4=3.71%, 10=47.25%, 20=44.20%, 50=4.63%
lat (msec) : 100=0.16%, 250=0.03%
cpu : usr=0.57%, sys=0.18%, ctx=67473, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.2%, 16=55.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=172642,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11761: Fri Aug 13 21:22:57 2021
read: IOPS=2933, BW=11.5MiB/s (12.0MB/s)(688MiB/60012msec)
slat (nsec): min=110, max=237806, avg=316.47, stdev=1077.52
clat (usec): min=469, max=65630, avg=10689.52, stdev=3847.61
lat (usec): min=492, max=65630, avg=10689.84, stdev=3847.62
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7308], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12387], 90.00th=[14615], 95.00th=[17171],
| 99.00th=[25560], 99.50th=[30278], 99.90th=[44827], 99.95th=[55837],
| 99.99th=[64750]
bw ( KiB/s): min= 6632, max=15872, per=0.21%, avg=11956.60, stdev=1996.01, samples=117
iops : min= 1658, max= 3968, avg=2989.09, stdev=499.01, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.20%, 10=55.87%, 20=41.13%, 50=2.73%
lat (msec) : 100=0.07%
cpu : usr=0.56%, sys=0.25%, ctx=63554, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=176072,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11762: Fri Aug 13 21:22:57 2021
read: IOPS=2731, BW=10.7MiB/s (11.2MB/s)(640MiB/60014msec)
slat (nsec): min=110, max=6218.9k, avg=459.23, stdev=21566.79
clat (usec): min=38, max=221332, avg=11569.73, stdev=6245.30
lat (usec): min=208, max=221332, avg=11570.19, stdev=6245.20
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 71], 99.95th=[ 124],
| 99.99th=[ 213]
bw ( KiB/s): min= 6912, max=15089, per=0.19%, avg=11049.68, stdev=1910.97, samples=118
iops : min= 1728, max= 3772, avg=2762.36, stdev=477.73, samples=118
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%
lat (msec) : 2=0.02%, 4=0.57%, 10=45.64%, 20=49.11%, 50=4.44%
lat (msec) : 100=0.15%, 250=0.07%
cpu : usr=0.45%, sys=0.36%, ctx=65606, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163927,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11763: Fri Aug 13 21:22:57 2021
read: IOPS=2731, BW=10.7MiB/s (11.2MB/s)(641MiB/60036msec)
slat (nsec): min=110, max=1631.8k, avg=370.48, stdev=6721.68
clat (usec): min=229, max=114193, avg=11457.38, stdev=5276.65
lat (usec): min=404, max=114194, avg=11457.75, stdev=5276.65
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 71], 99.95th=[ 80],
| 99.99th=[ 114]
bw ( KiB/s): min= 3489, max=15104, per=0.20%, avg=11127.18, stdev=2060.60, samples=117
iops : min= 872, max= 3776, avg=2781.74, stdev=515.16, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=47.72%, 20=47.78%, 50=4.13%
lat (msec) : 100=0.22%, 250=0.03%
cpu : usr=0.48%, sys=0.33%, ctx=65630, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=9.6%, 16=65.5%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.8%, 8=1.5%, 16=0.9%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=163999,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11764: Fri Aug 13 21:22:57 2021
read: IOPS=2664, BW=10.4MiB/s (10.9MB/s)(625MiB/60007msec)
slat (nsec): min=110, max=71832, avg=314.12, stdev=598.84
clat (usec): min=204, max=135143, avg=11811.23, stdev=5740.01
lat (usec): min=205, max=135143, avg=11811.55, stdev=5740.02
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 78], 99.95th=[ 87],
| 99.99th=[ 131]
bw ( KiB/s): min= 1277, max=15329, per=0.19%, avg=10759.53, stdev=2141.18, samples=118
iops : min= 319, max= 3832, avg=2689.81, stdev=535.29, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=43.77%, 20=51.36%, 50=4.43%
lat (msec) : 100=0.38%, 250=0.02%
cpu : usr=0.49%, sys=0.31%, ctx=66882, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.5%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.3%, 16=0.6%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=159904,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11765: Fri Aug 13 21:22:57 2021
read: IOPS=2941, BW=11.5MiB/s (12.0MB/s)(690MiB/60046msec)
slat (nsec): min=110, max=2063.8k, avg=329.86, stdev=4979.28
clat (usec): min=209, max=59484, avg=10642.10, stdev=3775.26
lat (usec): min=209, max=59485, avg=10642.43, stdev=3775.27
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[12256], 90.00th=[14353], 95.00th=[16909],
| 99.00th=[25297], 99.50th=[31065], 99.90th=[44303], 99.95th=[49546],
| 99.99th=[57410]
bw ( KiB/s): min= 4608, max=14848, per=0.21%, avg=12038.18, stdev=1810.10, samples=117
iops : min= 1152, max= 3712, avg=3009.48, stdev=452.54, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=56.66%, 20=40.65%, 50=2.57%
lat (msec) : 100=0.05%
cpu : usr=0.48%, sys=0.32%, ctx=61197, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.1%, 16=56.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.4%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=176618,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11766: Fri Aug 13 21:22:57 2021
read: IOPS=2921, BW=11.4MiB/s (12.0MB/s)(685MiB/60019msec)
slat (nsec): min=90, max=426258, avg=312.09, stdev=1231.72
clat (usec): min=48, max=139720, avg=10927.63, stdev=5725.81
lat (usec): min=195, max=139721, avg=10927.94, stdev=5725.83
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 69], 99.95th=[ 91],
| 99.99th=[ 140]
bw ( KiB/s): min= 6144, max=39592, per=0.21%, avg=11714.40, stdev=3803.85, samples=119
iops : min= 1536, max= 9898, avg=2928.50, stdev=950.95, samples=119
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=4.97%, 10=48.95%, 20=41.72%, 50=4.08%
lat (msec) : 100=0.24%, 250=0.04%
cpu : usr=0.53%, sys=0.21%, ctx=68217, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.2%, 16=55.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=175339,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11767: Fri Aug 13 21:22:57 2021
read: IOPS=2946, BW=11.5MiB/s (12.1MB/s)(691MiB/60011msec)
slat (nsec): min=110, max=2388.2k, avg=327.85, stdev=7468.13
clat (usec): min=215, max=105660, avg=10646.95, stdev=4300.59
lat (usec): min=220, max=105660, avg=10647.27, stdev=4300.63
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7373], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9503], 60.00th=[10028],
| 70.00th=[10814], 80.00th=[12125], 90.00th=[14222], 95.00th=[17171],
| 99.00th=[27657], 99.50th=[32637], 99.90th=[56886], 99.95th=[62129],
| 99.99th=[89654]
bw ( KiB/s): min= 5632, max=15616, per=0.21%, avg=12011.38, stdev=2015.89, samples=117
iops : min= 1408, max= 3904, avg=3002.79, stdev=503.97, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=58.59%, 20=38.11%, 50=3.05%
lat (msec) : 100=0.16%, 250=0.01%
cpu : usr=0.49%, sys=0.31%, ctx=61756, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.2%, 16=50.8%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=176841,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11768: Fri Aug 13 21:22:57 2021
read: IOPS=2712, BW=10.6MiB/s (11.1MB/s)(636MiB/60002msec)
slat (nsec): min=110, max=650236, avg=324.98, stdev=1854.86
clat (usec): min=746, max=170814, avg=11558.18, stdev=5326.29
lat (usec): min=747, max=170815, avg=11558.50, stdev=5326.30
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 57], 99.95th=[ 78],
| 99.99th=[ 163]
bw ( KiB/s): min= 6400, max=14600, per=0.19%, avg=11028.58, stdev=1735.39, samples=117
iops : min= 1600, max= 3650, avg=2757.15, stdev=433.99, samples=117
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 4=0.06%, 10=45.31%, 20=50.12%, 50=4.32%, 100=0.16%
lat (msec) : 250=0.03%
cpu : usr=0.44%, sys=0.37%, ctx=62482, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.8%, 16=58.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.8%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162785,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11769: Fri Aug 13 21:22:57 2021
read: IOPS=2679, BW=10.5MiB/s (11.0MB/s)(629MiB/60042msec)
slat (nsec): min=110, max=243195, avg=319.96, stdev=1056.97
clat (usec): min=163, max=90269, avg=11697.34, stdev=5200.81
lat (usec): min=188, max=90271, avg=11697.66, stdev=5200.82
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[12125], 80.00th=[13566], 90.00th=[16188], 95.00th=[20579],
| 99.00th=[31589], 99.50th=[40109], 99.90th=[60031], 99.95th=[71828],
| 99.99th=[90702]
bw ( KiB/s): min= 6051, max=15320, per=0.19%, avg=10909.13, stdev=1971.62, samples=117
iops : min= 1512, max= 3830, avg=2727.21, stdev=492.95, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=45.16%, 20=49.38%, 50=5.07%
lat (msec) : 100=0.28%
cpu : usr=0.48%, sys=0.31%, ctx=65777, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.1%, 16=54.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160897,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11770: Fri Aug 13 21:22:57 2021
read: IOPS=2897, BW=11.3MiB/s (11.9MB/s)(679MiB/60031msec)
slat (nsec): min=109, max=148116, avg=320.61, stdev=733.88
clat (usec): min=1498, max=119147, avg=11023.68, stdev=5432.51
lat (usec): min=1499, max=119148, avg=11024.00, stdev=5432.53
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 62], 99.95th=[ 75],
| 99.99th=[ 120]
bw ( KiB/s): min= 5381, max=34768, per=0.20%, avg=11615.81, stdev=3340.18, samples=119
iops : min= 1345, max= 8692, avg=2903.88, stdev=835.04, samples=119
lat (msec) : 2=0.01%, 4=3.89%, 10=48.85%, 20=42.71%, 50=4.37%
lat (msec) : 100=0.15%, 250=0.03%
cpu : usr=0.51%, sys=0.23%, ctx=68173, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.6%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=173923,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11771: Fri Aug 13 21:22:57 2021
read: IOPS=2605, BW=10.2MiB/s (10.7MB/s)(611MiB/60005msec)
slat (nsec): min=100, max=1653.2k, avg=361.15, stdev=6074.35
clat (usec): min=1555, max=211688, avg=12151.47, stdev=6597.43
lat (usec): min=1555, max=211689, avg=12151.83, stdev=6597.45
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 46], 99.90th=[ 77], 99.95th=[ 95],
| 99.99th=[ 207]
bw ( KiB/s): min= 6144, max=16128, per=0.18%, avg=10511.05, stdev=1913.70, samples=118
iops : min= 1536, max= 4032, avg=2627.71, stdev=478.42, samples=118
lat (msec) : 2=0.01%, 4=0.39%, 10=39.29%, 20=54.10%, 50=5.81%
lat (msec) : 100=0.37%, 250=0.04%
cpu : usr=0.49%, sys=0.29%, ctx=64289, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=156369,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11772: Fri Aug 13 21:22:57 2021
read: IOPS=2803, BW=10.9MiB/s (11.5MB/s)(657MiB/60016msec)
slat (nsec): min=110, max=10140k, avg=480.08, stdev=31239.97
clat (usec): min=491, max=162447, avg=11198.06, stdev=4847.07
lat (usec): min=492, max=162448, avg=11198.54, stdev=4847.05
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 55], 99.95th=[ 73],
| 99.99th=[ 161]
bw ( KiB/s): min= 6952, max=14976, per=0.20%, avg=11429.79, stdev=1784.12, samples=117
iops : min= 1738, max= 3744, avg=2857.39, stdev=446.04, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=49.96%, 20=46.39%, 50=3.38%
lat (msec) : 100=0.13%, 250=0.02%
cpu : usr=0.53%, sys=0.28%, ctx=64393, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=3.2%, 16=71.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.2%, 8=2.0%, 16=1.4%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=168236,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11773: Fri Aug 13 21:22:57 2021
read: IOPS=2746, BW=10.7MiB/s (11.2MB/s)(644MiB/60010msec)
slat (nsec): min=119, max=79281, avg=314.89, stdev=574.61
clat (usec): min=1522, max=144199, avg=11444.72, stdev=5617.55
lat (usec): min=1526, max=144200, avg=11445.03, stdev=5617.56
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 93], 99.95th=[ 101],
| 99.99th=[ 121]
bw ( KiB/s): min= 1245, max=14848, per=0.20%, avg=11121.82, stdev=2186.93, samples=118
iops : min= 311, max= 3712, avg=2780.39, stdev=546.74, samples=118
lat (msec) : 2=0.01%, 4=0.10%, 10=46.31%, 20=49.76%, 50=3.55%
lat (msec) : 100=0.24%, 250=0.04%
cpu : usr=0.44%, sys=0.38%, ctx=66891, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.8%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=164820,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11774: Fri Aug 13 21:22:57 2021
read: IOPS=2857, BW=11.2MiB/s (11.7MB/s)(670MiB/60006msec)
slat (nsec): min=110, max=3150.3k, avg=332.12, stdev=7626.81
clat (usec): min=1703, max=73040, avg=10980.70, stdev=4679.45
lat (usec): min=1704, max=73040, avg=10981.04, stdev=4679.50
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[15008], 95.00th=[18482],
| 99.00th=[29230], 99.50th=[37487], 99.90th=[60556], 99.95th=[69731],
| 99.99th=[72877]
bw ( KiB/s): min= 6112, max=15360, per=0.20%, avg=11647.26, stdev=2060.71, samples=117
iops : min= 1528, max= 3840, avg=2911.75, stdev=515.21, samples=117
lat (msec) : 2=0.01%, 4=0.28%, 10=53.88%, 20=41.95%, 50=3.70%
lat (msec) : 100=0.20%
cpu : usr=0.49%, sys=0.30%, ctx=63549, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.9%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=171445,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11775: Fri Aug 13 21:22:57 2021
read: IOPS=3064, BW=12.0MiB/s (12.6MB/s)(718MiB/60010msec)
slat (nsec): min=100, max=145295, avg=313.70, stdev=676.79
clat (usec): min=1959, max=71114, avg=10395.00, stdev=4211.24
lat (usec): min=1960, max=71118, avg=10395.31, stdev=4211.26
clat percentiles (usec):
| 1.00th=[ 2900], 5.00th=[ 6783], 10.00th=[ 7635], 20.00th=[ 8225],
| 30.00th=[ 8586], 40.00th=[ 8979], 50.00th=[ 9503], 60.00th=[10028],
| 70.00th=[10814], 80.00th=[11863], 90.00th=[14091], 95.00th=[16909],
| 99.00th=[27657], 99.50th=[32900], 99.90th=[50594], 99.95th=[60031],
| 99.99th=[63177]
bw ( KiB/s): min= 5640, max=25548, per=0.22%, avg=12263.01, stdev=2405.23, samples=119
iops : min= 1410, max= 6387, avg=3065.70, stdev=601.32, samples=119
lat (msec) : 2=0.01%, 4=2.72%, 10=56.72%, 20=37.77%, 50=2.68%
lat (msec) : 100=0.11%
cpu : usr=0.53%, sys=0.24%, ctx=64612, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.9%, 16=57.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.8%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=183879,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11776: Fri Aug 13 21:22:57 2021
read: IOPS=2682, BW=10.5MiB/s (11.0MB/s)(629MiB/60026msec)
slat (nsec): min=110, max=10739k, avg=378.25, stdev=26775.23
clat (usec): min=294, max=126443, avg=11751.38, stdev=6182.08
lat (usec): min=428, max=126443, avg=11751.76, stdev=6182.04
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 39], 99.50th=[ 52], 99.90th=[ 77], 99.95th=[ 83],
| 99.99th=[ 105]
bw ( KiB/s): min= 4864, max=16319, per=0.19%, avg=10826.92, stdev=2184.73, samples=118
iops : min= 1216, max= 4079, avg=2706.68, stdev=546.19, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=45.28%, 20=49.46%, 50=4.57%
lat (msec) : 100=0.52%, 250=0.02%
cpu : usr=0.51%, sys=0.28%, ctx=65361, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.4%, 16=50.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=161023,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11777: Fri Aug 13 21:22:57 2021
read: IOPS=2763, BW=10.8MiB/s (11.3MB/s)(648MiB/60016msec)
slat (nsec): min=110, max=491012, avg=330.53, stdev=1615.65
clat (usec): min=201, max=133890, avg=11397.91, stdev=5567.78
lat (usec): min=202, max=133890, avg=11398.25, stdev=5567.80
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 74], 99.95th=[ 116],
| 99.99th=[ 134]
bw ( KiB/s): min= 5392, max=15104, per=0.20%, avg=11171.75, stdev=2146.01, samples=118
iops : min= 1348, max= 3776, avg=2792.87, stdev=536.50, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=49.25%, 20=46.29%, 50=4.12%
lat (msec) : 100=0.20%, 250=0.05%
cpu : usr=0.46%, sys=0.36%, ctx=64902, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.3%, 16=55.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=165860,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11778: Fri Aug 13 21:22:57 2021
read: IOPS=2833, BW=11.1MiB/s (11.6MB/s)(665MiB/60037msec)
slat (nsec): min=110, max=703169, avg=333.20, stdev=2217.98
clat (usec): min=240, max=191029, avg=11050.01, stdev=5056.88
lat (usec): min=251, max=191030, avg=11050.35, stdev=5056.93
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 35], 99.90th=[ 55], 99.95th=[ 69],
| 99.99th=[ 184]
bw ( KiB/s): min= 4864, max=15336, per=0.20%, avg=11546.02, stdev=2011.72, samples=117
iops : min= 1216, max= 3834, avg=2886.43, stdev=502.94, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=52.44%, 20=44.44%, 50=2.87%
lat (msec) : 100=0.14%, 250=0.04%
cpu : usr=0.53%, sys=0.27%, ctx=61926, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.4%, 16=54.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=170119,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11779: Fri Aug 13 21:22:57 2021
read: IOPS=2663, BW=10.4MiB/s (10.9MB/s)(625MiB/60041msec)
slat (nsec): min=110, max=1504.3k, avg=337.66, stdev=3852.98
clat (usec): min=1702, max=158906, avg=11771.08, stdev=5884.95
lat (usec): min=1703, max=158907, avg=11771.41, stdev=5884.98
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 83], 99.95th=[ 107],
| 99.99th=[ 159]
bw ( KiB/s): min= 4352, max=15624, per=0.19%, avg=10869.67, stdev=2114.64, samples=117
iops : min= 1088, max= 3906, avg=2717.37, stdev=528.68, samples=117
lat (msec) : 2=0.01%, 4=0.01%, 10=45.59%, 20=49.32%, 50=4.83%
lat (msec) : 100=0.20%, 250=0.05%
cpu : usr=0.47%, sys=0.35%, ctx=64763, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.3%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=159906,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11780: Fri Aug 13 21:22:57 2021
read: IOPS=2598, BW=10.2MiB/s (10.6MB/s)(609MiB/60026msec)
slat (nsec): min=110, max=2576.9k, avg=351.78, stdev=7194.60
clat (usec): min=24, max=128180, avg=12112.18, stdev=6126.62
lat (usec): min=291, max=128183, avg=12112.53, stdev=6126.77
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 46], 99.90th=[ 73], 99.95th=[ 97],
| 99.99th=[ 123]
bw ( KiB/s): min= 2299, max=16862, per=0.18%, avg=10513.87, stdev=2246.67, samples=118
iops : min= 574, max= 4215, avg=2628.39, stdev=561.67, samples=118
lat (usec) : 50=0.01%, 500=0.01%
lat (msec) : 4=0.03%, 10=42.54%, 20=50.70%, 50=6.35%, 100=0.33%
lat (msec) : 250=0.05%
cpu : usr=0.46%, sys=0.33%, ctx=64171, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.0%, 16=54.0%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=155983,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11781: Fri Aug 13 21:22:57 2021
read: IOPS=3108, BW=12.1MiB/s (12.7MB/s)(729MiB/60009msec)
slat (nsec): min=110, max=339355, avg=313.61, stdev=1042.96
clat (usec): min=1358, max=74014, avg=10274.30, stdev=3985.55
lat (usec): min=1358, max=74015, avg=10274.61, stdev=3985.57
clat percentiles (usec):
| 1.00th=[ 2802], 5.00th=[ 5211], 10.00th=[ 7504], 20.00th=[ 8225],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9503], 60.00th=[10028],
| 70.00th=[10814], 80.00th=[11994], 90.00th=[14091], 95.00th=[16450],
| 99.00th=[24773], 99.50th=[30540], 99.90th=[46924], 99.95th=[53216],
| 99.99th=[67634]
bw ( KiB/s): min= 8248, max=33980, per=0.22%, avg=12442.64, stdev=3130.78, samples=119
iops : min= 2062, max= 8495, avg=3110.59, stdev=782.66, samples=119
lat (msec) : 2=0.01%, 4=3.79%, 10=55.26%, 20=38.49%, 50=2.40%
lat (msec) : 100=0.06%
cpu : usr=0.56%, sys=0.27%, ctx=65501, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.9%, 16=63.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.3%, 16=1.7%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=186528,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11782: Fri Aug 13 21:22:57 2021
read: IOPS=2885, BW=11.3MiB/s (11.8MB/s)(676MiB/60012msec)
slat (nsec): min=110, max=376101, avg=312.93, stdev=1067.03
clat (usec): min=544, max=104756, avg=10948.34, stdev=4580.17
lat (usec): min=920, max=104756, avg=10948.65, stdev=4580.18
clat percentiles (usec):
| 1.00th=[ 5014], 5.00th=[ 7242], 10.00th=[ 7767], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12518], 90.00th=[14746], 95.00th=[17957],
| 99.00th=[28705], 99.50th=[35390], 99.90th=[56886], 99.95th=[66847],
| 99.99th=[82314]
bw ( KiB/s): min= 6520, max=15880, per=0.20%, avg=11657.92, stdev=1985.19, samples=118
iops : min= 1630, max= 3970, avg=2914.42, stdev=496.29, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.30%, 10=51.68%, 20=44.60%, 50=3.22%
lat (msec) : 100=0.20%, 250=0.01%
cpu : usr=0.50%, sys=0.33%, ctx=65113, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.4%, 16=55.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=173135,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11783: Fri Aug 13 21:22:57 2021
read: IOPS=2873, BW=11.2MiB/s (11.8MB/s)(674MiB/60054msec)
slat (nsec): min=110, max=107328, avg=313.25, stdev=680.59
clat (usec): min=932, max=167073, avg=10950.58, stdev=5261.61
lat (usec): min=932, max=167073, avg=10950.89, stdev=5261.63
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 36], 99.90th=[ 62], 99.95th=[ 99],
| 99.99th=[ 144]
bw ( KiB/s): min= 6168, max=15640, per=0.21%, avg=11742.56, stdev=2068.83, samples=117
iops : min= 1542, max= 3910, avg=2935.56, stdev=517.24, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=55.97%, 20=40.16%, 50=3.70%
lat (msec) : 100=0.09%, 250=0.04%
cpu : usr=0.51%, sys=0.30%, ctx=60402, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.2%, 16=50.8%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=172558,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11784: Fri Aug 13 21:22:57 2021
read: IOPS=2899, BW=11.3MiB/s (11.9MB/s)(680MiB/60004msec)
slat (nsec): min=100, max=6978.0k, avg=371.98, stdev=17588.24
clat (usec): min=27, max=136497, avg=10778.03, stdev=4421.05
lat (usec): min=439, max=136497, avg=10778.40, stdev=4421.21
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 33], 99.90th=[ 56], 99.95th=[ 66],
| 99.99th=[ 124]
bw ( KiB/s): min= 4582, max=15344, per=0.21%, avg=11817.24, stdev=2099.44, samples=117
iops : min= 1145, max= 3836, avg=2954.26, stdev=524.88, samples=117
lat (usec) : 50=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=54.92%, 20=42.04%, 50=2.79%
lat (msec) : 100=0.09%, 250=0.02%
cpu : usr=0.51%, sys=0.30%, ctx=65836, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.1%, 16=56.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=174001,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11785: Fri Aug 13 21:22:57 2021
read: IOPS=2714, BW=10.6MiB/s (11.1MB/s)(636MiB/60013msec)
slat (nsec): min=119, max=2792.1k, avg=355.12, stdev=7775.26
clat (usec): min=1147, max=134051, avg=11613.42, stdev=5334.58
lat (usec): min=1147, max=134051, avg=11613.77, stdev=5334.80
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 68], 99.95th=[ 79],
| 99.99th=[ 113]
bw ( KiB/s): min= 5109, max=16351, per=0.19%, avg=10955.53, stdev=2121.50, samples=118
iops : min= 1277, max= 4087, avg=2738.81, stdev=530.36, samples=118
lat (msec) : 2=0.01%, 4=0.17%, 10=44.82%, 20=50.19%, 50=4.63%
lat (msec) : 100=0.15%, 250=0.04%
cpu : usr=0.45%, sys=0.36%, ctx=64346, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.7%, 16=55.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.4%, 16=0.8%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=162890,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11786: Fri Aug 13 21:22:57 2021
read: IOPS=2716, BW=10.6MiB/s (11.1MB/s)(637MiB/60053msec)
slat (nsec): min=110, max=1222.7k, avg=333.40, stdev=3574.66
clat (usec): min=1198, max=184835, avg=11706.73, stdev=6246.60
lat (usec): min=1198, max=184835, avg=11707.06, stdev=6246.63
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 71], 99.95th=[ 77],
| 99.99th=[ 186]
bw ( KiB/s): min= 1536, max=24782, per=0.19%, avg=10890.86, stdev=2581.54, samples=119
iops : min= 384, max= 6195, avg=2722.64, stdev=645.36, samples=119
lat (msec) : 2=0.01%, 4=1.86%, 10=43.11%, 20=49.93%, 50=4.77%
lat (msec) : 100=0.29%, 250=0.04%
cpu : usr=0.47%, sys=0.26%, ctx=68561, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=61.9%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.2%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=163107,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11787: Fri Aug 13 21:22:57 2021
read: IOPS=2962, BW=11.6MiB/s (12.1MB/s)(695MiB/60046msec)
slat (nsec): min=100, max=82522, avg=323.50, stdev=617.98
clat (usec): min=1348, max=79609, avg=10739.10, stdev=4747.42
lat (usec): min=1350, max=79610, avg=10739.43, stdev=4747.44
clat percentiles (usec):
| 1.00th=[ 4686], 5.00th=[ 7308], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[12125], 90.00th=[14222], 95.00th=[17171],
| 99.00th=[30278], 99.50th=[41157], 99.90th=[61604], 99.95th=[66323],
| 99.99th=[77071]
bw ( KiB/s): min= 5328, max=15464, per=0.21%, avg=11880.08, stdev=2085.79, samples=119
iops : min= 1332, max= 3866, avg=2969.96, stdev=521.47, samples=119
lat (msec) : 2=0.01%, 4=0.56%, 10=56.19%, 20=40.11%, 50=2.86%
lat (msec) : 100=0.28%
cpu : usr=0.54%, sys=0.22%, ctx=64174, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.5%, 16=59.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.2%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=177889,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11788: Fri Aug 13 21:22:57 2021
read: IOPS=2832, BW=11.1MiB/s (11.6MB/s)(664MiB/60044msec)
slat (nsec): min=100, max=411000, avg=324.69, stdev=1403.87
clat (usec): min=823, max=99721, avg=11270.18, stdev=5486.41
lat (usec): min=823, max=99721, avg=11270.51, stdev=5486.43
clat percentiles (usec):
| 1.00th=[ 2704], 5.00th=[ 5014], 10.00th=[ 7635], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10945],
| 70.00th=[11863], 80.00th=[13304], 90.00th=[15795], 95.00th=[19792],
| 99.00th=[32113], 99.50th=[38536], 99.90th=[70779], 99.95th=[82314],
| 99.99th=[91751]
bw ( KiB/s): min= 6104, max=38842, per=0.20%, avg=11362.86, stdev=3483.14, samples=119
iops : min= 1526, max= 9710, avg=2840.64, stdev=870.77, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.02%, 4=4.56%, 10=42.80%, 20=47.73%, 50=4.69%
lat (msec) : 100=0.20%
cpu : usr=0.51%, sys=0.22%, ctx=60781, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.9%, 16=59.2%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.9%, 16=0.8%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=170064,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11789: Fri Aug 13 21:22:57 2021
read: IOPS=2682, BW=10.5MiB/s (11.0MB/s)(629MiB/60047msec)
slat (nsec): min=110, max=121207, avg=326.98, stdev=726.49
clat (usec): min=228, max=141986, avg=11764.28, stdev=6345.46
lat (usec): min=244, max=141986, avg=11764.60, stdev=6345.49
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 50], 99.90th=[ 80], 99.95th=[ 86],
| 99.99th=[ 132]
bw ( KiB/s): min= 4598, max=15584, per=0.19%, avg=10856.69, stdev=2289.46, samples=118
iops : min= 1149, max= 3896, avg=2714.10, stdev=572.41, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=47.30%, 20=46.80%, 50=5.37%
lat (msec) : 100=0.47%, 250=0.02%
cpu : usr=0.45%, sys=0.36%, ctx=64185, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.6%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.0%, 16=1.3%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=161057,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11790: Fri Aug 13 21:22:57 2021
read: IOPS=2854, BW=11.2MiB/s (11.7MB/s)(669MiB/60022msec)
slat (nsec): min=110, max=1497.0k, avg=333.36, stdev=4517.71
clat (usec): min=191, max=101945, avg=11009.10, stdev=4432.62
lat (usec): min=1156, max=101945, avg=11009.43, stdev=4432.62
clat percentiles (usec):
| 1.00th=[ 6128], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[14746], 95.00th=[17171],
| 99.00th=[27657], 99.50th=[34341], 99.90th=[58983], 99.95th=[69731],
| 99.99th=[82314]
bw ( KiB/s): min= 207, max=16384, per=0.20%, avg=11520.75, stdev=2173.74, samples=118
iops : min= 51, max= 4096, avg=2880.11, stdev=543.47, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.26%, 10=50.64%, 20=46.28%, 50=2.62%
lat (msec) : 100=0.19%, 250=0.01%
cpu : usr=0.52%, sys=0.32%, ctx=67164, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=58.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.1%, 16=1.5%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=171357,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11791: Fri Aug 13 21:22:57 2021
read: IOPS=2614, BW=10.2MiB/s (10.7MB/s)(613MiB/60010msec)
slat (nsec): min=110, max=2507.2k, avg=357.02, stdev=7201.19
clat (usec): min=631, max=200409, avg=12030.38, stdev=6914.30
lat (usec): min=632, max=200409, avg=12030.74, stdev=6914.41
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 41], 99.50th=[ 52], 99.90th=[ 89], 99.95th=[ 94],
| 99.99th=[ 197]
bw ( KiB/s): min= 1788, max=14928, per=0.19%, avg=10558.68, stdev=2300.96, samples=118
iops : min= 447, max= 3732, avg=2639.60, stdev=575.20, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=44.24%, 20=49.91%, 50=5.23%
lat (msec) : 100=0.52%, 250=0.03%
cpu : usr=0.47%, sys=0.33%, ctx=65694, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=10.1%, 16=64.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.7%, 8=0.6%, 16=2.2%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=156907,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11792: Fri Aug 13 21:22:57 2021
read: IOPS=2802, BW=10.9MiB/s (11.5MB/s)(657MiB/60003msec)
slat (nsec): min=110, max=402849, avg=309.91, stdev=1355.47
clat (usec): min=965, max=265852, avg=11323.61, stdev=6882.52
lat (usec): min=966, max=265854, avg=11323.92, stdev=6882.52
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 86], 99.95th=[ 105],
| 99.99th=[ 266]
bw ( KiB/s): min= 1280, max=15840, per=0.20%, avg=11214.41, stdev=2590.69, samples=119
iops : min= 320, max= 3960, avg=2803.55, stdev=647.67, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=54.00%, 20=40.98%, 50=4.51%
lat (msec) : 100=0.29%, 250=0.04%, 500=0.02%
cpu : usr=0.49%, sys=0.24%, ctx=64177, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=168175,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11793: Fri Aug 13 21:22:57 2021
read: IOPS=3122, BW=12.2MiB/s (12.8MB/s)(732MiB/60013msec)
slat (nsec): min=100, max=393039, avg=309.34, stdev=1054.59
clat (usec): min=1288, max=91307, avg=10224.80, stdev=4236.10
lat (usec): min=1288, max=91308, avg=10225.11, stdev=4236.12
clat percentiles (usec):
| 1.00th=[ 2802], 5.00th=[ 6587], 10.00th=[ 7504], 20.00th=[ 8160],
| 30.00th=[ 8586], 40.00th=[ 8979], 50.00th=[ 9372], 60.00th=[ 9896],
| 70.00th=[10683], 80.00th=[11731], 90.00th=[13566], 95.00th=[16188],
| 99.00th=[26608], 99.50th=[31327], 99.90th=[58459], 99.95th=[61604],
| 99.99th=[79168]
bw ( KiB/s): min= 7249, max=27632, per=0.22%, avg=12512.79, stdev=2504.03, samples=119
iops : min= 1812, max= 6908, avg=3128.13, stdev=626.01, samples=119
lat (msec) : 2=0.01%, 4=3.42%, 10=57.80%, 20=36.38%, 50=2.23%
lat (msec) : 100=0.17%
cpu : usr=0.55%, sys=0.23%, ctx=63584, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.3%, 16=1.8%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=187406,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11794: Fri Aug 13 21:22:57 2021
read: IOPS=2918, BW=11.4MiB/s (12.0MB/s)(684MiB/60010msec)
slat (nsec): min=110, max=657382, avg=326.73, stdev=1888.57
clat (usec): min=1644, max=153383, avg=10931.57, stdev=5316.94
lat (usec): min=1644, max=153383, avg=10931.89, stdev=5316.95
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 71], 99.95th=[ 100],
| 99.99th=[ 153]
bw ( KiB/s): min= 4878, max=30208, per=0.21%, avg=11706.17, stdev=2603.06, samples=119
iops : min= 1219, max= 7552, avg=2926.46, stdev=650.78, samples=119
lat (msec) : 2=0.01%, 4=2.10%, 10=49.91%, 20=44.78%, 50=2.99%
lat (msec) : 100=0.17%, 250=0.05%
cpu : usr=0.57%, sys=0.18%, ctx=64644, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.3%, 16=55.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=175138,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11795: Fri Aug 13 21:22:57 2021
read: IOPS=2605, BW=10.2MiB/s (10.7MB/s)(611MiB/60008msec)
slat (nsec): min=120, max=192160, avg=330.82, stdev=993.02
clat (usec): min=171, max=115965, avg=12052.47, stdev=6237.81
lat (usec): min=198, max=115965, avg=12052.80, stdev=6237.83
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 50], 99.90th=[ 81], 99.95th=[ 92],
| 99.99th=[ 103]
bw ( KiB/s): min= 5616, max=14880, per=0.19%, avg=10615.74, stdev=2097.67, samples=117
iops : min= 1404, max= 3720, avg=2653.85, stdev=524.44, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=43.39%, 20=50.69%, 50=5.39%
lat (msec) : 100=0.45%, 250=0.02%
cpu : usr=0.49%, sys=0.31%, ctx=64573, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.8%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=156370,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11796: Fri Aug 13 21:22:57 2021
read: IOPS=2745, BW=10.7MiB/s (11.2MB/s)(644MiB/60006msec)
slat (nsec): min=110, max=9151.1k, avg=507.91, stdev=33337.66
clat (usec): min=170, max=308933, avg=11403.09, stdev=6020.67
lat (usec): min=215, max=308934, avg=11403.60, stdev=6020.59
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 36], 99.90th=[ 58], 99.95th=[ 81],
| 99.99th=[ 309]
bw ( KiB/s): min= 3448, max=14720, per=0.20%, avg=11172.72, stdev=2098.52, samples=117
iops : min= 862, max= 3680, avg=2793.11, stdev=524.62, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=48.88%, 20=46.51%, 50=4.33%
lat (msec) : 100=0.17%, 250=0.02%, 500=0.01%
cpu : usr=0.48%, sys=0.35%, ctx=64601, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=0.8%, 16=1.5%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=164762,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11797: Fri Aug 13 21:22:57 2021
read: IOPS=2784, BW=10.9MiB/s (11.4MB/s)(653MiB/60025msec)
slat (nsec): min=100, max=3650.7k, avg=372.85, stdev=11309.34
clat (usec): min=61, max=426364, avg=11223.54, stdev=6689.63
lat (usec): min=1496, max=426365, avg=11223.91, stdev=6690.44
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 65], 99.95th=[ 142],
| 99.99th=[ 255]
bw ( KiB/s): min= 215, max=14848, per=0.20%, avg=11357.59, stdev=2200.16, samples=117
iops : min= 53, max= 3712, avg=2839.34, stdev=550.08, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=50.98%, 20=45.25%, 50=3.39%
lat (msec) : 100=0.19%, 250=0.04%, 500=0.02%
cpu : usr=0.52%, sys=0.29%, ctx=63170, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.6%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167154,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11798: Fri Aug 13 21:22:57 2021
read: IOPS=2962, BW=11.6MiB/s (12.1MB/s)(695MiB/60024msec)
slat (nsec): min=100, max=411135, avg=310.22, stdev=1164.44
clat (usec): min=1792, max=73869, avg=10561.71, stdev=3458.05
lat (usec): min=1793, max=73870, avg=10562.02, stdev=3458.06
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[13960], 95.00th=[16188],
| 99.00th=[23462], 99.50th=[26870], 99.90th=[41157], 99.95th=[46924],
| 99.99th=[73925]
bw ( KiB/s): min= 5596, max=15504, per=0.21%, avg=12092.26, stdev=1697.80, samples=117
iops : min= 1399, max= 3876, avg=3023.01, stdev=424.44, samples=117
lat (msec) : 2=0.01%, 4=0.06%, 10=55.24%, 20=42.54%, 50=2.11%
lat (msec) : 100=0.04%
cpu : usr=0.47%, sys=0.34%, ctx=65165, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.0%, 16=57.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.4%, 16=0.6%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=177828,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11799: Fri Aug 13 21:22:57 2021
read: IOPS=2827, BW=11.0MiB/s (11.6MB/s)(663MiB/60003msec)
slat (nsec): min=110, max=115058, avg=319.22, stdev=628.23
clat (usec): min=449, max=99520, avg=11085.68, stdev=4531.41
lat (usec): min=450, max=99520, avg=11086.00, stdev=4531.44
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[ 9896], 60.00th=[10683],
| 70.00th=[11469], 80.00th=[12780], 90.00th=[15139], 95.00th=[17957],
| 99.00th=[27657], 99.50th=[36963], 99.90th=[61604], 99.95th=[66323],
| 99.99th=[88605]
bw ( KiB/s): min= 6131, max=15104, per=0.20%, avg=11518.03, stdev=2026.18, samples=117
iops : min= 1532, max= 3776, avg=2879.44, stdev=506.55, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=50.85%, 20=45.95%, 50=2.95%
lat (msec) : 100=0.19%
cpu : usr=0.49%, sys=0.29%, ctx=61697, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.3%, 16=55.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.2%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=169682,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11800: Fri Aug 13 21:22:57 2021
read: IOPS=2674, BW=10.4MiB/s (11.0MB/s)(627MiB/60016msec)
slat (nsec): min=110, max=227527, avg=335.03, stdev=1167.04
clat (usec): min=261, max=121778, avg=11703.60, stdev=6231.76
lat (usec): min=288, max=121779, avg=11703.94, stdev=6231.78
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 40], 99.50th=[ 51], 99.90th=[ 84], 99.95th=[ 101],
| 99.99th=[ 112]
bw ( KiB/s): min= 2570, max=15329, per=0.19%, avg=10909.56, stdev=2300.39, samples=117
iops : min= 642, max= 3832, avg=2727.32, stdev=575.16, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=47.11%, 20=47.84%, 50=4.49%
lat (msec) : 100=0.45%, 250=0.06%
cpu : usr=0.46%, sys=0.32%, ctx=63987, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=160485,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11801: Fri Aug 13 21:22:57 2021
read: IOPS=2698, BW=10.5MiB/s (11.1MB/s)(633MiB/60012msec)
slat (nsec): min=119, max=3039.8k, avg=345.35, stdev=7575.44
clat (usec): min=666, max=126228, avg=11686.31, stdev=6064.36
lat (usec): min=667, max=126229, avg=11686.66, stdev=6064.57
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 92], 99.95th=[ 100],
| 99.99th=[ 117]
bw ( KiB/s): min= 3840, max=15576, per=0.19%, avg=10903.40, stdev=2128.47, samples=118
iops : min= 960, max= 3894, avg=2725.79, stdev=532.11, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=46.86%, 20=47.73%, 50=4.97%
lat (msec) : 100=0.27%, 250=0.05%
cpu : usr=0.46%, sys=0.36%, ctx=65057, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=161957,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11802: Fri Aug 13 21:22:57 2021
read: IOPS=2771, BW=10.8MiB/s (11.4MB/s)(650MiB/60034msec)
slat (nsec): min=100, max=9653.8k, avg=397.32, stdev=23808.07
clat (usec): min=28, max=173203, avg=11324.48, stdev=5178.12
lat (usec): min=684, max=173204, avg=11324.88, stdev=5178.06
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 64], 99.95th=[ 75],
| 99.99th=[ 153]
bw ( KiB/s): min= 3456, max=14992, per=0.20%, avg=11315.09, stdev=1846.23, samples=117
iops : min= 864, max= 3748, avg=2828.72, stdev=461.55, samples=117
lat (usec) : 50=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=48.33%, 20=47.79%, 50=3.56%
lat (msec) : 100=0.14%, 250=0.04%
cpu : usr=0.53%, sys=0.28%, ctx=60564, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.4%, 16=54.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166397,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11803: Fri Aug 13 21:22:57 2021
read: IOPS=2892, BW=11.3MiB/s (11.8MB/s)(678MiB/60048msec)
slat (nsec): min=110, max=1348.9k, avg=364.36, stdev=4204.83
clat (usec): min=196, max=109278, avg=10962.79, stdev=4723.50
lat (usec): min=873, max=109278, avg=10963.16, stdev=4723.51
clat percentiles (usec):
| 1.00th=[ 3523], 5.00th=[ 7111], 10.00th=[ 7701], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15008], 95.00th=[17957],
| 99.00th=[27657], 99.50th=[33817], 99.90th=[64750], 99.95th=[77071],
| 99.99th=[96994]
bw ( KiB/s): min= 7120, max=26323, per=0.21%, avg=11706.80, stdev=2376.47, samples=118
iops : min= 1780, max= 6580, avg=2926.64, stdev=594.10, samples=118
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=1.72%, 10=49.71%, 20=45.20%, 50=3.21%
lat (msec) : 100=0.15%, 250=0.01%
cpu : usr=0.51%, sys=0.23%, ctx=61832, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.6%, 16=58.5%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.4%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=173680,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11804: Fri Aug 13 21:22:57 2021
read: IOPS=2840, BW=11.1MiB/s (11.6MB/s)(666MiB/60012msec)
slat (nsec): min=100, max=2889.3k, avg=363.79, stdev=8472.07
clat (usec): min=88, max=108299, avg=11040.24, stdev=4134.94
lat (usec): min=240, max=108299, avg=11040.60, stdev=4134.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 32], 99.90th=[ 44], 99.95th=[ 54],
| 99.99th=[ 101]
bw ( KiB/s): min= 7680, max=14592, per=0.20%, avg=11577.14, stdev=1712.46, samples=117
iops : min= 1920, max= 3648, avg=2894.23, stdev=428.12, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=50.87%, 20=45.58%, 50=3.35%
lat (msec) : 100=0.06%, 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=65057, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.3%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=170477,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11805: Fri Aug 13 21:22:57 2021
read: IOPS=2800, BW=10.9MiB/s (11.5MB/s)(656MiB/60006msec)
slat (nsec): min=110, max=2120.7k, avg=334.07, stdev=5601.12
clat (msec): min=2, max=116, avg=11.21, stdev= 4.74
lat (msec): min=2, max=116, avg=11.21, stdev= 4.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 58], 99.95th=[ 87],
| 99.99th=[ 113]
bw ( KiB/s): min= 5325, max=15624, per=0.20%, avg=11393.93, stdev=1875.67, samples=117
iops : min= 1331, max= 3906, avg=2848.42, stdev=468.92, samples=117
lat (msec) : 4=0.11%, 10=49.13%, 20=47.24%, 50=3.36%, 100=0.14%
lat (msec) : 250=0.02%
cpu : usr=0.48%, sys=0.34%, ctx=64200, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168032,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11806: Fri Aug 13 21:22:57 2021
read: IOPS=2677, BW=10.5MiB/s (11.0MB/s)(627MiB/60003msec)
slat (nsec): min=119, max=4923.2k, avg=366.61, stdev=12603.45
clat (usec): min=249, max=127368, avg=11736.53, stdev=5251.23
lat (usec): min=1134, max=127369, avg=11736.89, stdev=5251.22
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 41], 99.90th=[ 70], 99.95th=[ 73],
| 99.99th=[ 128]
bw ( KiB/s): min= 5612, max=14576, per=0.19%, avg=10890.26, stdev=1784.31, samples=117
iops : min= 1403, max= 3644, avg=2722.52, stdev=446.07, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=41.96%, 20=53.40%, 50=4.23%
lat (msec) : 100=0.30%, 250=0.02%
cpu : usr=0.46%, sys=0.36%, ctx=64598, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.8%, 16=55.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.7%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=160634,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11807: Fri Aug 13 21:22:57 2021
read: IOPS=2537, BW=9.91MiB/s (10.4MB/s)(595MiB/60024msec)
slat (nsec): min=119, max=1077.0k, avg=361.91, stdev=3486.28
clat (usec): min=269, max=144667, avg=12360.09, stdev=6329.93
lat (usec): min=270, max=144668, avg=12360.45, stdev=6329.93
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 39], 99.50th=[ 48], 99.90th=[ 79], 99.95th=[ 85],
| 99.99th=[ 130]
bw ( KiB/s): min= 6560, max=14848, per=0.18%, avg=10325.24, stdev=1788.51, samples=117
iops : min= 1640, max= 3712, avg=2581.26, stdev=447.13, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=40.21%, 20=52.77%, 50=6.47%
lat (msec) : 100=0.41%, 250=0.03%
cpu : usr=0.48%, sys=0.29%, ctx=65744, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.0%, 16=63.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.3%, 16=2.2%, 32=1.3%, 64=0.0%, >=64=0.0%
issued rwts: total=152284,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11808: Fri Aug 13 21:22:57 2021
read: IOPS=3027, BW=11.8MiB/s (12.4MB/s)(710MiB/60008msec)
slat (nsec): min=100, max=2681.6k, avg=335.04, stdev=6560.88
clat (usec): min=390, max=165561, avg=10504.08, stdev=5282.37
lat (usec): min=391, max=165562, avg=10504.42, stdev=5282.35
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 27], 99.50th=[ 39], 99.90th=[ 72], 99.95th=[ 91],
| 99.99th=[ 159]
bw ( KiB/s): min= 4904, max=31201, per=0.21%, avg=12114.92, stdev=2665.93, samples=119
iops : min= 1226, max= 7800, avg=3028.66, stdev=666.47, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=1.51%, 10=56.83%, 20=39.14%, 50=2.26%
lat (msec) : 100=0.22%, 250=0.03%
cpu : usr=0.57%, sys=0.19%, ctx=65395, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=181678,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11809: Fri Aug 13 21:22:57 2021
read: IOPS=2646, BW=10.3MiB/s (10.8MB/s)(620MiB/60005msec)
slat (nsec): min=110, max=108009, avg=345.66, stdev=813.95
clat (usec): min=273, max=107803, avg=11912.42, stdev=5942.24
lat (usec): min=319, max=107803, avg=11912.77, stdev=5942.27
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8717],
| 30.00th=[ 9372], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12125], 80.00th=[13435], 90.00th=[16319], 95.00th=[20579],
| 99.00th=[38536], 99.50th=[48497], 99.90th=[69731], 99.95th=[83362],
| 99.99th=[91751]
bw ( KiB/s): min= 3840, max=15329, per=0.19%, avg=10675.69, stdev=2129.45, samples=118
iops : min= 960, max= 3832, avg=2668.86, stdev=532.38, samples=118
lat (usec) : 500=0.01%
lat (msec) : 4=0.08%, 10=42.58%, 20=52.02%, 50=4.84%, 100=0.47%
lat (msec) : 250=0.01%
cpu : usr=0.48%, sys=0.33%, ctx=67052, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.2%, 16=60.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.9%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=158788,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11810: Fri Aug 13 21:22:57 2021
read: IOPS=2933, BW=11.5MiB/s (12.0MB/s)(688MiB/60005msec)
slat (nsec): min=119, max=1194.8k, avg=352.10, stdev=4800.80
clat (usec): min=1190, max=133847, avg=10690.12, stdev=4947.97
lat (usec): min=1190, max=133848, avg=10690.48, stdev=4947.99
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 28], 99.50th=[ 38], 99.90th=[ 69], 99.95th=[ 99],
| 99.99th=[ 128]
bw ( KiB/s): min= 4352, max=15360, per=0.21%, avg=11948.14, stdev=2038.26, samples=117
iops : min= 1088, max= 3840, avg=2986.97, stdev=509.56, samples=117
lat (msec) : 2=0.01%, 4=0.13%, 10=56.92%, 20=40.30%, 50=2.44%
lat (msec) : 100=0.17%, 250=0.05%
cpu : usr=0.52%, sys=0.28%, ctx=62216, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.7%, 16=56.4%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=176042,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11811: Fri Aug 13 21:22:57 2021
read: IOPS=2758, BW=10.8MiB/s (11.3MB/s)(647MiB/60011msec)
slat (nsec): min=110, max=234096, avg=339.59, stdev=1221.52
clat (usec): min=1402, max=239205, avg=11488.53, stdev=7351.73
lat (usec): min=1402, max=239205, avg=11488.87, stdev=7351.74
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 44], 99.90th=[ 115], 99.95th=[ 142],
| 99.99th=[ 232]
bw ( KiB/s): min= 5413, max=23504, per=0.20%, avg=11139.07, stdev=2540.90, samples=118
iops : min= 1353, max= 5876, avg=2784.71, stdev=635.24, samples=118
lat (msec) : 2=0.01%, 4=1.61%, 10=47.84%, 20=45.74%, 50=4.39%
lat (msec) : 100=0.25%, 250=0.16%
cpu : usr=0.50%, sys=0.24%, ctx=65598, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.4%, 16=58.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=165528,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11812: Fri Aug 13 21:22:57 2021
read: IOPS=2813, BW=11.0MiB/s (11.5MB/s)(660MiB/60042msec)
slat (nsec): min=110, max=531226, avg=313.40, stdev=1468.94
clat (usec): min=416, max=382113, avg=11292.33, stdev=5996.13
lat (usec): min=468, max=382114, avg=11292.64, stdev=5996.14
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 41], 99.90th=[ 73], 99.95th=[ 82],
| 99.99th=[ 122]
bw ( KiB/s): min= 4040, max=35257, per=0.20%, avg=11280.43, stdev=3047.56, samples=119
iops : min= 1010, max= 8814, avg=2820.05, stdev=761.87, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=3.72%, 10=43.77%, 20=47.80%, 50=4.46%
lat (msec) : 100=0.23%, 250=0.02%, 500=0.01%
cpu : usr=0.54%, sys=0.19%, ctx=66972, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.3%, 16=51.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=168901,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11813: Fri Aug 13 21:22:57 2021
read: IOPS=2701, BW=10.6MiB/s (11.1MB/s)(633MiB/60010msec)
slat (nsec): min=110, max=337216, avg=334.49, stdev=1444.33
clat (usec): min=562, max=97565, avg=11607.59, stdev=5576.32
lat (usec): min=607, max=97566, avg=11607.92, stdev=5576.34
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10945],
| 70.00th=[11994], 80.00th=[13435], 90.00th=[16057], 95.00th=[20317],
| 99.00th=[33424], 99.50th=[44827], 99.90th=[68682], 99.95th=[74974],
| 99.99th=[98042]
bw ( KiB/s): min= 6123, max=15616, per=0.19%, avg=10988.85, stdev=2065.00, samples=117
iops : min= 1530, max= 3904, avg=2747.15, stdev=516.27, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=47.21%, 20=47.59%, 50=4.76%
lat (msec) : 100=0.36%
cpu : usr=0.53%, sys=0.29%, ctx=67171, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=162135,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11814: Fri Aug 13 21:22:57 2021
read: IOPS=3029, BW=11.8MiB/s (12.4MB/s)(710MiB/60013msec)
slat (nsec): min=110, max=201541, avg=315.95, stdev=882.77
clat (usec): min=515, max=126276, avg=10496.51, stdev=4631.48
lat (usec): min=521, max=126277, avg=10496.83, stdev=4631.51
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 10],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 57], 99.95th=[ 77],
| 99.99th=[ 116]
bw ( KiB/s): min= 4598, max=15616, per=0.21%, avg=12162.98, stdev=2299.56, samples=119
iops : min= 1149, max= 3904, avg=3040.67, stdev=574.96, samples=119
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 4=0.11%, 10=61.09%, 20=35.86%, 50=2.76%, 100=0.15%
lat (msec) : 250=0.02%
cpu : usr=0.51%, sys=0.26%, ctx=64456, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=181808,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11815: Fri Aug 13 21:22:57 2021
read: IOPS=2597, BW=10.1MiB/s (10.6MB/s)(609MiB/60007msec)
slat (nsec): min=110, max=7393.5k, avg=377.41, stdev=18745.59
clat (usec): min=722, max=429553, avg=12061.40, stdev=8099.40
lat (usec): min=723, max=429553, avg=12061.77, stdev=8101.33
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 47], 99.90th=[ 95], 99.95th=[ 118],
| 99.99th=[ 338]
bw ( KiB/s): min= 4144, max=15104, per=0.19%, avg=10689.03, stdev=2036.06, samples=116
iops : min= 1036, max= 3776, avg=2672.20, stdev=509.03, samples=116
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=42.25%, 20=52.01%, 50=5.22%
lat (msec) : 100=0.36%, 250=0.06%, 500=0.02%
cpu : usr=0.49%, sys=0.28%, ctx=65036, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.9%, 16=61.2%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.3%, 16=0.8%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=155869,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11816: Fri Aug 13 21:22:57 2021
read: IOPS=2571, BW=10.0MiB/s (10.5MB/s)(603MiB/60013msec)
slat (nsec): min=110, max=96560, avg=323.73, stdev=703.29
clat (usec): min=149, max=185748, avg=12217.29, stdev=6284.96
lat (usec): min=172, max=185749, avg=12217.62, stdev=6284.97
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 47], 99.90th=[ 80], 99.95th=[ 94],
| 99.99th=[ 155]
bw ( KiB/s): min= 3328, max=15616, per=0.18%, avg=10471.09, stdev=2072.03, samples=117
iops : min= 832, max= 3904, avg=2617.71, stdev=518.02, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=39.09%, 20=54.97%, 50=5.40%
lat (msec) : 100=0.39%, 250=0.04%
cpu : usr=0.47%, sys=0.28%, ctx=60312, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=154302,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11817: Fri Aug 13 21:22:57 2021
read: IOPS=2751, BW=10.7MiB/s (11.3MB/s)(645MiB/60009msec)
slat (nsec): min=110, max=7198.8k, avg=470.94, stdev=22702.61
clat (usec): min=656, max=170360, avg=11455.18, stdev=5604.88
lat (usec): min=656, max=170361, avg=11455.65, stdev=5604.87
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 69], 99.95th=[ 93],
| 99.99th=[ 169]
bw ( KiB/s): min= 3840, max=15104, per=0.20%, avg=11109.85, stdev=2031.01, samples=118
iops : min= 960, max= 3776, avg=2777.40, stdev=507.75, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=47.49%, 20=47.77%, 50=4.28%
lat (msec) : 100=0.24%, 250=0.03%
cpu : usr=0.49%, sys=0.33%, ctx=61854, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.1%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.8%, 16=0.9%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=165103,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11818: Fri Aug 13 21:22:57 2021
read: IOPS=2687, BW=10.5MiB/s (11.0MB/s)(630MiB/60021msec)
slat (nsec): min=110, max=3792.1k, avg=375.31, stdev=10730.18
clat (usec): min=255, max=147853, avg=11670.42, stdev=5666.52
lat (usec): min=491, max=147854, avg=11670.80, stdev=5666.66
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 43], 99.90th=[ 62], 99.95th=[ 88],
| 99.99th=[ 146]
bw ( KiB/s): min= 4064, max=14392, per=0.19%, avg=10957.29, stdev=2124.58, samples=117
iops : min= 1016, max= 3598, avg=2739.27, stdev=531.14, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=46.29%, 20=48.43%, 50=4.93%
lat (msec) : 100=0.20%, 250=0.03%
cpu : usr=0.46%, sys=0.33%, ctx=64340, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.7%, 16=58.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.5%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=161325,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11819: Fri Aug 13 21:22:57 2021
read: IOPS=2813, BW=11.0MiB/s (11.5MB/s)(659MiB/60006msec)
slat (nsec): min=100, max=5402.8k, avg=359.31, stdev=13270.61
clat (usec): min=398, max=127194, avg=11155.97, stdev=4789.56
lat (usec): min=399, max=127194, avg=11156.33, stdev=4790.13
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 64], 99.95th=[ 75],
| 99.99th=[ 110]
bw ( KiB/s): min= 4608, max=15104, per=0.20%, avg=11446.38, stdev=2058.09, samples=117
iops : min= 1152, max= 3776, avg=2861.53, stdev=514.50, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 4=0.12%, 10=50.38%, 20=45.96%, 50=3.37%, 100=0.16%
lat (msec) : 250=0.01%
cpu : usr=0.48%, sys=0.31%, ctx=62831, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.1%, 16=59.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.4%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168801,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11820: Fri Aug 13 21:22:57 2021
read: IOPS=2687, BW=10.5MiB/s (11.0MB/s)(630MiB/60006msec)
slat (nsec): min=110, max=441993, avg=327.83, stdev=1915.19
clat (usec): min=1318, max=120849, avg=11654.90, stdev=5751.93
lat (usec): min=1319, max=120852, avg=11655.23, stdev=5751.99
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 70], 99.95th=[ 78],
| 99.99th=[ 103]
bw ( KiB/s): min= 1532, max=14848, per=0.19%, avg=10963.35, stdev=2230.23, samples=117
iops : min= 383, max= 3712, avg=2740.80, stdev=557.60, samples=117
lat (msec) : 2=0.01%, 4=0.09%, 10=46.41%, 20=48.57%, 50=4.52%
lat (msec) : 100=0.39%, 250=0.01%
cpu : usr=0.50%, sys=0.30%, ctx=63202, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.4%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=161254,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11821: Fri Aug 13 21:22:57 2021
read: IOPS=2698, BW=10.5MiB/s (11.1MB/s)(632MiB/60009msec)
slat (nsec): min=110, max=301029, avg=319.05, stdev=1087.84
clat (msec): min=2, max=163, avg=11.59, stdev= 5.86
lat (msec): min=2, max=163, avg=11.59, stdev= 5.86
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 88], 99.95th=[ 100],
| 99.99th=[ 159]
bw ( KiB/s): min= 1013, max=14632, per=0.19%, avg=10993.33, stdev=2099.12, samples=117
iops : min= 253, max= 3658, avg=2748.26, stdev=524.79, samples=117
lat (msec) : 4=0.15%, 10=46.30%, 20=48.97%, 50=4.34%, 100=0.19%
lat (msec) : 250=0.05%
cpu : usr=0.47%, sys=0.33%, ctx=65548, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.7%, 16=52.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=161911,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11822: Fri Aug 13 21:22:57 2021
read: IOPS=2784, BW=10.9MiB/s (11.4MB/s)(653MiB/60006msec)
slat (nsec): min=110, max=928336, avg=341.10, stdev=3135.94
clat (usec): min=654, max=110124, avg=11284.89, stdev=4937.83
lat (usec): min=660, max=110125, avg=11285.23, stdev=4937.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 41], 99.90th=[ 72], 99.95th=[ 82],
| 99.99th=[ 106]
bw ( KiB/s): min= 4600, max=14866, per=0.20%, avg=11326.20, stdev=1849.08, samples=117
iops : min= 1150, max= 3716, avg=2831.49, stdev=462.24, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=46.65%, 20=49.99%, 50=2.98%
lat (msec) : 100=0.27%, 250=0.02%
cpu : usr=0.47%, sys=0.34%, ctx=63537, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.8%, 16=55.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167074,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11823: Fri Aug 13 21:22:57 2021
read: IOPS=2831, BW=11.1MiB/s (11.6MB/s)(664MiB/60025msec)
slat (nsec): min=100, max=159353, avg=321.06, stdev=807.79
clat (usec): min=244, max=111748, avg=11075.08, stdev=5155.32
lat (usec): min=250, max=111749, avg=11075.40, stdev=5155.34
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[14877], 95.00th=[17957],
| 99.00th=[30540], 99.50th=[39060], 99.90th=[73925], 99.95th=[82314],
| 99.99th=[99091]
bw ( KiB/s): min= 4542, max=15608, per=0.20%, avg=11565.29, stdev=2076.85, samples=117
iops : min= 1135, max= 3902, avg=2891.26, stdev=519.22, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.20%, 10=52.42%, 20=43.66%, 50=3.46%
lat (msec) : 100=0.25%, 250=0.01%
cpu : usr=0.47%, sys=0.34%, ctx=64852, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.7%, 16=0.4%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169966,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11824: Fri Aug 13 21:22:57 2021
read: IOPS=2764, BW=10.8MiB/s (11.3MB/s)(648MiB/60008msec)
slat (nsec): min=110, max=3028.1k, avg=356.26, stdev=8544.38
clat (usec): min=246, max=172882, avg=11386.26, stdev=5628.77
lat (usec): min=285, max=172882, avg=11386.61, stdev=5628.82
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 77], 99.95th=[ 106],
| 99.99th=[ 124]
bw ( KiB/s): min= 1261, max=15329, per=0.20%, avg=11155.29, stdev=2305.39, samples=118
iops : min= 315, max= 3832, avg=2788.77, stdev=576.37, samples=118
lat (usec) : 250=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=48.94%, 20=46.30%, 50=4.39%
lat (msec) : 100=0.23%, 250=0.05%
cpu : usr=0.49%, sys=0.33%, ctx=66417, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165901,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11825: Fri Aug 13 21:22:57 2021
read: IOPS=2841, BW=11.1MiB/s (11.6MB/s)(666MiB/60006msec)
slat (nsec): min=110, max=1938.3k, avg=355.59, stdev=7484.39
clat (usec): min=139, max=162216, avg=11027.16, stdev=5492.38
lat (usec): min=197, max=162216, avg=11027.51, stdev=5492.44
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 70], 99.95th=[ 96],
| 99.99th=[ 163]
bw ( KiB/s): min= 4096, max=15616, per=0.20%, avg=11564.89, stdev=2190.44, samples=117
iops : min= 1024, max= 3904, avg=2891.17, stdev=547.63, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.17%, 10=53.74%, 20=42.51%, 50=3.28%
lat (msec) : 100=0.25%, 250=0.04%
cpu : usr=0.50%, sys=0.31%, ctx=61806, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.8%, 16=54.3%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=170493,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11826: Fri Aug 13 21:22:57 2021
read: IOPS=2665, BW=10.4MiB/s (10.9MB/s)(625MiB/60016msec)
slat (nsec): min=110, max=146555, avg=332.03, stdev=769.70
clat (usec): min=247, max=182136, avg=11761.44, stdev=5870.49
lat (usec): min=253, max=182136, avg=11761.77, stdev=5870.51
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 74], 99.95th=[ 87],
| 99.99th=[ 146]
bw ( KiB/s): min= 3832, max=15304, per=0.19%, avg=10849.91, stdev=2030.94, samples=117
iops : min= 958, max= 3826, avg=2712.41, stdev=507.73, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 4=0.10%, 10=44.69%, 20=50.19%, 50=4.65%, 100=0.35%
lat (msec) : 250=0.02%
cpu : usr=0.53%, sys=0.28%, ctx=60699, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=159966,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11827: Fri Aug 13 21:22:57 2021
read: IOPS=2773, BW=10.8MiB/s (11.4MB/s)(650MiB/60025msec)
slat (nsec): min=110, max=18570k, avg=483.19, stdev=48065.03
clat (usec): min=938, max=162946, avg=11308.56, stdev=6044.84
lat (usec): min=938, max=162946, avg=11309.04, stdev=6045.40
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 91], 99.95th=[ 125],
| 99.99th=[ 133]
bw ( KiB/s): min= 4096, max=15352, per=0.20%, avg=11309.07, stdev=2230.96, samples=117
iops : min= 1024, max= 3838, avg=2827.21, stdev=557.77, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.02%, 10=51.09%, 20=44.85%, 50=3.69%
lat (msec) : 100=0.26%, 250=0.08%
cpu : usr=0.56%, sys=0.26%, ctx=64216, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166495,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11828: Fri Aug 13 21:22:57 2021
read: IOPS=2666, BW=10.4MiB/s (10.9MB/s)(625MiB/60010msec)
slat (nsec): min=110, max=49691k, avg=647.66, stdev=124230.32
clat (usec): min=548, max=133786, avg=11821.01, stdev=6367.01
lat (usec): min=548, max=133787, avg=11821.66, stdev=6371.14
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 39], 99.50th=[ 52], 99.90th=[ 74], 99.95th=[ 86],
| 99.99th=[ 134]
bw ( KiB/s): min= 2554, max=15592, per=0.19%, avg=10760.44, stdev=2282.39, samples=118
iops : min= 638, max= 3898, avg=2690.03, stdev=570.61, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=46.65%, 20=47.62%, 50=5.12%
lat (msec) : 100=0.54%, 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=66665, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.5%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.9%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160037,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11829: Fri Aug 13 21:22:57 2021
read: IOPS=2722, BW=10.6MiB/s (11.2MB/s)(638MiB/60012msec)
slat (nsec): min=110, max=576598, avg=335.69, stdev=1611.17
clat (usec): min=151, max=142720, avg=11491.74, stdev=5818.37
lat (usec): min=190, max=142721, avg=11492.07, stdev=5818.44
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 73], 99.95th=[ 90],
| 99.99th=[ 121]
bw ( KiB/s): min= 5109, max=15352, per=0.19%, avg=11093.65, stdev=2387.10, samples=117
iops : min= 1277, max= 3838, avg=2773.35, stdev=596.79, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=49.45%, 20=45.48%, 50=4.61%
lat (msec) : 100=0.33%, 250=0.02%
cpu : usr=0.45%, sys=0.34%, ctx=60606, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.2%, 16=56.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=163412,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11830: Fri Aug 13 21:22:57 2021
read: IOPS=2740, BW=10.7MiB/s (11.2MB/s)(642MiB/60012msec)
slat (nsec): min=110, max=8537.8k, avg=659.04, stdev=43243.50
clat (usec): min=130, max=267292, avg=11410.97, stdev=6573.90
lat (usec): min=419, max=267293, avg=11411.63, stdev=6574.04
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 38], 99.90th=[ 72], 99.95th=[ 155],
| 99.99th=[ 255]
bw ( KiB/s): min= 1756, max=14896, per=0.20%, avg=11153.93, stdev=2205.43, samples=117
iops : min= 439, max= 3724, avg=2788.43, stdev=551.35, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=48.63%, 20=47.34%, 50=3.70%
lat (msec) : 100=0.20%, 250=0.04%, 500=0.01%
cpu : usr=0.48%, sys=0.31%, ctx=63937, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.1%, 16=64.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.5%, 16=1.4%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164451,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11831: Fri Aug 13 21:22:57 2021
read: IOPS=2699, BW=10.5MiB/s (11.1MB/s)(633MiB/60012msec)
slat (nsec): min=110, max=3632.6k, avg=425.33, stdev=14773.27
clat (usec): min=380, max=99194, avg=11649.45, stdev=5357.37
lat (usec): min=789, max=99194, avg=11649.88, stdev=5357.61
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12125], 80.00th=[13566], 90.00th=[16057], 95.00th=[19006],
| 99.00th=[30802], 99.50th=[38536], 99.90th=[83362], 99.95th=[90702],
| 99.99th=[95945]
bw ( KiB/s): min= 4920, max=14304, per=0.19%, avg=10978.19, stdev=1990.34, samples=117
iops : min= 1230, max= 3576, avg=2744.48, stdev=497.57, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=44.79%, 20=50.87%, 50=3.92%
lat (msec) : 100=0.30%
cpu : usr=0.47%, sys=0.32%, ctx=64527, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.8%, 16=55.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.1%, 16=0.4%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=162004,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11832: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60013msec)
slat (nsec): min=110, max=3082.1k, avg=344.25, stdev=7933.94
clat (usec): min=201, max=157604, avg=11642.19, stdev=5406.78
lat (usec): min=494, max=157604, avg=11642.53, stdev=5406.78
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 62], 99.95th=[ 71],
| 99.99th=[ 150]
bw ( KiB/s): min= 6648, max=14592, per=0.19%, avg=11005.18, stdev=1694.49, samples=117
iops : min= 1662, max= 3648, avg=2751.22, stdev=423.60, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=44.95%, 20=50.49%, 50=4.18%
lat (msec) : 100=0.27%, 250=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=65469, majf=0, minf=32
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.6%, 16=53.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162054,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11833: Fri Aug 13 21:22:57 2021
read: IOPS=2860, BW=11.2MiB/s (11.7MB/s)(671MiB/60015msec)
slat (nsec): min=110, max=186870, avg=325.35, stdev=1119.18
clat (usec): min=166, max=109675, avg=10956.55, stdev=4304.08
lat (usec): min=293, max=109675, avg=10956.87, stdev=4304.09
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 32], 99.90th=[ 59], 99.95th=[ 69],
| 99.99th=[ 108]
bw ( KiB/s): min= 5376, max=14568, per=0.20%, avg=11650.60, stdev=1928.02, samples=117
iops : min= 1344, max= 3642, avg=2912.58, stdev=481.99, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=51.43%, 20=45.76%, 50=2.53%
lat (msec) : 100=0.19%, 250=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=64260, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=171690,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11834: Fri Aug 13 21:22:57 2021
read: IOPS=2669, BW=10.4MiB/s (10.9MB/s)(626MiB/60013msec)
slat (nsec): min=110, max=2597.4k, avg=374.13, stdev=8334.54
clat (usec): min=174, max=95952, avg=11724.41, stdev=5604.10
lat (usec): min=179, max=95952, avg=11724.78, stdev=5604.12
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[10945],
| 70.00th=[11994], 80.00th=[13566], 90.00th=[16188], 95.00th=[20055],
| 99.00th=[35914], 99.50th=[46924], 99.90th=[70779], 99.95th=[74974],
| 99.99th=[82314]
bw ( KiB/s): min= 6400, max=15360, per=0.19%, avg=10861.45, stdev=2042.54, samples=117
iops : min= 1600, max= 3840, avg=2715.31, stdev=510.64, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=45.41%, 20=49.33%, 50=4.85%
lat (msec) : 100=0.31%
cpu : usr=0.48%, sys=0.32%, ctx=66986, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.8%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160176,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11835: Fri Aug 13 21:22:57 2021
read: IOPS=2840, BW=11.1MiB/s (11.6MB/s)(666MiB/60010msec)
slat (nsec): min=90, max=11789k, avg=391.65, stdev=28565.26
clat (usec): min=751, max=152494, avg=11055.85, stdev=4876.96
lat (usec): min=751, max=152495, avg=11056.24, stdev=4876.99
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 67], 99.95th=[ 75],
| 99.99th=[ 144]
bw ( KiB/s): min= 5376, max=14592, per=0.20%, avg=11563.85, stdev=1885.59, samples=117
iops : min= 1344, max= 3648, avg=2890.91, stdev=471.38, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=51.70%, 20=44.41%, 50=3.50%
lat (msec) : 100=0.19%, 250=0.02%
cpu : usr=0.50%, sys=0.32%, ctx=63881, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.2%, 16=1.3%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=170434,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11836: Fri Aug 13 21:22:57 2021
read: IOPS=2680, BW=10.5MiB/s (11.0MB/s)(629MiB/60051msec)
slat (nsec): min=109, max=1368.2k, avg=345.00, stdev=3631.03
clat (usec): min=356, max=110606, avg=11724.39, stdev=5698.47
lat (usec): min=356, max=110606, avg=11724.74, stdev=5698.49
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 47], 99.90th=[ 74], 99.95th=[ 91],
| 99.99th=[ 108]
bw ( KiB/s): min= 5432, max=15360, per=0.19%, avg=10919.36, stdev=1973.57, samples=117
iops : min= 1358, max= 3840, avg=2729.79, stdev=493.37, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.02%, 10=44.45%, 20=50.70%, 50=4.43%
lat (msec) : 100=0.37%, 250=0.02%
cpu : usr=0.51%, sys=0.30%, ctx=64215, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=160957,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11837: Fri Aug 13 21:22:57 2021
read: IOPS=2832, BW=11.1MiB/s (11.6MB/s)(664MiB/60017msec)
slat (nsec): min=110, max=1615.5k, avg=344.52, stdev=4746.83
clat (usec): min=30, max=137283, avg=11100.07, stdev=5475.39
lat (usec): min=283, max=137283, avg=11100.41, stdev=5475.51
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 33], 99.50th=[ 46], 99.90th=[ 79], 99.95th=[ 86],
| 99.99th=[ 111]
bw ( KiB/s): min= 510, max=15360, per=0.20%, avg=11428.97, stdev=2319.66, samples=118
iops : min= 127, max= 3840, avg=2857.20, stdev=579.96, samples=118
lat (usec) : 50=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=53.76%, 20=42.40%, 50=3.34%
lat (msec) : 100=0.39%, 250=0.02%
cpu : usr=0.54%, sys=0.27%, ctx=64109, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.8%, 16=59.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=169990,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11838: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60034msec)
slat (nsec): min=119, max=11827k, avg=524.67, stdev=32846.00
clat (usec): min=163, max=166184, avg=11604.31, stdev=5357.27
lat (usec): min=229, max=166185, avg=11604.84, stdev=5357.23
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 69], 99.95th=[ 80],
| 99.99th=[ 167]
bw ( KiB/s): min= 5620, max=14344, per=0.19%, avg=10994.22, stdev=1869.70, samples=117
iops : min= 1405, max= 3586, avg=2748.50, stdev=467.41, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=43.84%, 20=51.57%, 50=4.24%
lat (msec) : 100=0.25%, 250=0.02%
cpu : usr=0.45%, sys=0.36%, ctx=65574, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.3%, 16=51.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.2%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162115,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11839: Fri Aug 13 21:22:57 2021
read: IOPS=2586, BW=10.1MiB/s (10.6MB/s)(607MiB/60052msec)
slat (nsec): min=119, max=258955, avg=330.59, stdev=1334.53
clat (usec): min=248, max=134863, avg=12188.05, stdev=6460.38
lat (usec): min=270, max=134863, avg=12188.38, stdev=6460.39
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 48], 99.90th=[ 83], 99.95th=[ 117],
| 99.99th=[ 136]
bw ( KiB/s): min= 3321, max=14848, per=0.18%, avg=10450.01, stdev=2001.42, samples=118
iops : min= 830, max= 3712, avg=2612.43, stdev=500.34, samples=118
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=39.63%, 20=54.07%, 50=5.73%
lat (msec) : 100=0.40%, 250=0.07%
cpu : usr=0.51%, sys=0.28%, ctx=61053, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.1%, 16=56.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.9%, 16=0.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=155336,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11840: Fri Aug 13 21:22:57 2021
read: IOPS=2705, BW=10.6MiB/s (11.1MB/s)(634MiB/60015msec)
slat (nsec): min=119, max=115298, avg=318.86, stdev=657.62
clat (usec): min=273, max=178683, avg=11609.29, stdev=5713.71
lat (usec): min=379, max=178689, avg=11609.61, stdev=5713.73
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 80], 99.95th=[ 92],
| 99.99th=[ 180]
bw ( KiB/s): min= 5620, max=15584, per=0.19%, avg=11045.12, stdev=1887.05, samples=117
iops : min= 1405, max= 3896, avg=2761.21, stdev=471.77, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=44.41%, 20=51.21%, 50=4.09%
lat (msec) : 100=0.24%, 250=0.04%
cpu : usr=0.50%, sys=0.30%, ctx=65302, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.9%, 16=53.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162379,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11841: Fri Aug 13 21:22:57 2021
read: IOPS=2753, BW=10.8MiB/s (11.3MB/s)(646MiB/60031msec)
slat (nsec): min=120, max=3004.9k, avg=401.28, stdev=11044.73
clat (usec): min=167, max=130833, avg=11515.63, stdev=5845.88
lat (usec): min=325, max=130834, avg=11516.03, stdev=5845.84
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 44], 99.90th=[ 68], 99.95th=[ 89],
| 99.99th=[ 129]
bw ( KiB/s): min= 4598, max=19113, per=0.20%, avg=11136.61, stdev=2145.63, samples=118
iops : min= 1149, max= 4778, avg=2784.10, stdev=536.39, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.96%, 10=46.19%, 20=47.81%, 50=4.69%
lat (msec) : 100=0.30%, 250=0.04%
cpu : usr=0.47%, sys=0.34%, ctx=67087, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.4%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=165322,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11842: Fri Aug 13 21:22:57 2021
read: IOPS=2794, BW=10.9MiB/s (11.4MB/s)(655MiB/60011msec)
slat (nsec): min=110, max=161932, avg=336.04, stdev=675.44
clat (usec): min=264, max=101678, avg=11216.06, stdev=4862.67
lat (usec): min=270, max=101679, avg=11216.40, stdev=4862.70
clat percentiles (usec):
| 1.00th=[ 6718], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11469], 80.00th=[12780], 90.00th=[15270], 95.00th=[18482],
| 99.00th=[32375], 99.50th=[41157], 99.90th=[58459], 99.95th=[64226],
| 99.99th=[79168]
bw ( KiB/s): min= 6890, max=15800, per=0.20%, avg=11385.03, stdev=1986.98, samples=117
iops : min= 1722, max= 3950, avg=2846.21, stdev=496.77, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=51.31%, 20=44.78%, 50=3.62%
lat (msec) : 100=0.22%, 250=0.01%
cpu : usr=0.55%, sys=0.24%, ctx=65168, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=61.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.0%, 16=1.1%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167697,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11843: Fri Aug 13 21:22:57 2021
read: IOPS=2723, BW=10.6MiB/s (11.2MB/s)(638MiB/60016msec)
slat (nsec): min=119, max=7532.8k, avg=370.76, stdev=18644.32
clat (usec): min=208, max=116090, avg=11535.24, stdev=5290.49
lat (usec): min=232, max=116090, avg=11535.61, stdev=5290.82
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 42], 99.90th=[ 63], 99.95th=[ 77],
| 99.99th=[ 105]
bw ( KiB/s): min= 4352, max=14848, per=0.20%, avg=11103.35, stdev=2123.68, samples=117
iops : min= 1088, max= 3712, avg=2775.79, stdev=530.92, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=46.53%, 20=48.66%, 50=4.55%
lat (msec) : 100=0.19%, 250=0.02%
cpu : usr=0.48%, sys=0.32%, ctx=64533, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.9%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163444,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11844: Fri Aug 13 21:22:57 2021
read: IOPS=2815, BW=11.0MiB/s (11.5MB/s)(660MiB/60014msec)
slat (nsec): min=110, max=131645, avg=318.70, stdev=633.37
clat (usec): min=168, max=117450, avg=11248.11, stdev=5744.52
lat (usec): min=174, max=117450, avg=11248.43, stdev=5744.55
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 78], 99.95th=[ 88],
| 99.99th=[ 109]
bw ( KiB/s): min= 5128, max=18874, per=0.20%, avg=11400.12, stdev=2308.59, samples=118
iops : min= 1282, max= 4718, avg=2849.98, stdev=577.12, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.85%, 10=50.24%, 20=44.38%, 50=4.20%
lat (msec) : 100=0.31%, 250=0.02%
cpu : usr=0.51%, sys=0.30%, ctx=64586, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=168945,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11845: Fri Aug 13 21:22:57 2021
read: IOPS=2842, BW=11.1MiB/s (11.6MB/s)(666MiB/60007msec)
slat (nsec): min=110, max=7853.2k, avg=449.10, stdev=23009.48
clat (usec): min=99, max=143741, avg=11071.97, stdev=4871.69
lat (usec): min=649, max=143742, avg=11072.42, stdev=4871.54
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 34], 99.90th=[ 64], 99.95th=[ 77],
| 99.99th=[ 144]
bw ( KiB/s): min= 5620, max=15384, per=0.20%, avg=11480.36, stdev=1939.71, samples=118
iops : min= 1405, max= 3846, avg=2870.02, stdev=484.94, samples=118
lat (usec) : 100=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=49.98%, 20=46.74%, 50=2.99%
lat (msec) : 100=0.19%, 250=0.03%
cpu : usr=0.51%, sys=0.32%, ctx=65982, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.1%, 16=1.4%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=170569,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11846: Fri Aug 13 21:22:57 2021
read: IOPS=2873, BW=11.2MiB/s (11.8MB/s)(674MiB/60003msec)
slat (nsec): min=110, max=8307.6k, avg=362.88, stdev=20026.88
clat (usec): min=245, max=327786, avg=10911.48, stdev=6201.67
lat (usec): min=251, max=327787, avg=10911.84, stdev=6201.65
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 63], 99.95th=[ 90],
| 99.99th=[ 326]
bw ( KiB/s): min= 2554, max=15712, per=0.21%, avg=11700.98, stdev=2196.14, samples=117
iops : min= 638, max= 3928, avg=2925.20, stdev=549.08, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=53.80%, 20=42.97%, 50=2.91%
lat (msec) : 100=0.16%, 250=0.02%, 500=0.02%
cpu : usr=0.52%, sys=0.30%, ctx=61604, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.4%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=172428,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11847: Fri Aug 13 21:22:57 2021
read: IOPS=2775, BW=10.8MiB/s (11.4MB/s)(650MiB/60004msec)
slat (nsec): min=119, max=159584, avg=320.85, stdev=812.76
clat (usec): min=1580, max=93796, avg=11339.23, stdev=5135.66
lat (usec): min=1581, max=93797, avg=11339.55, stdev=5135.68
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15533], 95.00th=[19530],
| 99.00th=[33424], 99.50th=[40109], 99.90th=[61604], 99.95th=[72877],
| 99.99th=[84411]
bw ( KiB/s): min= 1988, max=15576, per=0.20%, avg=11197.81, stdev=2221.51, samples=118
iops : min= 497, max= 3894, avg=2799.38, stdev=555.36, samples=118
lat (msec) : 2=0.01%, 4=0.11%, 10=50.01%, 20=45.25%, 50=4.40%
lat (msec) : 100=0.23%
cpu : usr=0.48%, sys=0.32%, ctx=59391, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.2%, 16=56.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.7%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=166523,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11848: Fri Aug 13 21:22:57 2021
read: IOPS=2729, BW=10.7MiB/s (11.2MB/s)(640MiB/60032msec)
slat (nsec): min=119, max=1564.1k, avg=362.59, stdev=6447.39
clat (usec): min=677, max=154862, avg=11514.19, stdev=5505.81
lat (usec): min=688, max=154863, avg=11514.55, stdev=5505.81
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 39], 99.90th=[ 79], 99.95th=[ 115],
| 99.99th=[ 118]
bw ( KiB/s): min= 3328, max=14680, per=0.20%, avg=11148.68, stdev=1984.99, samples=117
iops : min= 832, max= 3670, avg=2787.10, stdev=496.25, samples=117
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=45.73%, 20=50.01%, 50=3.88%
lat (msec) : 100=0.15%, 250=0.07%
cpu : usr=0.46%, sys=0.32%, ctx=63764, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.6%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.8%, 16=0.6%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163868,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11849: Fri Aug 13 21:22:57 2021
read: IOPS=2563, BW=10.0MiB/s (10.5MB/s)(601MiB/60008msec)
slat (nsec): min=110, max=5180.1k, avg=365.71, stdev=14135.51
clat (usec): min=735, max=122514, avg=12234.55, stdev=6417.91
lat (usec): min=740, max=122514, avg=12234.91, stdev=6418.35
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 39], 99.50th=[ 47], 99.90th=[ 83], 99.95th=[ 95],
| 99.99th=[ 122]
bw ( KiB/s): min= 4864, max=15872, per=0.18%, avg=10437.98, stdev=2096.76, samples=117
iops : min= 1216, max= 3968, avg=2609.42, stdev=524.16, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=41.20%, 20=51.76%, 50=6.51%
lat (msec) : 100=0.41%, 250=0.04%
cpu : usr=0.45%, sys=0.33%, ctx=63536, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=153857,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11850: Fri Aug 13 21:22:57 2021
read: IOPS=2908, BW=11.4MiB/s (11.9MB/s)(682MiB/60003msec)
slat (nsec): min=110, max=1699.3k, avg=332.83, stdev=4413.21
clat (usec): min=1393, max=101317, avg=10966.03, stdev=4579.16
lat (usec): min=1394, max=101318, avg=10966.37, stdev=4579.18
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 57], 99.95th=[ 71],
| 99.99th=[ 102]
bw ( KiB/s): min= 6144, max=25608, per=0.21%, avg=11675.74, stdev=2279.47, samples=119
iops : min= 1536, max= 6402, avg=2918.87, stdev=569.85, samples=119
lat (msec) : 2=0.01%, 4=1.82%, 10=49.47%, 20=45.30%, 50=3.28%
lat (msec) : 100=0.11%, 250=0.01%
cpu : usr=0.55%, sys=0.29%, ctx=64576, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.5%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.7%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=174500,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11851: Fri Aug 13 21:22:57 2021
read: IOPS=2830, BW=11.1MiB/s (11.6MB/s)(663MiB/60014msec)
slat (nsec): min=119, max=66043, avg=309.77, stdev=567.31
clat (usec): min=1805, max=158700, avg=11140.64, stdev=5635.24
lat (usec): min=1808, max=158700, avg=11140.95, stdev=5635.26
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 41], 99.90th=[ 71], 99.95th=[ 86],
| 99.99th=[ 159]
bw ( KiB/s): min= 6131, max=14736, per=0.20%, avg=11426.06, stdev=2062.70, samples=118
iops : min= 1532, max= 3684, avg=2856.44, stdev=515.74, samples=118
lat (msec) : 2=0.01%, 4=0.08%, 10=53.85%, 20=42.06%, 50=3.73%
lat (msec) : 100=0.24%, 250=0.03%
cpu : usr=0.47%, sys=0.34%, ctx=62427, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.0%, 16=0.5%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169850,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11852: Fri Aug 13 21:22:57 2021
read: IOPS=2894, BW=11.3MiB/s (11.9MB/s)(678MiB/60011msec)
slat (nsec): min=119, max=1234.0k, avg=322.35, stdev=3078.64
clat (usec): min=97, max=246827, avg=10811.85, stdev=4932.21
lat (usec): min=322, max=246827, avg=10812.18, stdev=4932.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 24], 99.50th=[ 27], 99.90th=[ 52], 99.95th=[ 109],
| 99.99th=[ 209]
bw ( KiB/s): min= 4854, max=14976, per=0.21%, avg=11787.20, stdev=1916.05, samples=117
iops : min= 1213, max= 3744, avg=2946.73, stdev=479.02, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.22%, 10=52.24%, 20=45.39%, 50=2.04%
lat (msec) : 100=0.06%, 250=0.06%
cpu : usr=0.49%, sys=0.31%, ctx=64339, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.5%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=173692,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11853: Fri Aug 13 21:22:57 2021
read: IOPS=2738, BW=10.7MiB/s (11.2MB/s)(642MiB/60013msec)
slat (nsec): min=100, max=146686, avg=332.32, stdev=1037.02
clat (usec): min=157, max=280484, avg=11450.22, stdev=6041.44
lat (usec): min=298, max=280488, avg=11450.56, stdev=6041.45
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 37], 99.90th=[ 59], 99.95th=[ 82],
| 99.99th=[ 271]
bw ( KiB/s): min= 1832, max=14848, per=0.20%, avg=11171.44, stdev=1998.81, samples=117
iops : min= 458, max= 3712, avg=2792.79, stdev=499.71, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=48.30%, 20=47.28%, 50=4.19%
lat (msec) : 100=0.13%, 250=0.02%, 500=0.02%
cpu : usr=0.48%, sys=0.33%, ctx=63862, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.6%, 16=58.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=164350,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11854: Fri Aug 13 21:22:57 2021
read: IOPS=2857, BW=11.2MiB/s (11.7MB/s)(670MiB/60045msec)
slat (nsec): min=110, max=1408.7k, avg=351.56, stdev=4115.68
clat (usec): min=599, max=92547, avg=10960.92, stdev=4222.81
lat (usec): min=623, max=92548, avg=10961.27, stdev=4222.81
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12780], 90.00th=[15008], 95.00th=[18482],
| 99.00th=[27132], 99.50th=[32637], 99.90th=[46400], 99.95th=[53216],
| 99.99th=[84411]
bw ( KiB/s): min= 6400, max=15344, per=0.20%, avg=11662.85, stdev=2025.00, samples=117
iops : min= 1600, max= 3836, avg=2915.65, stdev=506.24, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=53.68%, 20=42.53%, 50=3.61%
lat (msec) : 100=0.06%
cpu : usr=0.54%, sys=0.27%, ctx=63033, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.3%, 16=57.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.8%, 16=0.6%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=171602,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11855: Fri Aug 13 21:22:57 2021
read: IOPS=2889, BW=11.3MiB/s (11.8MB/s)(677MiB/60007msec)
slat (nsec): min=110, max=570914, avg=331.18, stdev=2380.28
clat (usec): min=376, max=175768, avg=11053.30, stdev=6223.54
lat (usec): min=436, max=175768, avg=11053.63, stdev=6223.55
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 97], 99.95th=[ 112],
| 99.99th=[ 157]
bw ( KiB/s): min= 4792, max=28416, per=0.20%, avg=11577.51, stdev=2909.55, samples=119
iops : min= 1198, max= 7104, avg=2894.31, stdev=727.38, samples=119
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=3.67%, 10=49.07%, 20=43.23%, 50=3.63%
lat (msec) : 100=0.30%, 250=0.08%
cpu : usr=0.52%, sys=0.20%, ctx=62647, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.4%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=173372,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11856: Fri Aug 13 21:22:57 2021
read: IOPS=2726, BW=10.6MiB/s (11.2MB/s)(639MiB/60008msec)
slat (nsec): min=110, max=1637.5k, avg=342.53, stdev=4541.18
clat (usec): min=350, max=136112, avg=11554.27, stdev=5599.20
lat (usec): min=375, max=136112, avg=11554.62, stdev=5599.21
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 44], 99.90th=[ 67], 99.95th=[ 83],
| 99.99th=[ 134]
bw ( KiB/s): min= 2554, max=15560, per=0.19%, avg=11005.09, stdev=2297.56, samples=118
iops : min= 638, max= 3890, avg=2751.22, stdev=574.43, samples=118
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=47.29%, 20=47.79%, 50=4.49%
lat (msec) : 100=0.31%, 250=0.02%
cpu : usr=0.44%, sys=0.36%, ctx=67360, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.3%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=163586,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11857: Fri Aug 13 21:22:57 2021
read: IOPS=2740, BW=10.7MiB/s (11.2MB/s)(643MiB/60031msec)
slat (nsec): min=100, max=1214.7k, avg=347.25, stdev=3137.76
clat (usec): min=581, max=163359, avg=11459.86, stdev=5607.25
lat (usec): min=582, max=164573, avg=11460.20, stdev=5607.47
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 64], 99.95th=[ 131],
| 99.99th=[ 161]
bw ( KiB/s): min= 6264, max=15104, per=0.20%, avg=11179.31, stdev=1920.93, samples=117
iops : min= 1566, max= 3776, avg=2794.75, stdev=480.22, samples=117
lat (usec) : 750=0.01%
lat (msec) : 4=0.06%, 10=47.02%, 20=48.73%, 50=4.04%, 100=0.08%
lat (msec) : 250=0.07%
cpu : usr=0.49%, sys=0.32%, ctx=60138, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=9.8%, 16=65.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.5%, 16=1.0%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=164541,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11858: Fri Aug 13 21:22:57 2021
read: IOPS=2873, BW=11.2MiB/s (11.8MB/s)(674MiB/60010msec)
slat (nsec): min=110, max=1939.9k, avg=378.02, stdev=6013.68
clat (usec): min=33, max=118872, avg=11096.93, stdev=5678.52
lat (usec): min=307, max=118872, avg=11097.31, stdev=5678.50
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 70], 99.95th=[ 78],
| 99.99th=[ 103]
bw ( KiB/s): min= 4752, max=32447, per=0.20%, avg=11503.21, stdev=3182.15, samples=119
iops : min= 1188, max= 8111, avg=2875.72, stdev=795.51, samples=119
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=3.61%, 10=49.24%, 20=42.69%, 50=4.16%
lat (msec) : 100=0.29%, 250=0.01%
cpu : usr=0.53%, sys=0.29%, ctx=69231, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=62.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.4%, 16=1.8%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=172467,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11859: Fri Aug 13 21:22:57 2021
read: IOPS=2762, BW=10.8MiB/s (11.3MB/s)(648MiB/60005msec)
slat (nsec): min=110, max=156233, avg=321.72, stdev=773.13
clat (usec): min=185, max=156695, avg=11339.20, stdev=5186.53
lat (usec): min=191, max=156696, avg=11339.53, stdev=5186.57
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 37], 99.90th=[ 63], 99.95th=[ 71],
| 99.99th=[ 148]
bw ( KiB/s): min= 4376, max=15048, per=0.20%, avg=11225.98, stdev=1941.09, samples=117
iops : min= 1094, max= 3762, avg=2806.44, stdev=485.31, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=48.99%, 20=47.13%, 50=3.67%
lat (msec) : 100=0.12%, 250=0.04%
cpu : usr=0.52%, sys=0.27%, ctx=59710, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=165762,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11860: Fri Aug 13 21:22:57 2021
read: IOPS=2680, BW=10.5MiB/s (11.0MB/s)(629MiB/60036msec)
slat (nsec): min=110, max=4408.1k, avg=359.18, stdev=12660.93
clat (usec): min=505, max=141059, avg=11683.85, stdev=6205.83
lat (usec): min=559, max=141059, avg=11684.21, stdev=6205.80
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 50], 99.90th=[ 78], 99.95th=[ 82],
| 99.99th=[ 140]
bw ( KiB/s): min= 3832, max=15168, per=0.19%, avg=10924.50, stdev=2263.81, samples=117
iops : min= 958, max= 3792, avg=2731.06, stdev=565.97, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=48.82%, 20=45.41%, 50=5.16%
lat (msec) : 100=0.44%, 250=0.02%
cpu : usr=0.45%, sys=0.33%, ctx=63904, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.4%, 16=1.8%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=160897,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11861: Fri Aug 13 21:22:57 2021
read: IOPS=2823, BW=11.0MiB/s (11.6MB/s)(662MiB/60010msec)
slat (nsec): min=110, max=13060k, avg=476.37, stdev=38992.50
clat (usec): min=215, max=165493, avg=11303.58, stdev=6546.93
lat (usec): min=237, max=165493, avg=11304.06, stdev=6547.00
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 48], 99.90th=[ 81], 99.95th=[ 105],
| 99.99th=[ 159]
bw ( KiB/s): min= 2768, max=33213, per=0.20%, avg=11301.13, stdev=3635.64, samples=119
iops : min= 692, max= 8303, avg=2825.21, stdev=908.89, samples=119
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=4.20%, 10=45.45%, 20=45.43%, 50=4.52%
lat (msec) : 100=0.34%, 250=0.06%
cpu : usr=0.47%, sys=0.24%, ctx=60128, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.5%, 16=58.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.7%, 16=1.0%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=169410,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11862: Fri Aug 13 21:22:57 2021
read: IOPS=2918, BW=11.4MiB/s (12.0MB/s)(684MiB/60025msec)
slat (nsec): min=110, max=1116.8k, avg=315.35, stdev=3602.21
clat (usec): min=1533, max=84659, avg=10751.11, stdev=4613.77
lat (usec): min=1533, max=84659, avg=10751.43, stdev=4613.86
clat percentiles (usec):
| 1.00th=[ 6063], 5.00th=[ 7308], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[12387], 90.00th=[14484], 95.00th=[17433],
| 99.00th=[27919], 99.50th=[35390], 99.90th=[67634], 99.95th=[72877],
| 99.99th=[79168]
bw ( KiB/s): min= 3960, max=15608, per=0.21%, avg=11899.50, stdev=2152.24, samples=117
iops : min= 990, max= 3902, avg=2974.81, stdev=538.06, samples=117
lat (msec) : 2=0.01%, 4=0.19%, 10=57.05%, 20=39.64%, 50=2.91%
lat (msec) : 100=0.21%
cpu : usr=0.47%, sys=0.34%, ctx=64393, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.5%, 16=53.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=175163,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11863: Fri Aug 13 21:22:57 2021
read: IOPS=2891, BW=11.3MiB/s (11.8MB/s)(678MiB/60026msec)
slat (nsec): min=100, max=497151, avg=313.08, stdev=1523.08
clat (usec): min=1150, max=143836, avg=11041.70, stdev=5720.03
lat (usec): min=1150, max=143837, avg=11042.02, stdev=5720.04
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 42], 99.90th=[ 72], 99.95th=[ 102],
| 99.99th=[ 123]
bw ( KiB/s): min= 4280, max=33189, per=0.20%, avg=11581.22, stdev=3408.45, samples=119
iops : min= 1070, max= 8297, avg=2895.24, stdev=852.10, samples=119
lat (msec) : 2=0.01%, 4=3.95%, 10=46.85%, 20=45.05%, 50=3.84%
lat (msec) : 100=0.26%, 250=0.05%
cpu : usr=0.49%, sys=0.24%, ctx=64998, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.5%, 16=1.1%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=173540,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11864: Fri Aug 13 21:22:57 2021
read: IOPS=2865, BW=11.2MiB/s (11.7MB/s)(672MiB/60009msec)
slat (nsec): min=110, max=82902, avg=313.69, stdev=599.88
clat (usec): min=312, max=134615, avg=11003.73, stdev=5176.38
lat (usec): min=318, max=134620, avg=11004.04, stdev=5176.40
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 39], 99.90th=[ 75], 99.95th=[ 92],
| 99.99th=[ 129]
bw ( KiB/s): min= 5333, max=15440, per=0.20%, avg=11564.70, stdev=2101.24, samples=118
iops : min= 1333, max= 3860, avg=2891.11, stdev=525.33, samples=118
lat (usec) : 500=0.01%
lat (msec) : 4=0.14%, 10=53.31%, 20=43.12%, 50=3.21%, 100=0.18%
lat (msec) : 250=0.03%
cpu : usr=0.53%, sys=0.29%, ctx=63884, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.2%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=171949,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11865: Fri Aug 13 21:22:57 2021
read: IOPS=2817, BW=11.0MiB/s (11.5MB/s)(661MiB/60044msec)
slat (nsec): min=110, max=4213.2k, avg=361.10, stdev=10642.55
clat (usec): min=632, max=210639, avg=11225.38, stdev=5982.59
lat (usec): min=637, max=210639, avg=11225.74, stdev=5982.58
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 44], 99.90th=[ 73], 99.95th=[ 96],
| 99.99th=[ 205]
bw ( KiB/s): min= 3065, max=15824, per=0.20%, avg=11377.14, stdev=2106.84, samples=118
iops : min= 766, max= 3956, avg=2844.21, stdev=526.70, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.53%, 10=49.06%, 20=46.93%, 50=3.08%
lat (msec) : 100=0.37%, 250=0.03%
cpu : usr=0.49%, sys=0.33%, ctx=63844, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.4%, 16=57.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=169149,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11866: Fri Aug 13 21:22:57 2021
read: IOPS=2897, BW=11.3MiB/s (11.9MB/s)(679MiB/60007msec)
slat (nsec): min=110, max=800898, avg=309.29, stdev=2061.78
clat (usec): min=478, max=111193, avg=11010.63, stdev=5218.95
lat (usec): min=505, max=111193, avg=11010.94, stdev=5218.96
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 37], 99.90th=[ 71], 99.95th=[ 80],
| 99.99th=[ 111]
bw ( KiB/s): min= 5128, max=25064, per=0.20%, avg=11618.52, stdev=2605.23, samples=119
iops : min= 1282, max= 6266, avg=2904.58, stdev=651.31, samples=119
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=3.38%, 10=47.45%, 20=45.58%, 50=3.32%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.47%, sys=0.25%, ctx=62422, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.9%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=173871,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11867: Fri Aug 13 21:22:57 2021
read: IOPS=2911, BW=11.4MiB/s (11.9MB/s)(683MiB/60025msec)
slat (nsec): min=119, max=1852.2k, avg=354.84, stdev=5597.08
clat (usec): min=624, max=215961, avg=10760.83, stdev=4838.77
lat (usec): min=624, max=215961, avg=10761.19, stdev=4838.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 32], 99.90th=[ 57], 99.95th=[ 83],
| 99.99th=[ 167]
bw ( KiB/s): min= 4822, max=15400, per=0.21%, avg=11856.60, stdev=1919.63, samples=117
iops : min= 1205, max= 3850, avg=2964.09, stdev=479.92, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=55.15%, 20=42.17%, 50=2.51%
lat (msec) : 100=0.07%, 250=0.04%
cpu : usr=0.53%, sys=0.26%, ctx=65569, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.8%, 16=63.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.9%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=174770,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11868: Fri Aug 13 21:22:57 2021
read: IOPS=2880, BW=11.3MiB/s (11.8MB/s)(675MiB/60014msec)
slat (nsec): min=110, max=440595, avg=319.58, stdev=1424.65
clat (usec): min=1163, max=191124, avg=10923.90, stdev=5446.95
lat (usec): min=1163, max=191124, avg=10924.22, stdev=5446.96
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 73], 99.95th=[ 109],
| 99.99th=[ 188]
bw ( KiB/s): min= 2043, max=14936, per=0.20%, avg=11629.13, stdev=2242.61, samples=118
iops : min= 510, max= 3734, avg=2907.21, stdev=560.66, samples=118
lat (msec) : 2=0.01%, 4=0.09%, 10=53.07%, 20=43.72%, 50=2.94%
lat (msec) : 100=0.12%, 250=0.05%
cpu : usr=0.51%, sys=0.32%, ctx=66188, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.4%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=172899,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11869: Fri Aug 13 21:22:57 2021
read: IOPS=2831, BW=11.1MiB/s (11.6MB/s)(664MiB/60010msec)
slat (nsec): min=110, max=1144.1k, avg=328.06, stdev=2864.16
clat (usec): min=492, max=143378, avg=11067.47, stdev=4707.67
lat (usec): min=497, max=143378, avg=11067.80, stdev=4707.70
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 35], 99.90th=[ 67], 99.95th=[ 80],
| 99.99th=[ 136]
bw ( KiB/s): min= 7640, max=14243, per=0.20%, avg=11536.09, stdev=1684.05, samples=117
iops : min= 1910, max= 3560, avg=2883.95, stdev=421.02, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=49.53%, 20=47.60%, 50=2.56%
lat (msec) : 100=0.17%, 250=0.03%
cpu : usr=0.54%, sys=0.26%, ctx=63727, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.3%, 16=0.7%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=169912,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11870: Fri Aug 13 21:22:57 2021
read: IOPS=2738, BW=10.7MiB/s (11.2MB/s)(642MiB/60011msec)
slat (nsec): min=110, max=511950, avg=338.07, stdev=2048.18
clat (usec): min=260, max=124066, avg=11556.49, stdev=6093.57
lat (usec): min=281, max=124067, avg=11556.83, stdev=6093.59
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 48], 99.90th=[ 78], 99.95th=[ 101],
| 99.99th=[ 125]
bw ( KiB/s): min= 4864, max=19369, per=0.19%, avg=11038.99, stdev=2330.41, samples=118
iops : min= 1216, max= 4842, avg=2759.69, stdev=582.60, samples=118
lat (usec) : 500=0.01%
lat (msec) : 4=0.65%, 10=47.97%, 20=46.02%, 50=4.92%, 100=0.40%
lat (msec) : 250=0.05%
cpu : usr=0.51%, sys=0.29%, ctx=67325, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.6%, 16=53.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=164357,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11871: Fri Aug 13 21:22:57 2021
read: IOPS=2826, BW=11.0MiB/s (11.6MB/s)(663MiB/60011msec)
slat (nsec): min=110, max=5104.6k, avg=360.11, stdev=12411.84
clat (usec): min=268, max=97285, avg=11113.35, stdev=5018.25
lat (usec): min=297, max=97286, avg=11113.71, stdev=5018.67
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12518], 90.00th=[15139], 95.00th=[18744],
| 99.00th=[31851], 99.50th=[38536], 99.90th=[65274], 99.95th=[71828],
| 99.99th=[83362]
bw ( KiB/s): min= 5632, max=15360, per=0.20%, avg=11527.26, stdev=2068.43, samples=117
iops : min= 1408, max= 3840, avg=2881.76, stdev=517.11, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=53.84%, 20=41.90%, 50=3.95%
lat (msec) : 100=0.25%
cpu : usr=0.54%, sys=0.27%, ctx=64816, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=60.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.9%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=169629,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11872: Fri Aug 13 21:22:57 2021
read: IOPS=2650, BW=10.4MiB/s (10.9MB/s)(621MiB/60011msec)
slat (nsec): min=110, max=84104k, avg=865.78, stdev=210880.21
clat (usec): min=1282, max=86920, avg=11951.12, stdev=5946.78
lat (usec): min=1282, max=166818, avg=11951.99, stdev=5956.81
clat percentiles (usec):
| 1.00th=[ 3589], 5.00th=[ 7439], 10.00th=[ 7963], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12387], 80.00th=[13960], 90.00th=[17433], 95.00th=[21365],
| 99.00th=[35914], 99.50th=[42730], 99.90th=[79168], 99.95th=[82314],
| 99.99th=[83362]
bw ( KiB/s): min= 3840, max=22994, per=0.19%, avg=10684.32, stdev=2492.84, samples=118
iops : min= 960, max= 5748, avg=2671.04, stdev=623.22, samples=118
lat (msec) : 2=0.01%, 4=1.20%, 10=43.40%, 20=49.02%, 50=6.03%
lat (msec) : 100=0.35%
cpu : usr=0.43%, sys=0.35%, ctx=64580, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=159075,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11873: Fri Aug 13 21:22:57 2021
read: IOPS=2959, BW=11.6MiB/s (12.1MB/s)(694MiB/60043msec)
slat (nsec): min=110, max=340465, avg=311.97, stdev=1135.21
clat (usec): min=1968, max=92813, avg=10782.10, stdev=5238.67
lat (usec): min=1969, max=92813, avg=10782.42, stdev=5238.68
clat percentiles (usec):
| 1.00th=[ 2769], 5.00th=[ 5014], 10.00th=[ 7570], 20.00th=[ 8225],
| 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[14746], 95.00th=[18220],
| 99.00th=[32900], 99.50th=[42730], 99.90th=[60031], 99.95th=[67634],
| 99.99th=[87557]
bw ( KiB/s): min= 5632, max=39089, per=0.21%, avg=11873.14, stdev=3624.22, samples=119
iops : min= 1408, max= 9772, avg=2968.23, stdev=906.04, samples=119
lat (msec) : 2=0.01%, 4=4.44%, 10=50.44%, 20=41.20%, 50=3.65%
lat (msec) : 100=0.26%
cpu : usr=0.52%, sys=0.29%, ctx=65499, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=177719,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11874: Fri Aug 13 21:22:57 2021
read: IOPS=2948, BW=11.5MiB/s (12.1MB/s)(691MiB/60015msec)
slat (nsec): min=110, max=650350, avg=318.52, stdev=1661.43
clat (usec): min=1538, max=119368, avg=10631.51, stdev=3922.60
lat (usec): min=1538, max=119368, avg=10631.83, stdev=3922.67
clat percentiles (usec):
| 1.00th=[ 5932], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12125], 90.00th=[14091], 95.00th=[16909],
| 99.00th=[25560], 99.50th=[30016], 99.90th=[42730], 99.95th=[57934],
| 99.99th=[80217]
bw ( KiB/s): min= 7168, max=14856, per=0.21%, avg=12008.26, stdev=1748.33, samples=117
iops : min= 1792, max= 3714, avg=3002.03, stdev=437.13, samples=117
lat (msec) : 2=0.01%, 4=0.10%, 10=55.16%, 20=41.93%, 50=2.71%
lat (msec) : 100=0.08%, 250=0.01%
cpu : usr=0.56%, sys=0.26%, ctx=61759, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.6%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=176950,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11875: Fri Aug 13 21:22:57 2021
read: IOPS=2815, BW=11.0MiB/s (11.5MB/s)(660MiB/60005msec)
slat (nsec): min=110, max=10765k, avg=391.24, stdev=26284.50
clat (usec): min=374, max=280175, avg=11142.77, stdev=5677.97
lat (usec): min=1208, max=280176, avg=11143.16, stdev=5678.73
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 58], 99.95th=[ 74],
| 99.99th=[ 279]
bw ( KiB/s): min= 6144, max=14336, per=0.20%, avg=11462.26, stdev=1783.91, samples=117
iops : min= 1536, max= 3584, avg=2865.54, stdev=445.99, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=49.72%, 20=46.93%, 50=3.12%
lat (msec) : 100=0.16%, 500=0.02%
cpu : usr=0.52%, sys=0.30%, ctx=62884, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=168927,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11876: Fri Aug 13 21:22:57 2021
read: IOPS=3004, BW=11.7MiB/s (12.3MB/s)(704MiB/60013msec)
slat (nsec): min=110, max=581760, avg=330.30, stdev=2079.07
clat (usec): min=494, max=72596, avg=10552.03, stdev=3982.73
lat (usec): min=581, max=72596, avg=10552.36, stdev=3982.73
clat percentiles (usec):
| 1.00th=[ 3851], 5.00th=[ 7046], 10.00th=[ 7635], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[12125], 90.00th=[14222], 95.00th=[16909],
| 99.00th=[26346], 99.50th=[30802], 99.90th=[46400], 99.95th=[57410],
| 99.99th=[69731]
bw ( KiB/s): min= 7168, max=26043, per=0.21%, avg=12138.81, stdev=2397.86, samples=118
iops : min= 1792, max= 6510, avg=3034.64, stdev=599.44, samples=118
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=1.24%, 10=55.26%, 20=40.80%, 50=2.61%
lat (msec) : 100=0.07%
cpu : usr=0.52%, sys=0.33%, ctx=69737, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.9%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=180315,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11877: Fri Aug 13 21:22:57 2021
read: IOPS=2685, BW=10.5MiB/s (11.0MB/s)(629MiB/60007msec)
slat (nsec): min=110, max=184223, avg=316.18, stdev=779.65
clat (msec): min=2, max=267, avg=11.68, stdev= 6.87
lat (msec): min=2, max=267, avg=11.68, stdev= 6.87
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 45], 99.90th=[ 95], 99.95th=[ 101],
| 99.99th=[ 268]
bw ( KiB/s): min= 3832, max=15064, per=0.19%, avg=10923.91, stdev=2254.20, samples=117
iops : min= 958, max= 3766, avg=2730.85, stdev=563.57, samples=117
lat (msec) : 4=0.05%, 10=47.26%, 20=47.90%, 50=4.46%, 100=0.27%
lat (msec) : 250=0.04%, 500=0.02%
cpu : usr=0.42%, sys=0.38%, ctx=65312, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.9%, 16=52.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=161130,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11878: Fri Aug 13 21:22:57 2021
read: IOPS=2780, BW=10.9MiB/s (11.4MB/s)(652MiB/60007msec)
slat (nsec): min=110, max=465812, avg=309.88, stdev=1338.40
clat (msec): min=2, max=158, avg=11.31, stdev= 5.65
lat (msec): min=2, max=158, avg=11.31, stdev= 5.65
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 84], 99.95th=[ 131],
| 99.99th=[ 153]
bw ( KiB/s): min= 4087, max=15312, per=0.20%, avg=11238.74, stdev=2071.07, samples=118
iops : min= 1021, max= 3828, avg=2809.58, stdev=517.79, samples=118
lat (msec) : 4=0.12%, 10=48.87%, 20=47.19%, 50=3.62%, 100=0.14%
lat (msec) : 250=0.06%
cpu : usr=0.50%, sys=0.32%, ctx=65406, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.7%, 16=52.3%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166831,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11879: Fri Aug 13 21:22:57 2021
read: IOPS=2912, BW=11.4MiB/s (11.9MB/s)(683MiB/60008msec)
slat (nsec): min=100, max=9275.4k, avg=401.00, stdev=23317.25
clat (usec): min=313, max=225278, avg=10771.41, stdev=5424.00
lat (usec): min=448, max=225279, avg=10771.81, stdev=5423.97
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 63], 99.95th=[ 75],
| 99.99th=[ 226]
bw ( KiB/s): min= 7145, max=15104, per=0.21%, avg=11858.85, stdev=1900.94, samples=117
iops : min= 1786, max= 3776, avg=2964.56, stdev=475.18, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=57.64%, 20=39.16%, 50=2.89%
lat (msec) : 100=0.18%, 250=0.04%
cpu : usr=0.53%, sys=0.29%, ctx=65331, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=174764,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11880: Fri Aug 13 21:22:57 2021
read: IOPS=2709, BW=10.6MiB/s (11.1MB/s)(635MiB/60004msec)
slat (nsec): min=110, max=264933, avg=324.58, stdev=1329.00
clat (usec): min=209, max=332516, avg=11641.81, stdev=6789.83
lat (usec): min=232, max=332517, avg=11642.14, stdev=6789.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 66], 99.95th=[ 74],
| 99.99th=[ 330]
bw ( KiB/s): min= 4598, max=14600, per=0.19%, avg=10918.75, stdev=2074.31, samples=118
iops : min= 1149, max= 3650, avg=2729.58, stdev=518.59, samples=118
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=45.65%, 20=49.24%, 50=4.72%
lat (msec) : 100=0.27%, 500=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=65346, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.0%, 16=56.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162567,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11881: Fri Aug 13 21:22:57 2021
read: IOPS=2704, BW=10.6MiB/s (11.1MB/s)(634MiB/60012msec)
slat (nsec): min=110, max=385189, avg=319.58, stdev=1137.94
clat (usec): min=705, max=203260, avg=11573.74, stdev=6176.46
lat (usec): min=705, max=203260, avg=11574.06, stdev=6176.49
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 78], 99.95th=[ 118],
| 99.99th=[ 192]
bw ( KiB/s): min= 255, max=15104, per=0.19%, avg=11045.57, stdev=2071.03, samples=117
iops : min= 63, max= 3776, avg=2761.26, stdev=517.80, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=45.90%, 20=50.07%, 50=3.56%
lat (msec) : 100=0.29%, 250=0.07%
cpu : usr=0.51%, sys=0.28%, ctx=64787, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162309,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11882: Fri Aug 13 21:22:57 2021
read: IOPS=2834, BW=11.1MiB/s (11.6MB/s)(665MiB/60009msec)
slat (nsec): min=100, max=3554.3k, avg=446.80, stdev=14501.08
clat (usec): min=461, max=98794, avg=11119.20, stdev=4470.02
lat (usec): min=461, max=98795, avg=11119.65, stdev=4469.93
clat percentiles (usec):
| 1.00th=[ 6063], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[15270], 95.00th=[18220],
| 99.00th=[26870], 99.50th=[32375], 99.90th=[55837], 99.95th=[76022],
| 99.99th=[87557]
bw ( KiB/s): min= 1788, max=15145, per=0.20%, avg=11474.10, stdev=2038.52, samples=118
iops : min= 447, max= 3786, avg=2868.41, stdev=509.64, samples=118
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=50.39%, 20=45.87%, 50=3.45%
lat (msec) : 100=0.15%
cpu : usr=0.48%, sys=0.32%, ctx=60402, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.8%, 16=56.3%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=170116,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11883: Fri Aug 13 21:22:57 2021
read: IOPS=2713, BW=10.6MiB/s (11.1MB/s)(636MiB/60010msec)
slat (nsec): min=109, max=885160, avg=345.36, stdev=2430.09
clat (usec): min=53, max=91139, avg=11617.25, stdev=5186.98
lat (usec): min=272, max=91139, avg=11617.60, stdev=5186.99
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7504], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9765], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[11994], 80.00th=[13435], 90.00th=[16057], 95.00th=[19792],
| 99.00th=[32637], 99.50th=[42206], 99.90th=[60031], 99.95th=[74974],
| 99.99th=[88605]
bw ( KiB/s): min= 5109, max=16303, per=0.19%, avg=10968.37, stdev=1957.30, samples=118
iops : min= 1277, max= 4075, avg=2741.95, stdev=489.28, samples=118
lat (usec) : 100=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=45.15%, 20=49.96%, 50=4.57%
lat (msec) : 100=0.28%
cpu : usr=0.53%, sys=0.28%, ctx=67842, majf=0, minf=30
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162816,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11884: Fri Aug 13 21:22:57 2021
read: IOPS=2904, BW=11.3MiB/s (11.9MB/s)(681MiB/60024msec)
slat (nsec): min=119, max=1638.0k, avg=330.01, stdev=4434.22
clat (usec): min=253, max=303635, avg=10775.58, stdev=6597.51
lat (usec): min=430, max=303635, avg=10775.91, stdev=6597.60
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 31], 99.50th=[ 40], 99.90th=[ 66], 99.95th=[ 163],
| 99.99th=[ 296]
bw ( KiB/s): min= 255, max=14968, per=0.21%, avg=11824.82, stdev=2312.82, samples=117
iops : min= 63, max= 3742, avg=2956.06, stdev=578.22, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=57.49%, 20=39.38%, 50=2.72%
lat (msec) : 100=0.19%, 250=0.04%, 500=0.02%
cpu : usr=0.51%, sys=0.30%, ctx=64153, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.3%, 16=0.4%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=174354,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11885: Fri Aug 13 21:22:57 2021
read: IOPS=2729, BW=10.7MiB/s (11.2MB/s)(640MiB/60008msec)
slat (nsec): min=119, max=352734, avg=330.07, stdev=1848.58
clat (usec): min=82, max=144032, avg=11483.54, stdev=6180.75
lat (usec): min=397, max=144033, avg=11483.87, stdev=6180.76
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 46], 99.90th=[ 91], 99.95th=[ 105],
| 99.99th=[ 124]
bw ( KiB/s): min= 6056, max=15400, per=0.20%, avg=11101.50, stdev=2089.26, samples=117
iops : min= 1514, max= 3850, avg=2775.26, stdev=522.34, samples=117
lat (usec) : 100=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=49.52%, 20=45.99%, 50=3.99%
lat (msec) : 100=0.34%, 250=0.06%
cpu : usr=0.48%, sys=0.30%, ctx=62412, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.8%, 16=56.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163797,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11886: Fri Aug 13 21:22:57 2021
read: IOPS=2790, BW=10.9MiB/s (11.4MB/s)(654MiB/60007msec)
slat (nsec): min=100, max=784584, avg=325.41, stdev=2834.62
clat (usec): min=336, max=181125, avg=11244.32, stdev=5727.58
lat (usec): min=638, max=181126, avg=11244.65, stdev=5727.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 70], 99.95th=[ 140],
| 99.99th=[ 174]
bw ( KiB/s): min= 2304, max=16168, per=0.20%, avg=11360.26, stdev=2132.52, samples=117
iops : min= 576, max= 4042, avg=2839.96, stdev=533.13, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=49.88%, 20=46.54%, 50=3.27%
lat (msec) : 100=0.12%, 250=0.07%
cpu : usr=0.51%, sys=0.28%, ctx=66162, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.2%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167462,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11887: Fri Aug 13 21:22:57 2021
read: IOPS=2770, BW=10.8MiB/s (11.3MB/s)(650MiB/60010msec)
slat (nsec): min=110, max=156215, avg=315.58, stdev=745.55
clat (usec): min=262, max=112632, avg=11327.03, stdev=5161.31
lat (usec): min=418, max=112632, avg=11327.35, stdev=5161.32
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 40], 99.90th=[ 67], 99.95th=[ 87],
| 99.99th=[ 101]
bw ( KiB/s): min= 7152, max=14592, per=0.20%, avg=11296.33, stdev=1990.44, samples=117
iops : min= 1788, max= 3648, avg=2823.97, stdev=497.59, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.04%, 10=49.40%, 20=46.03%, 50=4.31%, 100=0.21%
lat (msec) : 250=0.01%
cpu : usr=0.48%, sys=0.33%, ctx=62890, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.5%, 16=53.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166272,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11888: Fri Aug 13 21:22:57 2021
read: IOPS=2768, BW=10.8MiB/s (11.3MB/s)(649MiB/60014msec)
slat (nsec): min=110, max=7146.1k, avg=480.86, stdev=26698.56
clat (usec): min=292, max=106583, avg=11376.56, stdev=5439.65
lat (usec): min=341, max=106584, avg=11377.04, stdev=5439.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 81], 99.95th=[ 92],
| 99.99th=[ 107]
bw ( KiB/s): min= 4343, max=15321, per=0.20%, avg=11174.38, stdev=2171.64, samples=118
iops : min= 1085, max= 3830, avg=2793.43, stdev=542.95, samples=118
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=49.78%, 20=45.53%, 50=4.29%
lat (msec) : 100=0.24%, 250=0.03%
cpu : usr=0.52%, sys=0.28%, ctx=67403, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.7%, 16=52.3%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166171,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11889: Fri Aug 13 21:22:57 2021
read: IOPS=2923, BW=11.4MiB/s (12.0MB/s)(685MiB/60015msec)
slat (nsec): min=100, max=117498, avg=313.20, stdev=595.13
clat (usec): min=1880, max=152984, avg=10730.09, stdev=4514.32
lat (usec): min=1881, max=152984, avg=10730.40, stdev=4514.33
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 33], 99.90th=[ 53], 99.95th=[ 88],
| 99.99th=[ 150]
bw ( KiB/s): min= 6440, max=14328, per=0.21%, avg=11902.44, stdev=1822.03, samples=117
iops : min= 1610, max= 3582, avg=2975.49, stdev=455.52, samples=117
lat (msec) : 2=0.01%, 4=0.03%, 10=55.95%, 20=40.98%, 50=2.92%
lat (msec) : 100=0.08%, 250=0.04%
cpu : usr=0.53%, sys=0.30%, ctx=65714, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.1%, 16=56.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=0.6%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=175459,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11890: Fri Aug 13 21:22:57 2021
read: IOPS=2959, BW=11.6MiB/s (12.1MB/s)(694MiB/60014msec)
slat (nsec): min=110, max=4022.6k, avg=333.71, stdev=9564.75
clat (usec): min=690, max=255456, avg=10616.71, stdev=5457.80
lat (usec): min=690, max=255457, avg=10617.04, stdev=5458.14
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 27], 99.50th=[ 34], 99.90th=[ 81], 99.95th=[ 94],
| 99.99th=[ 213]
bw ( KiB/s): min= 5512, max=15104, per=0.21%, avg=12061.59, stdev=2012.17, samples=117
iops : min= 1378, max= 3776, avg=3015.26, stdev=503.03, samples=117
lat (usec) : 750=0.01%
lat (msec) : 4=0.15%, 10=58.85%, 20=38.20%, 50=2.60%, 100=0.15%
lat (msec) : 250=0.04%, 500=0.01%
cpu : usr=0.49%, sys=0.31%, ctx=62942, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.1%, 16=1.9%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=177631,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11891: Fri Aug 13 21:22:57 2021
read: IOPS=2935, BW=11.5MiB/s (12.0MB/s)(689MiB/60047msec)
slat (nsec): min=110, max=197690, avg=325.29, stdev=877.67
clat (usec): min=455, max=161264, avg=10814.98, stdev=5504.09
lat (usec): min=455, max=161265, avg=10815.30, stdev=5504.12
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 86], 99.95th=[ 128],
| 99.99th=[ 161]
bw ( KiB/s): min= 6411, max=18083, per=0.21%, avg=11907.19, stdev=2078.24, samples=118
iops : min= 1602, max= 4520, avg=2976.73, stdev=519.58, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=55.74%, 20=41.24%, 50=2.74%
lat (msec) : 100=0.14%, 250=0.05%
cpu : usr=0.49%, sys=0.25%, ctx=65004, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.3%, 16=61.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.1%, 16=2.0%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=176296,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11892: Fri Aug 13 21:22:57 2021
read: IOPS=2648, BW=10.3MiB/s (10.8MB/s)(621MiB/60034msec)
slat (nsec): min=110, max=356694, avg=328.76, stdev=1729.21
clat (usec): min=233, max=165712, avg=11880.85, stdev=6357.28
lat (usec): min=239, max=165712, avg=11881.18, stdev=6357.29
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 48], 99.90th=[ 96], 99.95th=[ 116],
| 99.99th=[ 146]
bw ( KiB/s): min= 718, max=15272, per=0.19%, avg=10701.42, stdev=2171.19, samples=118
iops : min= 179, max= 3818, avg=2675.23, stdev=542.83, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=42.73%, 20=52.73%, 50=3.99%
lat (msec) : 100=0.38%, 250=0.06%
cpu : usr=0.52%, sys=0.28%, ctx=63856, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=158973,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11893: Fri Aug 13 21:22:57 2021
read: IOPS=2802, BW=10.9MiB/s (11.5MB/s)(657MiB/60010msec)
slat (nsec): min=110, max=138236, avg=319.34, stdev=875.34
clat (usec): min=767, max=145197, avg=11234.37, stdev=5350.76
lat (usec): min=767, max=145198, avg=11234.69, stdev=5350.78
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 65], 99.95th=[ 103],
| 99.99th=[ 146]
bw ( KiB/s): min= 1788, max=14968, per=0.20%, avg=11328.97, stdev=2203.81, samples=118
iops : min= 447, max= 3742, avg=2832.12, stdev=550.94, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 4=0.09%, 10=49.78%, 20=46.51%, 50=3.31%, 100=0.25%
lat (msec) : 250=0.05%
cpu : usr=0.52%, sys=0.29%, ctx=62808, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.1%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=168186,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11894: Fri Aug 13 21:22:57 2021
read: IOPS=2785, BW=10.9MiB/s (11.4MB/s)(653MiB/60004msec)
slat (nsec): min=119, max=2813.7k, avg=353.09, stdev=7398.03
clat (usec): min=465, max=113901, avg=11270.08, stdev=5310.69
lat (usec): min=466, max=113901, avg=11270.44, stdev=5310.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 75], 99.95th=[ 84],
| 99.99th=[ 104]
bw ( KiB/s): min= 6048, max=14848, per=0.20%, avg=11346.60, stdev=2112.21, samples=117
iops : min= 1512, max= 3712, avg=2836.60, stdev=528.05, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=49.55%, 20=46.61%, 50=3.47%
lat (msec) : 100=0.31%, 250=0.01%
cpu : usr=0.50%, sys=0.30%, ctx=62154, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=167156,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11895: Fri Aug 13 21:22:57 2021
read: IOPS=2735, BW=10.7MiB/s (11.2MB/s)(642MiB/60042msec)
slat (nsec): min=110, max=4132.5k, avg=338.89, stdev=10239.62
clat (usec): min=1714, max=147625, avg=11461.62, stdev=5091.65
lat (usec): min=1714, max=147625, avg=11461.96, stdev=5092.02
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 73], 99.95th=[ 88],
| 99.99th=[ 134]
bw ( KiB/s): min= 4854, max=15360, per=0.20%, avg=11163.30, stdev=1890.65, samples=117
iops : min= 1213, max= 3840, avg=2790.70, stdev=472.69, samples=117
lat (msec) : 2=0.01%, 4=0.04%, 10=46.00%, 20=49.98%, 50=3.79%
lat (msec) : 100=0.17%, 250=0.02%
cpu : usr=0.54%, sys=0.25%, ctx=62569, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.8%, 16=56.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=164236,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11896: Fri Aug 13 21:22:57 2021
read: IOPS=2636, BW=10.3MiB/s (10.8MB/s)(618MiB/60019msec)
slat (nsec): min=119, max=3372.2k, avg=350.03, stdev=8631.93
clat (usec): min=221, max=188224, avg=11899.94, stdev=5732.88
lat (usec): min=243, max=188225, avg=11900.29, stdev=5733.15
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 65], 99.95th=[ 77],
| 99.99th=[ 186]
bw ( KiB/s): min= 5333, max=15152, per=0.19%, avg=10746.36, stdev=2046.19, samples=117
iops : min= 1333, max= 3788, avg=2686.46, stdev=511.57, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.05%, 10=41.47%, 20=53.25%, 50=4.96%, 100=0.25%
lat (msec) : 250=0.02%
cpu : usr=0.49%, sys=0.30%, ctx=65192, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.7%, 16=58.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.4%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=158217,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11897: Fri Aug 13 21:22:57 2021
read: IOPS=2765, BW=10.8MiB/s (11.3MB/s)(648MiB/60022msec)
slat (nsec): min=100, max=1465.0k, avg=375.67, stdev=5593.87
clat (usec): min=318, max=122008, avg=11317.36, stdev=5176.26
lat (usec): min=331, max=122008, avg=11317.74, stdev=5176.24
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 67], 99.95th=[ 86],
| 99.99th=[ 104]
bw ( KiB/s): min= 6112, max=14906, per=0.20%, avg=11287.21, stdev=2007.55, samples=117
iops : min= 1528, max= 3726, avg=2821.68, stdev=501.91, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=48.82%, 20=46.65%, 50=4.20%
lat (msec) : 100=0.20%, 250=0.02%
cpu : usr=0.47%, sys=0.34%, ctx=66983, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.1%, 16=64.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=1.1%, 16=0.8%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=165983,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11898: Fri Aug 13 21:22:57 2021
read: IOPS=2683, BW=10.5MiB/s (11.0MB/s)(629MiB/60010msec)
slat (nsec): min=110, max=11146k, avg=518.07, stdev=38987.13
clat (usec): min=45, max=129770, avg=11703.15, stdev=5357.31
lat (usec): min=452, max=129771, avg=11703.67, stdev=5357.31
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 70], 99.95th=[ 80],
| 99.99th=[ 113]
bw ( KiB/s): min= 455, max=14848, per=0.19%, avg=10848.87, stdev=2062.61, samples=118
iops : min= 113, max= 3712, avg=2712.09, stdev=515.67, samples=118
lat (usec) : 50=0.01%, 100=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 4=0.10%, 10=43.97%, 20=51.05%, 50=4.57%, 100=0.29%
lat (msec) : 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=63464, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=161016,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11899: Fri Aug 13 21:22:57 2021
read: IOPS=2715, BW=10.6MiB/s (11.1MB/s)(637MiB/60023msec)
slat (nsec): min=110, max=22183k, avg=478.76, stdev=55121.51
clat (usec): min=142, max=344274, avg=11523.92, stdev=6799.85
lat (usec): min=467, max=364496, avg=11524.40, stdev=6806.68
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 34], 99.90th=[ 64], 99.95th=[ 113],
| 99.99th=[ 342]
bw ( KiB/s): min= 4800, max=15104, per=0.20%, avg=11181.78, stdev=1997.32, samples=116
iops : min= 1200, max= 3776, avg=2795.32, stdev=499.34, samples=116
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=47.76%, 20=47.60%, 50=4.38%
lat (msec) : 100=0.10%, 250=0.03%, 500=0.02%
cpu : usr=0.42%, sys=0.38%, ctx=61715, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.9%, 16=61.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.8%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=162965,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11900: Fri Aug 13 21:22:57 2021
read: IOPS=2822, BW=11.0MiB/s (11.6MB/s)(662MiB/60044msec)
slat (nsec): min=110, max=3810.3k, avg=351.18, stdev=9559.08
clat (usec): min=25, max=219877, avg=11086.04, stdev=5186.38
lat (usec): min=369, max=219877, avg=11086.39, stdev=5186.35
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 36], 99.90th=[ 60], 99.95th=[ 72],
| 99.99th=[ 157]
bw ( KiB/s): min= 2299, max=14840, per=0.20%, avg=11504.59, stdev=1898.70, samples=117
iops : min= 574, max= 3710, avg=2876.01, stdev=474.71, samples=117
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=49.46%, 20=47.59%, 50=2.70%
lat (msec) : 100=0.14%, 250=0.05%
cpu : usr=0.46%, sys=0.35%, ctx=65075, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.7%, 16=56.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169476,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11901: Fri Aug 13 21:22:57 2021
read: IOPS=2745, BW=10.7MiB/s (11.2MB/s)(644MiB/60008msec)
slat (nsec): min=110, max=10043k, avg=376.84, stdev=24782.66
clat (usec): min=4, max=293516, avg=11437.06, stdev=7087.92
lat (usec): min=227, max=293517, avg=11437.44, stdev=7088.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 72], 99.95th=[ 113],
| 99.99th=[ 292]
bw ( KiB/s): min= 4584, max=15336, per=0.20%, avg=11185.51, stdev=2105.50, samples=117
iops : min= 1146, max= 3834, avg=2796.23, stdev=526.37, samples=117
lat (usec) : 10=0.01%, 50=0.01%, 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=49.07%, 20=46.51%, 50=4.05%
lat (msec) : 100=0.19%, 250=0.05%, 500=0.02%
cpu : usr=0.47%, sys=0.33%, ctx=64430, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.0%, 16=52.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164778,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11902: Fri Aug 13 21:22:57 2021
read: IOPS=2612, BW=10.2MiB/s (10.7MB/s)(612MiB/60003msec)
slat (nsec): min=119, max=377879, avg=327.03, stdev=1252.59
clat (usec): min=176, max=151069, avg=12063.85, stdev=6783.94
lat (usec): min=198, max=151069, avg=12064.17, stdev=6783.98
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 41], 99.50th=[ 53], 99.90th=[ 88], 99.95th=[ 105],
| 99.99th=[ 122]
bw ( KiB/s): min= 3832, max=15520, per=0.19%, avg=10567.43, stdev=2281.27, samples=118
iops : min= 958, max= 3880, avg=2641.72, stdev=570.30, samples=118
lat (usec) : 250=0.01%
lat (msec) : 4=0.08%, 10=44.87%, 20=49.06%, 50=5.40%, 100=0.53%
lat (msec) : 250=0.06%
cpu : usr=0.51%, sys=0.29%, ctx=64911, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.7%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=156741,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11903: Fri Aug 13 21:22:57 2021
read: IOPS=2788, BW=10.9MiB/s (11.4MB/s)(654MiB/60045msec)
slat (nsec): min=110, max=7134.7k, avg=517.28, stdev=23277.62
clat (usec): min=11, max=141148, avg=11267.30, stdev=4975.33
lat (usec): min=216, max=141148, avg=11267.82, stdev=4975.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 65], 99.95th=[ 90],
| 99.99th=[ 142]
bw ( KiB/s): min= 6107, max=15464, per=0.20%, avg=11358.25, stdev=1836.91, samples=117
iops : min= 1526, max= 3866, avg=2839.42, stdev=459.27, samples=117
lat (usec) : 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 1000=0.01%
lat (msec) : 4=0.13%, 10=47.01%, 20=49.41%, 50=3.24%, 100=0.17%
lat (msec) : 250=0.04%
cpu : usr=0.52%, sys=0.29%, ctx=64105, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.4%, 16=59.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.3%, 16=0.5%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=167408,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11904: Fri Aug 13 21:22:57 2021
read: IOPS=2640, BW=10.3MiB/s (10.8MB/s)(619MiB/60012msec)
slat (nsec): min=110, max=171673, avg=310.94, stdev=849.90
clat (usec): min=173, max=157978, avg=11872.08, stdev=5981.92
lat (usec): min=226, max=157978, avg=11872.39, stdev=5981.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 44], 99.90th=[ 79], 99.95th=[ 117],
| 99.99th=[ 157]
bw ( KiB/s): min= 6898, max=14848, per=0.19%, avg=10747.68, stdev=1935.96, samples=117
iops : min= 1724, max= 3712, avg=2686.75, stdev=483.97, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 4=0.06%, 10=41.20%, 20=53.87%, 50=4.47%, 100=0.33%
lat (msec) : 250=0.06%
cpu : usr=0.51%, sys=0.27%, ctx=64847, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.5%, 16=54.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=158466,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11905: Fri Aug 13 21:22:57 2021
read: IOPS=2770, BW=10.8MiB/s (11.3MB/s)(649MiB/60008msec)
slat (nsec): min=110, max=197818, avg=310.01, stdev=902.66
clat (usec): min=363, max=122908, avg=11298.78, stdev=5314.07
lat (usec): min=373, max=122909, avg=11299.09, stdev=5314.09
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 75], 99.95th=[ 79],
| 99.99th=[ 123]
bw ( KiB/s): min= 6664, max=15073, per=0.20%, avg=11269.91, stdev=2080.62, samples=117
iops : min= 1666, max= 3768, avg=2817.36, stdev=520.15, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.19%, 10=51.12%, 20=44.23%, 50=4.18%, 100=0.28%
lat (msec) : 250=0.02%
cpu : usr=0.46%, sys=0.35%, ctx=66492, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.3%, 16=50.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166245,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11906: Fri Aug 13 21:22:57 2021
read: IOPS=2844, BW=11.1MiB/s (11.7MB/s)(667MiB/60032msec)
slat (nsec): min=110, max=3146.0k, avg=380.10, stdev=10298.60
clat (usec): min=450, max=152018, avg=11000.18, stdev=5030.24
lat (usec): min=450, max=152019, avg=11000.56, stdev=5030.53
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 65], 99.95th=[ 74],
| 99.99th=[ 153]
bw ( KiB/s): min= 3536, max=15608, per=0.20%, avg=11609.79, stdev=2105.38, samples=117
iops : min= 884, max= 3902, avg=2902.32, stdev=526.34, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=52.29%, 20=44.36%, 50=3.01%
lat (msec) : 100=0.13%, 250=0.04%
cpu : usr=0.54%, sys=0.27%, ctx=64533, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.6%, 16=58.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=170762,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11907: Fri Aug 13 21:22:57 2021
read: IOPS=2603, BW=10.2MiB/s (10.7MB/s)(611MiB/60045msec)
slat (nsec): min=110, max=2796.6k, avg=370.86, stdev=10104.36
clat (usec): min=254, max=121076, avg=12074.41, stdev=6052.07
lat (usec): min=1402, max=121077, avg=12074.78, stdev=6052.05
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 44], 99.90th=[ 83], 99.95th=[ 88],
| 99.99th=[ 122]
bw ( KiB/s): min= 5352, max=15017, per=0.19%, avg=10608.13, stdev=1949.89, samples=117
iops : min= 1338, max= 3754, avg=2651.91, stdev=487.48, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=41.60%, 20=52.46%, 50=5.48%
lat (msec) : 100=0.29%, 250=0.04%
cpu : usr=0.47%, sys=0.29%, ctx=61341, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=156320,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11908: Fri Aug 13 21:22:57 2021
read: IOPS=2758, BW=10.8MiB/s (11.3MB/s)(647MiB/60011msec)
slat (nsec): min=110, max=31376k, avg=522.93, stdev=77184.38
clat (usec): min=573, max=116465, avg=11384.31, stdev=5736.50
lat (usec): min=802, max=116465, avg=11384.84, stdev=5736.89
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 48], 99.90th=[ 78], 99.95th=[ 94],
| 99.99th=[ 101]
bw ( KiB/s): min= 4864, max=15104, per=0.20%, avg=11230.38, stdev=2203.40, samples=117
iops : min= 1216, max= 3776, avg=2807.45, stdev=550.84, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=51.03%, 20=44.30%, 50=4.12%
lat (msec) : 100=0.44%, 250=0.01%
cpu : usr=0.49%, sys=0.31%, ctx=64181, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.5%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.0%, 16=1.1%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=165536,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11909: Fri Aug 13 21:22:57 2021
read: IOPS=2856, BW=11.2MiB/s (11.7MB/s)(670MiB/60043msec)
slat (nsec): min=110, max=448704, avg=329.25, stdev=2191.65
clat (usec): min=1434, max=108902, avg=11080.81, stdev=5018.35
lat (usec): min=1434, max=108903, avg=11081.14, stdev=5018.36
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 38], 99.90th=[ 60], 99.95th=[ 77],
| 99.99th=[ 108]
bw ( KiB/s): min= 6360, max=22227, per=0.20%, avg=11547.99, stdev=2328.07, samples=118
iops : min= 1590, max= 5556, avg=2886.90, stdev=581.97, samples=118
lat (msec) : 2=0.01%, 4=1.40%, 10=50.04%, 20=44.61%, 50=3.79%
lat (msec) : 100=0.13%, 250=0.02%
cpu : usr=0.51%, sys=0.23%, ctx=65864, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.0%, 16=63.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=0.9%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=171531,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11910: Fri Aug 13 21:22:57 2021
read: IOPS=2949, BW=11.5MiB/s (12.1MB/s)(692MiB/60023msec)
slat (nsec): min=110, max=12538k, avg=421.11, stdev=30832.65
clat (usec): min=129, max=98924, avg=10636.23, stdev=4291.98
lat (usec): min=292, max=98925, avg=10636.65, stdev=4292.05
clat percentiles (usec):
| 1.00th=[ 5866], 5.00th=[ 7308], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[11994], 90.00th=[14222], 95.00th=[16909],
| 99.00th=[26870], 99.50th=[32900], 99.90th=[54789], 99.95th=[66847],
| 99.99th=[95945]
bw ( KiB/s): min= 6936, max=14880, per=0.21%, avg=12028.23, stdev=1664.59, samples=117
iops : min= 1734, max= 3720, avg=3006.93, stdev=416.15, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.19%, 10=57.08%, 20=39.84%, 50=2.77%
lat (msec) : 100=0.11%
cpu : usr=0.49%, sys=0.33%, ctx=65126, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.4%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.9%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=177052,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11911: Fri Aug 13 21:22:57 2021
read: IOPS=2455, BW=9821KiB/s (10.1MB/s)(576MiB/60007msec)
slat (nsec): min=119, max=2627.9k, avg=345.30, stdev=6922.88
clat (usec): min=274, max=115969, avg=12769.65, stdev=7120.15
lat (usec): min=303, max=115970, avg=12769.99, stdev=7120.19
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 14], 80.00th=[ 15], 90.00th=[ 19], 95.00th=[ 24],
| 99.00th=[ 44], 99.50th=[ 55], 99.90th=[ 86], 99.95th=[ 96],
| 99.99th=[ 112]
bw ( KiB/s): min= 4910, max=15432, per=0.18%, avg=10005.44, stdev=2072.37, samples=117
iops : min= 1227, max= 3858, avg=2501.29, stdev=518.11, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.02%, 10=36.84%, 20=55.36%, 50=7.05%
lat (msec) : 100=0.70%, 250=0.03%
cpu : usr=0.45%, sys=0.29%, ctx=62506, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.8%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=147339,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11912: Fri Aug 13 21:22:57 2021
read: IOPS=2779, BW=10.9MiB/s (11.4MB/s)(652MiB/60008msec)
slat (nsec): min=110, max=18996k, avg=473.92, stdev=50536.77
clat (usec): min=18, max=131289, avg=11286.78, stdev=4959.78
lat (usec): min=361, max=131289, avg=11287.25, stdev=4959.80
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7504], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[15270], 95.00th=[18744],
| 99.00th=[31327], 99.50th=[38536], 99.90th=[64226], 99.95th=[68682],
| 99.99th=[77071]
bw ( KiB/s): min= 6928, max=16384, per=0.20%, avg=11316.91, stdev=1842.36, samples=117
iops : min= 1732, max= 4096, avg=2829.17, stdev=460.62, samples=117
lat (usec) : 20=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=48.41%, 20=47.40%, 50=3.77%
lat (msec) : 100=0.25%, 250=0.01%
cpu : usr=0.52%, sys=0.29%, ctx=66448, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166799,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11913: Fri Aug 13 21:22:57 2021
read: IOPS=2879, BW=11.2MiB/s (11.8MB/s)(675MiB/60008msec)
slat (nsec): min=110, max=718456, avg=330.70, stdev=2360.49
clat (usec): min=1716, max=122273, avg=11083.42, stdev=5776.06
lat (usec): min=1716, max=122274, avg=11083.75, stdev=5776.09
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 70], 99.95th=[ 83],
| 99.99th=[ 115]
bw ( KiB/s): min= 5376, max=41852, per=0.20%, avg=11540.53, stdev=3905.57, samples=119
iops : min= 1344, max=10463, avg=2885.08, stdev=976.39, samples=119
lat (msec) : 2=0.02%, 4=5.16%, 10=44.11%, 20=46.67%, 50=3.70%
lat (msec) : 100=0.31%, 250=0.03%
cpu : usr=0.52%, sys=0.23%, ctx=65501, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.1%, 16=1.7%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=172806,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11914: Fri Aug 13 21:22:57 2021
read: IOPS=2856, BW=11.2MiB/s (11.7MB/s)(670MiB/60024msec)
slat (nsec): min=110, max=811433, avg=320.62, stdev=2357.22
clat (usec): min=142, max=119125, avg=10981.75, stdev=5384.07
lat (usec): min=147, max=119125, avg=10982.07, stdev=5384.14
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 85], 99.95th=[ 91],
| 99.99th=[ 105]
bw ( KiB/s): min= 5368, max=15144, per=0.20%, avg=11640.44, stdev=1999.10, samples=117
iops : min= 1342, max= 3786, avg=2910.07, stdev=499.77, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 4=0.14%, 10=54.46%, 20=42.10%, 50=2.99%, 100=0.29%
lat (msec) : 250=0.02%
cpu : usr=0.49%, sys=0.29%, ctx=65779, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.7%, 16=51.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=171443,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11915: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60008msec)
slat (nsec): min=100, max=8598.4k, avg=372.64, stdev=20708.17
clat (usec): min=191, max=145491, avg=10953.96, stdev=4345.62
lat (usec): min=277, max=145491, avg=10954.34, stdev=4345.63
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 31], 99.90th=[ 54], 99.95th=[ 69],
| 99.99th=[ 144]
bw ( KiB/s): min= 2043, max=15113, per=0.20%, avg=11622.55, stdev=1982.88, samples=118
iops : min= 510, max= 3778, avg=2905.57, stdev=495.75, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=50.12%, 20=47.32%, 50=2.32%
lat (msec) : 100=0.12%, 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=66010, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.6%, 16=57.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=172572,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11916: Fri Aug 13 21:22:57 2021
read: IOPS=2711, BW=10.6MiB/s (11.1MB/s)(636MiB/60010msec)
slat (nsec): min=110, max=1042.9k, avg=320.13, stdev=2665.76
clat (msec): min=2, max=158, avg=11.59, stdev= 5.46
lat (msec): min=2, max=158, avg=11.59, stdev= 5.46
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 71], 99.95th=[ 78],
| 99.99th=[ 122]
bw ( KiB/s): min= 766, max=15360, per=0.19%, avg=10953.52, stdev=2177.86, samples=118
iops : min= 191, max= 3840, avg=2738.32, stdev=544.48, samples=118
lat (msec) : 4=0.08%, 10=46.40%, 20=48.79%, 50=4.37%, 100=0.35%
lat (msec) : 250=0.02%
cpu : usr=0.46%, sys=0.34%, ctx=65582, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=5.6%, 16=69.4%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.4%, 8=1.1%, 16=2.0%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162691,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11917: Fri Aug 13 21:22:57 2021
read: IOPS=2727, BW=10.7MiB/s (11.2MB/s)(639MiB/60006msec)
slat (nsec): min=119, max=8911.9k, avg=466.80, stdev=26431.52
clat (usec): min=793, max=228159, avg=11457.15, stdev=5565.39
lat (usec): min=794, max=228159, avg=11457.62, stdev=5565.30
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 40], 99.90th=[ 68], 99.95th=[ 82],
| 99.99th=[ 153]
bw ( KiB/s): min= 6642, max=15080, per=0.20%, avg=11119.40, stdev=1800.27, samples=117
iops : min= 1660, max= 3770, avg=2779.78, stdev=450.09, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=46.56%, 20=49.56%, 50=3.50%
lat (msec) : 100=0.31%, 250=0.03%
cpu : usr=0.51%, sys=0.30%, ctx=67357, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.7%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=163695,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11918: Fri Aug 13 21:22:57 2021
read: IOPS=2922, BW=11.4MiB/s (12.0MB/s)(685MiB/60003msec)
slat (nsec): min=110, max=82512, avg=315.48, stdev=576.89
clat (usec): min=547, max=65132, avg=10922.20, stdev=4474.89
lat (usec): min=548, max=65133, avg=10922.51, stdev=4474.91
clat percentiles (usec):
| 1.00th=[ 2802], 5.00th=[ 6456], 10.00th=[ 7635], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[13042], 90.00th=[15401], 95.00th=[18482],
| 99.00th=[27395], 99.50th=[32900], 99.90th=[46400], 99.95th=[53216],
| 99.99th=[65274]
bw ( KiB/s): min= 8000, max=36681, per=0.21%, avg=11715.24, stdev=3143.75, samples=119
iops : min= 2000, max= 9170, avg=2928.74, stdev=785.91, samples=119
lat (usec) : 750=0.01%
lat (msec) : 4=3.59%, 10=47.20%, 20=45.43%, 50=3.73%, 100=0.06%
cpu : usr=0.47%, sys=0.27%, ctx=65679, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.2%, 16=56.9%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=175334,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11919: Fri Aug 13 21:22:57 2021
read: IOPS=2911, BW=11.4MiB/s (11.9MB/s)(682MiB/60008msec)
slat (nsec): min=110, max=163424, avg=321.89, stdev=798.44
clat (usec): min=855, max=94393, avg=10921.37, stdev=4643.51
lat (usec): min=856, max=94393, avg=10921.70, stdev=4643.53
clat percentiles (usec):
| 1.00th=[ 3163], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12780], 90.00th=[14877], 95.00th=[17433],
| 99.00th=[27657], 99.50th=[33424], 99.90th=[62653], 99.95th=[85459],
| 99.99th=[93848]
bw ( KiB/s): min= 1226, max=24526, per=0.20%, avg=11652.03, stdev=2365.00, samples=119
iops : min= 306, max= 6131, avg=2912.94, stdev=591.23, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=1.37%, 10=51.35%, 20=44.16%, 50=2.96%
lat (msec) : 100=0.16%
cpu : usr=0.44%, sys=0.39%, ctx=67396, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.8%, 16=63.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.3%, 16=2.2%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=174718,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11920: Fri Aug 13 21:22:57 2021
read: IOPS=2732, BW=10.7MiB/s (11.2MB/s)(640MiB/60010msec)
slat (nsec): min=110, max=1139.6k, avg=346.25, stdev=5215.38
clat (usec): min=50, max=210005, avg=11446.12, stdev=5437.13
lat (usec): min=840, max=210006, avg=11446.47, stdev=5437.10
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 41], 99.90th=[ 72], 99.95th=[ 90],
| 99.99th=[ 121]
bw ( KiB/s): min= 5888, max=15104, per=0.20%, avg=11115.58, stdev=1901.86, samples=117
iops : min= 1472, max= 3776, avg=2778.85, stdev=475.46, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=46.36%, 20=49.52%, 50=3.67%
lat (msec) : 100=0.26%, 250=0.04%
cpu : usr=0.50%, sys=0.30%, ctx=68085, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.0%, 16=56.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.5%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=163955,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11921: Fri Aug 13 21:22:57 2021
read: IOPS=2911, BW=11.4MiB/s (11.9MB/s)(682MiB/60008msec)
slat (nsec): min=110, max=93790, avg=308.03, stdev=573.00
clat (usec): min=148, max=220114, avg=10803.26, stdev=4603.00
lat (usec): min=153, max=220115, avg=10803.57, stdev=4603.01
clat percentiles (usec):
| 1.00th=[ 5932], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14615], 95.00th=[17171],
| 99.00th=[26870], 99.50th=[32113], 99.90th=[60556], 99.95th=[81265],
| 99.99th=[96994]
bw ( KiB/s): min= 6680, max=15840, per=0.21%, avg=11781.24, stdev=2037.07, samples=118
iops : min= 1670, max= 3960, avg=2945.25, stdev=509.30, samples=118
lat (usec) : 250=0.01%
lat (msec) : 4=0.16%, 10=55.16%, 20=41.65%, 50=2.86%, 100=0.17%
lat (msec) : 250=0.01%
cpu : usr=0.49%, sys=0.32%, ctx=62185, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.5%, 16=50.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=174689,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11922: Fri Aug 13 21:22:57 2021
read: IOPS=2843, BW=11.1MiB/s (11.6MB/s)(666MiB/60008msec)
slat (nsec): min=110, max=3569.1k, avg=358.48, stdev=10746.20
clat (usec): min=154, max=100663, avg=11077.13, stdev=4745.31
lat (usec): min=166, max=100664, avg=11077.49, stdev=4745.54
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 64], 99.95th=[ 84],
| 99.99th=[ 101]
bw ( KiB/s): min= 3065, max=15616, per=0.20%, avg=11474.69, stdev=2012.54, samples=118
iops : min= 766, max= 3904, avg=2868.59, stdev=503.15, samples=118
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=52.56%, 20=43.98%, 50=3.12%
lat (msec) : 100=0.19%, 250=0.01%
cpu : usr=0.52%, sys=0.30%, ctx=63267, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.0%, 16=56.1%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.4%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=170612,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11923: Fri Aug 13 21:22:57 2021
read: IOPS=2806, BW=11.0MiB/s (11.5MB/s)(658MiB/60045msec)
slat (nsec): min=110, max=640490, avg=318.32, stdev=1697.28
clat (usec): min=840, max=100006, avg=11254.30, stdev=5411.98
lat (usec): min=840, max=100007, avg=11254.62, stdev=5412.04
clat percentiles (usec):
| 1.00th=[ 5604], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[15270], 95.00th=[19268],
| 99.00th=[33424], 99.50th=[44303], 99.90th=[70779], 99.95th=[87557],
| 99.99th=[99091]
bw ( KiB/s): min= 6387, max=15760, per=0.20%, avg=11364.64, stdev=2041.40, samples=118
iops : min= 1596, max= 3940, avg=2841.10, stdev=510.39, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.41%, 10=50.16%, 20=45.08%, 50=4.05%
lat (msec) : 100=0.30%, 250=0.01%
cpu : usr=0.49%, sys=0.32%, ctx=67512, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.7%, 16=56.4%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=168541,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11924: Fri Aug 13 21:22:57 2021
read: IOPS=2886, BW=11.3MiB/s (11.8MB/s)(677MiB/60026msec)
slat (nsec): min=110, max=241285, avg=313.12, stdev=867.89
clat (msec): min=2, max=126, avg=10.95, stdev= 5.20
lat (msec): min=2, max=126, avg=10.95, stdev= 5.20
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 77], 99.95th=[ 84],
| 99.99th=[ 110]
bw ( KiB/s): min= 4698, max=15712, per=0.20%, avg=11666.97, stdev=1929.82, samples=118
iops : min= 1174, max= 3928, avg=2916.62, stdev=482.48, samples=118
lat (msec) : 4=0.07%, 10=53.08%, 20=44.08%, 50=2.39%, 100=0.36%
lat (msec) : 250=0.02%
cpu : usr=0.53%, sys=0.28%, ctx=64736, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.8%, 16=60.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.8%, 8=1.6%, 16=1.0%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=173278,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11925: Fri Aug 13 21:22:57 2021
read: IOPS=2773, BW=10.8MiB/s (11.4MB/s)(650MiB/60006msec)
slat (nsec): min=110, max=682673, avg=330.08, stdev=2328.61
clat (usec): min=1884, max=83838, avg=11276.78, stdev=5020.73
lat (usec): min=1884, max=83839, avg=11277.11, stdev=5020.73
clat percentiles (usec):
| 1.00th=[ 6456], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15401], 95.00th=[19268],
| 99.00th=[31589], 99.50th=[40633], 99.90th=[66323], 99.95th=[71828],
| 99.99th=[82314]
bw ( KiB/s): min= 4854, max=15632, per=0.20%, avg=11285.00, stdev=2122.97, samples=117
iops : min= 1213, max= 3908, avg=2821.12, stdev=530.78, samples=117
lat (msec) : 2=0.01%, 4=0.14%, 10=49.53%, 20=46.00%, 50=4.13%
lat (msec) : 100=0.19%
cpu : usr=0.52%, sys=0.28%, ctx=65927, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.7%, 16=52.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=166447,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11926: Fri Aug 13 21:22:57 2021
read: IOPS=2826, BW=11.0MiB/s (11.6MB/s)(663MiB/60051msec)
slat (nsec): min=100, max=366705, avg=315.77, stdev=1136.65
clat (usec): min=404, max=149083, avg=11103.57, stdev=5066.74
lat (usec): min=484, max=149084, avg=11103.89, stdev=5066.75
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 35], 99.90th=[ 70], 99.95th=[ 107],
| 99.99th=[ 142]
bw ( KiB/s): min= 5120, max=15104, per=0.20%, avg=11522.32, stdev=1851.37, samples=117
iops : min= 1280, max= 3776, avg=2880.51, stdev=462.83, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=49.03%, 20=48.05%, 50=2.61%
lat (msec) : 100=0.18%, 250=0.05%
cpu : usr=0.52%, sys=0.28%, ctx=66368, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.8%, 16=51.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=169727,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11927: Fri Aug 13 21:22:57 2021
read: IOPS=2793, BW=10.9MiB/s (11.4MB/s)(655MiB/60020msec)
slat (nsec): min=110, max=32762k, avg=545.21, stdev=80129.60
clat (usec): min=70, max=245864, avg=11262.88, stdev=6510.42
lat (usec): min=1964, max=245864, avg=11263.43, stdev=6510.66
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 49], 99.90th=[ 85], 99.95th=[ 91],
| 99.99th=[ 236]
bw ( KiB/s): min= 1277, max=15425, per=0.20%, avg=11296.81, stdev=2521.28, samples=118
iops : min= 319, max= 3856, avg=2824.14, stdev=630.34, samples=118
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.22%, 10=52.99%, 20=42.35%, 50=3.98%
lat (msec) : 100=0.42%, 250=0.04%
cpu : usr=0.51%, sys=0.31%, ctx=68536, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.3%, 16=62.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.2%, 16=2.3%, 32=1.3%, 64=0.0%, >=64=0.0%
issued rwts: total=167638,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11928: Fri Aug 13 21:22:57 2021
read: IOPS=2892, BW=11.3MiB/s (11.8MB/s)(678MiB/60035msec)
slat (nsec): min=110, max=14201k, avg=410.12, stdev=34525.29
clat (usec): min=1461, max=107547, avg=10893.48, stdev=4629.70
lat (usec): min=1612, max=107547, avg=10893.89, stdev=4629.67
clat percentiles (usec):
| 1.00th=[ 5932], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14484], 95.00th=[17695],
| 99.00th=[28967], 99.50th=[35914], 99.90th=[63177], 99.95th=[72877],
| 99.99th=[86508]
bw ( KiB/s): min= 2810, max=17628, per=0.21%, avg=11687.14, stdev=2148.59, samples=118
iops : min= 702, max= 4407, avg=2921.74, stdev=537.17, samples=118
lat (msec) : 2=0.01%, 4=0.15%, 10=53.79%, 20=42.57%, 50=3.33%
lat (msec) : 100=0.16%, 250=0.01%
cpu : usr=0.55%, sys=0.25%, ctx=65034, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.3%, 16=52.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=173623,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11929: Fri Aug 13 21:22:57 2021
read: IOPS=2732, BW=10.7MiB/s (11.2MB/s)(641MiB/60016msec)
slat (nsec): min=110, max=413687, avg=333.36, stdev=2187.90
clat (usec): min=149, max=112720, avg=11510.18, stdev=5808.72
lat (usec): min=171, max=112721, avg=11510.51, stdev=5808.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 44], 99.90th=[ 79], 99.95th=[ 94],
| 99.99th=[ 112]
bw ( KiB/s): min= 6187, max=15528, per=0.20%, avg=11127.85, stdev=2136.76, samples=117
iops : min= 1546, max= 3882, avg=2781.89, stdev=534.22, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=47.98%, 20=47.34%, 50=4.21%
lat (msec) : 100=0.37%, 250=0.04%
cpu : usr=0.51%, sys=0.29%, ctx=64641, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.7%, 16=54.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=164005,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11930: Fri Aug 13 21:22:57 2021
read: IOPS=2648, BW=10.3MiB/s (10.8MB/s)(621MiB/60005msec)
slat (nsec): min=110, max=433336, avg=327.96, stdev=1540.39
clat (usec): min=412, max=131734, avg=11845.34, stdev=6192.10
lat (usec): min=418, max=131736, avg=11845.66, stdev=6192.11
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 94], 99.95th=[ 107],
| 99.99th=[ 132]
bw ( KiB/s): min= 4864, max=14592, per=0.19%, avg=10776.72, stdev=2093.74, samples=117
iops : min= 1216, max= 3648, avg=2694.11, stdev=523.43, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 4=0.19%, 10=43.29%, 20=51.79%, 50=4.31%, 100=0.36%
lat (msec) : 250=0.06%
cpu : usr=0.50%, sys=0.28%, ctx=64718, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.0%, 16=55.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158937,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11931: Fri Aug 13 21:22:57 2021
read: IOPS=2727, BW=10.7MiB/s (11.2MB/s)(640MiB/60044msec)
slat (nsec): min=100, max=7829.1k, avg=372.25, stdev=19394.73
clat (usec): min=236, max=124828, avg=11468.39, stdev=4939.57
lat (usec): min=237, max=124828, avg=11468.76, stdev=4939.61
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 61], 99.95th=[ 87],
| 99.99th=[ 124]
bw ( KiB/s): min= 6387, max=14664, per=0.20%, avg=11099.25, stdev=1865.43, samples=117
iops : min= 1596, max= 3666, avg=2774.76, stdev=466.39, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.04%, 10=44.93%, 20=50.74%, 50=4.08%, 100=0.16%
lat (msec) : 250=0.04%
cpu : usr=0.49%, sys=0.31%, ctx=67799, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.6%, 16=53.4%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=163747,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11932: Fri Aug 13 21:22:57 2021
read: IOPS=2573, BW=10.1MiB/s (10.5MB/s)(603MiB/60006msec)
slat (nsec): min=110, max=8059.1k, avg=469.27, stdev=26847.61
clat (usec): min=142, max=140426, avg=12168.29, stdev=6899.14
lat (usec): min=300, max=140426, avg=12168.76, stdev=6899.15
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 41], 99.50th=[ 53], 99.90th=[ 94], 99.95th=[ 107],
| 99.99th=[ 125]
bw ( KiB/s): min= 4152, max=14592, per=0.18%, avg=10466.85, stdev=2129.62, samples=117
iops : min= 1038, max= 3648, avg=2616.65, stdev=532.42, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=44.00%, 20=49.32%, 50=5.96%
lat (msec) : 100=0.56%, 250=0.05%
cpu : usr=0.42%, sys=0.35%, ctx=61192, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.3%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=154432,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11933: Fri Aug 13 21:22:57 2021
read: IOPS=2907, BW=11.4MiB/s (11.9MB/s)(682MiB/60025msec)
slat (nsec): min=119, max=2504.3k, avg=345.54, stdev=6026.62
clat (usec): min=423, max=150460, avg=10803.11, stdev=5222.77
lat (usec): min=464, max=150460, avg=10803.46, stdev=5222.97
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 39], 99.90th=[ 77], 99.95th=[ 95],
| 99.99th=[ 150]
bw ( KiB/s): min= 6072, max=15392, per=0.21%, avg=11886.38, stdev=2127.90, samples=117
iops : min= 1518, max= 3848, avg=2971.52, stdev=531.98, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=56.53%, 20=40.00%, 50=3.12%
lat (msec) : 100=0.22%, 250=0.04%
cpu : usr=0.55%, sys=0.27%, ctx=65230, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.5%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=174535,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11934: Fri Aug 13 21:22:57 2021
read: IOPS=2650, BW=10.4MiB/s (10.9MB/s)(621MiB/60012msec)
slat (nsec): min=100, max=1484.0k, avg=343.62, stdev=3806.90
clat (usec): min=1984, max=105549, avg=11858.89, stdev=5580.37
lat (usec): min=1985, max=105550, avg=11859.23, stdev=5580.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 45], 99.90th=[ 70], 99.95th=[ 92],
| 99.99th=[ 106]
bw ( KiB/s): min= 1021, max=14360, per=0.19%, avg=10694.22, stdev=1990.64, samples=118
iops : min= 255, max= 3590, avg=2673.51, stdev=497.67, samples=118
lat (msec) : 2=0.01%, 4=0.07%, 10=42.24%, 20=52.61%, 50=4.77%
lat (msec) : 100=0.30%, 250=0.02%
cpu : usr=0.44%, sys=0.36%, ctx=63921, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.5%, 16=54.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=159071,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11935: Fri Aug 13 21:22:57 2021
read: IOPS=2706, BW=10.6MiB/s (11.1MB/s)(635MiB/60047msec)
slat (nsec): min=110, max=829770, avg=354.82, stdev=2886.06
clat (usec): min=154, max=116702, avg=11612.70, stdev=5484.23
lat (usec): min=160, max=116702, avg=11613.05, stdev=5484.26
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 71], 99.95th=[ 89],
| 99.99th=[ 113]
bw ( KiB/s): min= 5964, max=14856, per=0.19%, avg=11037.54, stdev=1952.04, samples=117
iops : min= 1491, max= 3714, avg=2759.32, stdev=488.00, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.02%, 4=0.08%, 10=45.75%, 20=49.39%, 50=4.49%
lat (msec) : 100=0.25%, 250=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=65521, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.0%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162531,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11936: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60013msec)
slat (nsec): min=110, max=833579, avg=343.80, stdev=2232.13
clat (usec): min=322, max=144728, avg=11115.25, stdev=6123.51
lat (usec): min=343, max=144728, avg=11115.60, stdev=6123.54
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 48], 99.90th=[ 82], 99.95th=[ 97],
| 99.99th=[ 146]
bw ( KiB/s): min= 5376, max=34960, per=0.20%, avg=11506.32, stdev=3373.56, samples=119
iops : min= 1344, max= 8740, avg=2876.52, stdev=843.37, samples=119
lat (usec) : 500=0.01%
lat (msec) : 4=3.88%, 10=48.40%, 20=43.65%, 50=3.62%, 100=0.41%
lat (msec) : 250=0.04%
cpu : usr=0.48%, sys=0.26%, ctx=67684, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.3%, 16=61.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.7%, 16=0.8%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=172557,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11937: Fri Aug 13 21:22:57 2021
read: IOPS=2680, BW=10.5MiB/s (11.0MB/s)(629MiB/60042msec)
slat (nsec): min=110, max=1904.2k, avg=341.64, stdev=5357.24
clat (usec): min=417, max=102322, avg=11715.65, stdev=5292.16
lat (usec): min=418, max=102324, avg=11715.99, stdev=5292.26
clat percentiles (usec):
| 1.00th=[ 6456], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[12125], 80.00th=[13698], 90.00th=[16450], 95.00th=[20317],
| 99.00th=[33817], 99.50th=[41157], 99.90th=[61604], 99.95th=[67634],
| 99.99th=[85459]
bw ( KiB/s): min= 6408, max=15208, per=0.19%, avg=10934.70, stdev=1991.31, samples=117
iops : min= 1602, max= 3802, avg=2733.61, stdev=497.85, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=45.25%, 20=49.37%, 50=5.05%
lat (msec) : 100=0.22%, 250=0.01%
cpu : usr=0.46%, sys=0.34%, ctx=64535, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.3%, 16=51.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160921,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11938: Fri Aug 13 21:22:57 2021
read: IOPS=2670, BW=10.4MiB/s (10.9MB/s)(626MiB/60006msec)
slat (nsec): min=110, max=2654.9k, avg=366.48, stdev=7246.10
clat (usec): min=1344, max=114462, avg=11740.07, stdev=5648.56
lat (usec): min=1376, max=114462, avg=11740.44, stdev=5648.67
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 73], 99.95th=[ 84],
| 99.99th=[ 106]
bw ( KiB/s): min= 5376, max=15360, per=0.19%, avg=10872.07, stdev=1959.62, samples=117
iops : min= 1344, max= 3840, avg=2717.97, stdev=489.90, samples=117
lat (msec) : 2=0.01%, 4=0.05%, 10=43.82%, 20=51.37%, 50=4.38%
lat (msec) : 100=0.35%, 250=0.02%
cpu : usr=0.48%, sys=0.33%, ctx=64537, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.0%, 16=62.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.7%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=160235,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11939: Fri Aug 13 21:22:57 2021
read: IOPS=2831, BW=11.1MiB/s (11.6MB/s)(664MiB/60012msec)
slat (nsec): min=110, max=7447.8k, avg=400.57, stdev=20194.38
clat (usec): min=92, max=134831, avg=11045.43, stdev=4992.68
lat (usec): min=390, max=134833, avg=11045.83, stdev=4992.65
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 71], 99.95th=[ 84],
| 99.99th=[ 136]
bw ( KiB/s): min= 4624, max=14896, per=0.20%, avg=11530.03, stdev=2083.42, samples=117
iops : min= 1156, max= 3724, avg=2882.44, stdev=520.88, samples=117
lat (usec) : 100=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=52.65%, 20=43.88%, 50=3.09%
lat (msec) : 100=0.19%, 250=0.04%
cpu : usr=0.47%, sys=0.34%, ctx=63969, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.0%, 16=56.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=169948,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11940: Fri Aug 13 21:22:57 2021
read: IOPS=2574, BW=10.1MiB/s (10.5MB/s)(603MiB/60007msec)
slat (nsec): min=119, max=6684.9k, avg=455.72, stdev=22972.31
clat (usec): min=247, max=167824, avg=12148.23, stdev=6658.09
lat (usec): min=292, max=167825, avg=12148.69, stdev=6658.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 38], 99.50th=[ 51], 99.90th=[ 87], 99.95th=[ 94],
| 99.99th=[ 159]
bw ( KiB/s): min= 3576, max=14848, per=0.18%, avg=10454.49, stdev=2034.52, samples=117
iops : min= 894, max= 3712, avg=2613.56, stdev=508.63, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=41.66%, 20=52.32%, 50=5.41%
lat (msec) : 100=0.46%, 250=0.05%
cpu : usr=0.46%, sys=0.30%, ctx=60262, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.8%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.7%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=154466,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11941: Fri Aug 13 21:22:57 2021
read: IOPS=2813, BW=11.0MiB/s (11.5MB/s)(660MiB/60012msec)
slat (nsec): min=119, max=375192, avg=323.23, stdev=1355.46
clat (usec): min=1825, max=252856, avg=11106.00, stdev=5187.82
lat (usec): min=1825, max=252856, avg=11106.32, stdev=5187.88
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 52], 99.95th=[ 71],
| 99.99th=[ 153]
bw ( KiB/s): min= 2810, max=16336, per=0.20%, avg=11459.79, stdev=2060.79, samples=117
iops : min= 702, max= 4084, avg=2864.89, stdev=515.24, samples=117
lat (msec) : 2=0.01%, 4=0.11%, 10=51.44%, 20=44.82%, 50=3.51%
lat (msec) : 100=0.09%, 250=0.02%, 500=0.01%
cpu : usr=0.46%, sys=0.33%, ctx=64028, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.2%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=168862,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11942: Fri Aug 13 21:22:57 2021
read: IOPS=2813, BW=11.0MiB/s (11.5MB/s)(660MiB/60014msec)
slat (nsec): min=110, max=564182, avg=329.04, stdev=1964.27
clat (usec): min=47, max=108138, avg=11167.01, stdev=4611.04
lat (usec): min=611, max=108139, avg=11167.34, stdev=4611.05
clat percentiles (usec):
| 1.00th=[ 6849], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15139], 95.00th=[17957],
| 99.00th=[28705], 99.50th=[35390], 99.90th=[65274], 99.95th=[67634],
| 99.99th=[84411]
bw ( KiB/s): min= 7400, max=15144, per=0.20%, avg=11462.74, stdev=1771.46, samples=117
iops : min= 1850, max= 3786, avg=2865.63, stdev=442.89, samples=117
lat (usec) : 50=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=50.30%, 20=46.38%, 50=3.09%
lat (msec) : 100=0.19%, 250=0.01%
cpu : usr=0.43%, sys=0.37%, ctx=60919, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.2%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168836,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11943: Fri Aug 13 21:22:57 2021
read: IOPS=2743, BW=10.7MiB/s (11.2MB/s)(643MiB/60014msec)
slat (nsec): min=110, max=2744.2k, avg=353.05, stdev=6850.02
clat (usec): min=861, max=106695, avg=11487.72, stdev=5511.58
lat (usec): min=862, max=106695, avg=11488.07, stdev=5511.76
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 45], 99.90th=[ 70], 99.95th=[ 87],
| 99.99th=[ 101]
bw ( KiB/s): min= 4327, max=15616, per=0.19%, avg=11071.57, stdev=2079.18, samples=118
iops : min= 1081, max= 3904, avg=2767.81, stdev=519.81, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=47.75%, 20=47.83%, 50=4.00%
lat (msec) : 100=0.37%, 250=0.01%
cpu : usr=0.48%, sys=0.33%, ctx=65325, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.6%, 16=61.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.2%, 8=1.8%, 16=1.5%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164639,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11944: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60015msec)
slat (nsec): min=100, max=4346.1k, avg=350.48, stdev=10916.44
clat (msec): min=2, max=162, avg=11.62, stdev= 5.20
lat (msec): min=2, max=162, avg=11.62, stdev= 5.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 67], 99.95th=[ 83],
| 99.99th=[ 127]
bw ( KiB/s): min= 5880, max=14784, per=0.19%, avg=10989.95, stdev=1791.52, samples=117
iops : min= 1470, max= 3696, avg=2747.43, stdev=447.89, samples=117
lat (msec) : 4=0.04%, 10=43.57%, 20=52.53%, 50=3.63%, 100=0.20%
lat (msec) : 250=0.03%
cpu : usr=0.51%, sys=0.30%, ctx=64795, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.1%, 16=52.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162049,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11945: Fri Aug 13 21:22:57 2021
read: IOPS=2870, BW=11.2MiB/s (11.8MB/s)(673MiB/60013msec)
slat (nsec): min=110, max=234546, avg=324.59, stdev=887.98
clat (usec): min=472, max=187623, avg=10926.89, stdev=5137.53
lat (usec): min=496, max=187624, avg=10927.21, stdev=5137.55
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 58], 99.95th=[ 87],
| 99.99th=[ 186]
bw ( KiB/s): min= 6912, max=15360, per=0.21%, avg=11687.70, stdev=1830.48, samples=117
iops : min= 1728, max= 3840, avg=2921.88, stdev=457.64, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=53.87%, 20=42.70%, 50=3.19%
lat (msec) : 100=0.12%, 250=0.04%
cpu : usr=0.52%, sys=0.29%, ctx=62879, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.1%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=172262,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11946: Fri Aug 13 21:22:57 2021
read: IOPS=2644, BW=10.3MiB/s (10.8MB/s)(620MiB/60040msec)
slat (nsec): min=119, max=1096.9k, avg=354.25, stdev=4720.87
clat (usec): min=618, max=175287, avg=11871.12, stdev=6486.28
lat (usec): min=619, max=175287, avg=11871.48, stdev=6486.28
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 38], 99.50th=[ 49], 99.90th=[ 84], 99.95th=[ 95],
| 99.99th=[ 142]
bw ( KiB/s): min= 6112, max=15104, per=0.19%, avg=10770.50, stdev=2086.54, samples=117
iops : min= 1528, max= 3776, avg=2692.57, stdev=521.65, samples=117
lat (usec) : 750=0.01%
lat (msec) : 4=0.10%, 10=45.37%, 20=49.15%, 50=4.90%, 100=0.45%
lat (msec) : 250=0.04%
cpu : usr=0.46%, sys=0.33%, ctx=66478, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158778,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11947: Fri Aug 13 21:22:57 2021
read: IOPS=2664, BW=10.4MiB/s (10.9MB/s)(625MiB/60005msec)
slat (nsec): min=110, max=349826, avg=341.46, stdev=1314.81
clat (usec): min=1452, max=261196, avg=11752.78, stdev=6965.17
lat (usec): min=1452, max=261198, avg=11753.13, stdev=6965.22
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 45], 99.90th=[ 86], 99.95th=[ 127],
| 99.99th=[ 243]
bw ( KiB/s): min= 255, max=15256, per=0.19%, avg=10834.92, stdev=2428.88, samples=117
iops : min= 63, max= 3814, avg=2708.68, stdev=607.26, samples=117
lat (msec) : 2=0.01%, 4=0.06%, 10=47.26%, 20=47.61%, 50=4.67%
lat (msec) : 100=0.33%, 250=0.06%, 500=0.01%
cpu : usr=0.56%, sys=0.24%, ctx=64306, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.1%, 16=1.2%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=159881,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11948: Fri Aug 13 21:22:57 2021
read: IOPS=2902, BW=11.3MiB/s (11.9MB/s)(680MiB/60011msec)
slat (nsec): min=110, max=310320, avg=328.91, stdev=1090.34
clat (usec): min=970, max=99152, avg=10863.96, stdev=3975.86
lat (usec): min=1159, max=99152, avg=10864.29, stdev=3975.87
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12518], 90.00th=[14484], 95.00th=[16909],
| 99.00th=[24511], 99.50th=[29754], 99.90th=[50070], 99.95th=[62653],
| 99.99th=[98042]
bw ( KiB/s): min= 4071, max=17389, per=0.21%, avg=11739.74, stdev=1828.34, samples=118
iops : min= 1017, max= 4347, avg=2934.86, stdev=457.11, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=51.61%, 20=45.83%, 50=2.36%
lat (msec) : 100=0.11%
cpu : usr=0.47%, sys=0.35%, ctx=63887, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.6%, 16=61.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=174180,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11949: Fri Aug 13 21:22:57 2021
read: IOPS=2685, BW=10.5MiB/s (11.0MB/s)(630MiB/60017msec)
slat (nsec): min=110, max=4499.7k, avg=370.75, stdev=11224.97
clat (usec): min=1605, max=138034, avg=11749.19, stdev=5954.02
lat (usec): min=1606, max=138037, avg=11749.56, stdev=5954.33
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 44], 99.90th=[ 75], 99.95th=[ 101],
| 99.99th=[ 125]
bw ( KiB/s): min= 6387, max=15840, per=0.19%, avg=10830.04, stdev=2145.80, samples=118
iops : min= 1596, max= 3960, avg=2707.46, stdev=536.47, samples=118
lat (msec) : 2=0.01%, 4=0.19%, 10=44.98%, 20=49.59%, 50=4.90%
lat (msec) : 100=0.29%, 250=0.05%
cpu : usr=0.48%, sys=0.35%, ctx=66166, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.5%, 16=62.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.0%, 16=1.4%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=161192,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11950: Fri Aug 13 21:22:57 2021
read: IOPS=2814, BW=11.0MiB/s (11.5MB/s)(660MiB/60012msec)
slat (nsec): min=110, max=1761.2k, avg=336.16, stdev=4384.06
clat (usec): min=1312, max=233293, avg=11337.98, stdev=6623.48
lat (usec): min=1312, max=233293, avg=11338.32, stdev=6623.52
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 82], 99.95th=[ 86],
| 99.99th=[ 207]
bw ( KiB/s): min= 4854, max=26315, per=0.20%, avg=11290.10, stdev=2809.86, samples=119
iops : min= 1213, max= 6578, avg=2822.44, stdev=702.45, samples=119
lat (msec) : 2=0.01%, 4=2.65%, 10=49.04%, 20=43.35%, 50=4.49%
lat (msec) : 100=0.44%, 250=0.02%
cpu : usr=0.48%, sys=0.25%, ctx=65950, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.1%, 16=64.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.8%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168882,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11951: Fri Aug 13 21:22:57 2021
read: IOPS=2581, BW=10.1MiB/s (10.6MB/s)(605MiB/60012msec)
slat (nsec): min=110, max=160384, avg=318.80, stdev=790.03
clat (usec): min=1013, max=138654, avg=12181.99, stdev=6458.45
lat (usec): min=1013, max=138655, avg=12182.31, stdev=6458.47
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 38], 99.50th=[ 47], 99.90th=[ 89], 99.95th=[ 111],
| 99.99th=[ 129]
bw ( KiB/s): min= 766, max=14848, per=0.18%, avg=10423.57, stdev=2184.89, samples=118
iops : min= 191, max= 3712, avg=2605.82, stdev=546.23, samples=118
lat (msec) : 2=0.01%, 4=0.17%, 10=39.62%, 20=54.06%, 50=5.73%
lat (msec) : 100=0.35%, 250=0.06%
cpu : usr=0.47%, sys=0.31%, ctx=63875, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=51.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=154910,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11952: Fri Aug 13 21:22:57 2021
read: IOPS=2840, BW=11.1MiB/s (11.6MB/s)(666MiB/60011msec)
slat (nsec): min=110, max=36310k, avg=539.31, stdev=87974.61
clat (usec): min=924, max=136877, avg=11092.77, stdev=5380.01
lat (usec): min=930, max=136878, avg=11093.31, stdev=5380.39
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 81], 99.95th=[ 88],
| 99.99th=[ 103]
bw ( KiB/s): min= 3065, max=15104, per=0.20%, avg=11474.42, stdev=2224.47, samples=118
iops : min= 766, max= 3776, avg=2868.55, stdev=556.15, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=52.08%, 20=44.31%, 50=3.14%
lat (msec) : 100=0.33%, 250=0.03%
cpu : usr=0.54%, sys=0.27%, ctx=64720, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.4%, 16=61.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.1%, 16=2.2%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=170457,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11953: Fri Aug 13 21:22:57 2021
read: IOPS=2733, BW=10.7MiB/s (11.2MB/s)(641MiB/60005msec)
slat (nsec): min=109, max=299031, avg=325.63, stdev=1029.87
clat (usec): min=1379, max=252819, avg=11560.10, stdev=6165.01
lat (usec): min=1379, max=252819, avg=11560.42, stdev=6165.03
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 73], 99.95th=[ 86],
| 99.99th=[ 245]
bw ( KiB/s): min= 4864, max=14618, per=0.19%, avg=11047.28, stdev=2048.90, samples=118
iops : min= 1216, max= 3654, avg=2761.76, stdev=512.21, samples=118
lat (msec) : 2=0.01%, 4=0.10%, 10=47.38%, 20=47.87%, 50=4.33%
lat (msec) : 100=0.28%, 250=0.03%, 500=0.01%
cpu : usr=0.51%, sys=0.31%, ctx=67621, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.2%, 16=55.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=164051,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11954: Fri Aug 13 21:22:57 2021
read: IOPS=2700, BW=10.5MiB/s (11.1MB/s)(633MiB/60033msec)
slat (nsec): min=119, max=6267.1k, avg=486.08, stdev=23814.01
clat (usec): min=61, max=116567, avg=11661.28, stdev=4947.11
lat (usec): min=244, max=116568, avg=11661.77, stdev=4946.98
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 39], 99.90th=[ 60], 99.95th=[ 66],
| 99.99th=[ 110]
bw ( KiB/s): min= 3065, max=14592, per=0.19%, avg=10914.34, stdev=1991.48, samples=118
iops : min= 766, max= 3648, avg=2728.53, stdev=497.89, samples=118
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=42.65%, 20=52.91%, 50=4.10%
lat (msec) : 100=0.18%, 250=0.03%
cpu : usr=0.46%, sys=0.35%, ctx=65458, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.0%, 16=59.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=1.0%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=162115,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11955: Fri Aug 13 21:22:57 2021
read: IOPS=2665, BW=10.4MiB/s (10.9MB/s)(625MiB/60044msec)
slat (nsec): min=110, max=22204k, avg=462.21, stdev=55506.21
clat (usec): min=226, max=132358, avg=11776.29, stdev=5678.04
lat (usec): min=254, max=132358, avg=11776.76, stdev=5679.72
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 43], 99.90th=[ 70], 99.95th=[ 73],
| 99.99th=[ 123]
bw ( KiB/s): min= 4854, max=15872, per=0.19%, avg=10858.83, stdev=2126.77, samples=117
iops : min= 1213, max= 3968, avg=2714.65, stdev=531.72, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=45.59%, 20=48.91%, 50=5.15%
lat (msec) : 100=0.27%, 250=0.04%
cpu : usr=0.52%, sys=0.29%, ctx=67056, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.3%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160063,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11956: Fri Aug 13 21:22:57 2021
read: IOPS=2769, BW=10.8MiB/s (11.3MB/s)(649MiB/60009msec)
slat (nsec): min=110, max=619867, avg=327.70, stdev=1664.54
clat (usec): min=386, max=251145, avg=11407.95, stdev=5934.15
lat (usec): min=387, max=251146, avg=11408.28, stdev=5934.17
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 67], 99.95th=[ 114],
| 99.99th=[ 228]
bw ( KiB/s): min= 4592, max=16095, per=0.20%, avg=11172.37, stdev=1996.90, samples=118
iops : min= 1148, max= 4023, avg=2793.02, stdev=499.20, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.17%, 10=48.09%, 20=47.47%, 50=4.09%
lat (msec) : 100=0.13%, 250=0.05%, 500=0.01%
cpu : usr=0.49%, sys=0.33%, ctx=63219, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.7%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=166177,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11957: Fri Aug 13 21:22:57 2021
read: IOPS=2698, BW=10.5MiB/s (11.1MB/s)(633MiB/60035msec)
slat (nsec): min=110, max=1272.6k, avg=347.92, stdev=4276.20
clat (usec): min=40, max=111532, avg=11641.60, stdev=5973.87
lat (usec): min=190, max=111532, avg=11641.95, stdev=5973.91
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 47], 99.90th=[ 86], 99.95th=[ 94],
| 99.99th=[ 110]
bw ( KiB/s): min= 5620, max=14962, per=0.19%, avg=11012.53, stdev=2025.34, samples=117
iops : min= 1405, max= 3740, avg=2753.10, stdev=506.34, samples=117
lat (usec) : 50=0.01%, 250=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=46.66%, 20=48.52%, 50=4.31%
lat (msec) : 100=0.42%, 250=0.02%
cpu : usr=0.53%, sys=0.26%, ctx=66139, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=161988,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11958: Fri Aug 13 21:22:57 2021
read: IOPS=2634, BW=10.3MiB/s (10.8MB/s)(618MiB/60024msec)
slat (nsec): min=119, max=9939.7k, avg=434.97, stdev=25761.68
clat (usec): min=66, max=147180, avg=11912.38, stdev=6032.40
lat (usec): min=343, max=147181, avg=11912.82, stdev=6032.34
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 79], 99.95th=[ 100],
| 99.99th=[ 146]
bw ( KiB/s): min= 6744, max=15816, per=0.19%, avg=10721.58, stdev=1984.19, samples=117
iops : min= 1686, max= 3954, avg=2680.32, stdev=496.07, samples=117
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=42.55%, 20=52.35%, 50=4.62%
lat (msec) : 100=0.36%, 250=0.04%
cpu : usr=0.49%, sys=0.30%, ctx=62048, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=158160,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11959: Fri Aug 13 21:22:57 2021
read: IOPS=2547, BW=9.95MiB/s (10.4MB/s)(597MiB/60035msec)
slat (nsec): min=100, max=4272.3k, avg=404.96, stdev=12779.90
clat (usec): min=1017, max=107900, avg=12298.93, stdev=6502.73
lat (usec): min=1017, max=107901, avg=12299.33, stdev=6502.73
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7701], 10.00th=[ 8160], 20.00th=[ 8848],
| 30.00th=[ 9503], 40.00th=[10028], 50.00th=[10683], 60.00th=[11469],
| 70.00th=[12649], 80.00th=[13960], 90.00th=[17171], 95.00th=[21365],
| 99.00th=[39060], 99.50th=[50594], 99.90th=[87557], 99.95th=[93848],
| 99.99th=[98042]
bw ( KiB/s): min= 4087, max=15056, per=0.18%, avg=10362.32, stdev=2001.12, samples=117
iops : min= 1021, max= 3764, avg=2590.51, stdev=500.30, samples=117
lat (msec) : 2=0.01%, 4=0.11%, 10=39.07%, 20=54.57%, 50=5.72%
lat (msec) : 100=0.52%, 250=0.01%
cpu : usr=0.46%, sys=0.32%, ctx=64356, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.3%, 16=61.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=1.4%, 16=1.2%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=152931,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11960: Fri Aug 13 21:22:57 2021
read: IOPS=2730, BW=10.7MiB/s (11.2MB/s)(640MiB/60041msec)
slat (nsec): min=110, max=1911.6k, avg=358.51, stdev=5726.85
clat (usec): min=162, max=119741, avg=11558.05, stdev=5596.54
lat (usec): min=436, max=119741, avg=11558.41, stdev=5596.55
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 81], 99.95th=[ 109],
| 99.99th=[ 120]
bw ( KiB/s): min= 3632, max=16870, per=0.19%, avg=11035.70, stdev=2057.36, samples=118
iops : min= 908, max= 4217, avg=2758.85, stdev=514.33, samples=118
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.26%, 10=44.79%, 20=50.85%, 50=3.80%
lat (msec) : 100=0.24%, 250=0.05%
cpu : usr=0.50%, sys=0.31%, ctx=65582, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.0%, 16=54.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=163944,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11961: Fri Aug 13 21:22:57 2021
read: IOPS=2802, BW=10.9MiB/s (11.5MB/s)(657MiB/60014msec)
slat (nsec): min=109, max=1014.2k, avg=351.91, stdev=2842.15
clat (usec): min=521, max=149316, avg=11329.15, stdev=5489.43
lat (usec): min=521, max=149316, avg=11329.50, stdev=5489.44
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 72], 99.95th=[ 89],
| 99.99th=[ 146]
bw ( KiB/s): min= 769, max=18147, per=0.20%, avg=11251.21, stdev=2392.53, samples=119
iops : min= 192, max= 4536, avg=2812.68, stdev=598.10, samples=119
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.62%, 10=49.13%, 20=45.84%, 50=4.18%
lat (msec) : 100=0.17%, 250=0.04%
cpu : usr=0.54%, sys=0.18%, ctx=57140, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.8%, 16=60.4%, 32=24.7%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.8%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=168179,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11962: Fri Aug 13 21:22:57 2021
read: IOPS=2764, BW=10.8MiB/s (11.3MB/s)(648MiB/60013msec)
slat (nsec): min=110, max=1768.5k, avg=380.27, stdev=7849.74
clat (usec): min=905, max=109721, avg=11497.34, stdev=5458.52
lat (usec): min=906, max=109722, avg=11497.72, stdev=5458.52
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 41], 99.90th=[ 82], 99.95th=[ 88],
| 99.99th=[ 107]
bw ( KiB/s): min= 1024, max=26570, per=0.19%, avg=11067.21, stdev=2521.74, samples=119
iops : min= 256, max= 6642, avg=2766.76, stdev=630.41, samples=119
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=1.47%, 10=43.57%, 20=50.59%, 50=4.06%
lat (msec) : 100=0.28%, 250=0.02%
cpu : usr=0.52%, sys=0.22%, ctx=66192, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.7%, 16=62.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=0.4%, 16=2.3%, 32=1.3%, 64=0.0%, >=64=0.0%
issued rwts: total=165882,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11963: Fri Aug 13 21:22:57 2021
read: IOPS=2887, BW=11.3MiB/s (11.8MB/s)(677MiB/60017msec)
slat (nsec): min=110, max=99379, avg=325.38, stdev=613.92
clat (usec): min=133, max=179432, avg=10916.35, stdev=5441.87
lat (usec): min=141, max=179433, avg=10916.67, stdev=5441.89
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 65], 99.95th=[ 95],
| 99.99th=[ 180]
bw ( KiB/s): min= 3049, max=15104, per=0.21%, avg=11678.00, stdev=2226.73, samples=118
iops : min= 762, max= 3776, avg=2919.44, stdev=556.70, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.19%, 10=54.99%, 20=41.17%, 50=3.41%
lat (msec) : 100=0.21%, 250=0.03%
cpu : usr=0.52%, sys=0.30%, ctx=62463, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.5%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.1%, 16=1.7%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=173291,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11964: Fri Aug 13 21:22:57 2021
read: IOPS=2719, BW=10.6MiB/s (11.1MB/s)(638MiB/60034msec)
slat (nsec): min=110, max=680071, avg=315.44, stdev=2221.36
clat (msec): min=2, max=118, avg=11.51, stdev= 4.84
lat (msec): min=2, max=118, avg=11.51, stdev= 4.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 36], 99.90th=[ 63], 99.95th=[ 91],
| 99.99th=[ 117]
bw ( KiB/s): min= 4598, max=14848, per=0.19%, avg=11080.49, stdev=1903.77, samples=117
iops : min= 1149, max= 3712, avg=2770.06, stdev=475.99, samples=117
lat (msec) : 4=0.08%, 10=43.99%, 20=52.44%, 50=3.29%, 100=0.16%
lat (msec) : 250=0.04%
cpu : usr=0.52%, sys=0.27%, ctx=62389, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.0%, 16=54.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=163278,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11965: Fri Aug 13 21:22:57 2021
read: IOPS=2790, BW=10.9MiB/s (11.4MB/s)(654MiB/60007msec)
slat (nsec): min=100, max=4640.7k, avg=376.01, stdev=12092.34
clat (usec): min=36, max=177951, avg=11190.55, stdev=5708.07
lat (usec): min=919, max=177952, avg=11190.93, stdev=5708.04
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 41], 99.90th=[ 66], 99.95th=[ 118],
| 99.99th=[ 144]
bw ( KiB/s): min= 3872, max=14592, per=0.20%, avg=11361.70, stdev=2100.46, samples=117
iops : min= 968, max= 3648, avg=2840.37, stdev=525.11, samples=117
lat (usec) : 50=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=52.43%, 20=43.62%, 50=3.52%
lat (msec) : 100=0.26%, 250=0.05%
cpu : usr=0.52%, sys=0.30%, ctx=65807, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.2%, 16=51.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=167461,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11966: Fri Aug 13 21:22:57 2021
read: IOPS=2831, BW=11.1MiB/s (11.6MB/s)(664MiB/60014msec)
slat (nsec): min=119, max=5774.7k, avg=392.67, stdev=15526.81
clat (usec): min=132, max=197215, avg=11212.77, stdev=5728.51
lat (usec): min=153, max=197216, avg=11213.16, stdev=5728.49
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 63], 99.95th=[ 89],
| 99.99th=[ 199]
bw ( KiB/s): min= 256, max=21461, per=0.20%, avg=11353.25, stdev=2464.46, samples=119
iops : min= 64, max= 5365, avg=2838.24, stdev=616.10, samples=119
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.59%, 10=49.58%, 20=45.82%, 50=3.83%
lat (msec) : 100=0.13%, 250=0.05%
cpu : usr=0.55%, sys=0.18%, ctx=68496, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.5%, 16=54.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169953,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11967: Fri Aug 13 21:22:57 2021
read: IOPS=2874, BW=11.2MiB/s (11.8MB/s)(674MiB/60046msec)
slat (nsec): min=110, max=1750.0k, avg=345.10, stdev=4579.52
clat (msec): min=2, max=125, avg=10.95, stdev= 4.77
lat (msec): min=2, max=125, avg=10.95, stdev= 4.77
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 69], 99.95th=[ 91],
| 99.99th=[ 126]
bw ( KiB/s): min= 982, max=15944, per=0.20%, avg=11637.10, stdev=1983.12, samples=118
iops : min= 245, max= 3986, avg=2909.23, stdev=495.81, samples=118
lat (msec) : 4=0.15%, 10=53.45%, 20=43.22%, 50=3.02%, 100=0.13%
lat (msec) : 250=0.04%
cpu : usr=0.51%, sys=0.32%, ctx=64519, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.2%, 16=62.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.9%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=172627,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11968: Fri Aug 13 21:22:57 2021
read: IOPS=2901, BW=11.3MiB/s (11.9MB/s)(680MiB/60015msec)
slat (nsec): min=110, max=1911.2k, avg=327.57, stdev=5319.48
clat (usec): min=206, max=148960, avg=10806.48, stdev=4211.76
lat (usec): min=232, max=148961, avg=10806.81, stdev=4211.75
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 25], 99.50th=[ 29], 99.90th=[ 56], 99.95th=[ 67],
| 99.99th=[ 150]
bw ( KiB/s): min= 5620, max=15080, per=0.21%, avg=11840.21, stdev=1810.78, samples=117
iops : min= 1405, max= 3770, avg=2959.99, stdev=452.69, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=54.20%, 20=43.16%, 50=2.41%
lat (msec) : 100=0.11%, 250=0.02%
cpu : usr=0.41%, sys=0.39%, ctx=65655, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.5%, 16=52.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=174144,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11969: Fri Aug 13 21:22:57 2021
read: IOPS=2911, BW=11.4MiB/s (11.9MB/s)(683MiB/60010msec)
slat (nsec): min=110, max=8989.5k, avg=392.94, stdev=23109.54
clat (usec): min=37, max=202682, avg=10892.82, stdev=5176.40
lat (usec): min=244, max=211343, avg=10893.21, stdev=5179.09
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 34], 99.90th=[ 58], 99.95th=[ 75],
| 99.99th=[ 203]
bw ( KiB/s): min= 7168, max=15360, per=0.21%, avg=11757.69, stdev=1772.14, samples=118
iops : min= 1792, max= 3840, avg=2939.36, stdev=443.03, samples=118
lat (usec) : 50=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 4=0.16%, 10=54.41%, 20=42.01%, 50=3.27%, 100=0.11%
lat (msec) : 250=0.03%
cpu : usr=0.55%, sys=0.28%, ctx=66018, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=174722,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11970: Fri Aug 13 21:22:57 2021
read: IOPS=2831, BW=11.1MiB/s (11.6MB/s)(664MiB/60013msec)
slat (nsec): min=110, max=101611, avg=327.54, stdev=642.86
clat (usec): min=550, max=120550, avg=11125.94, stdev=4964.36
lat (usec): min=588, max=120551, avg=11126.27, stdev=4964.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 40], 99.90th=[ 59], 99.95th=[ 88],
| 99.99th=[ 121]
bw ( KiB/s): min= 1021, max=15360, per=0.20%, avg=11438.26, stdev=2365.63, samples=118
iops : min= 255, max= 3840, avg=2859.50, stdev=591.44, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=50.23%, 20=46.21%, 50=3.27%
lat (msec) : 100=0.15%, 250=0.03%
cpu : usr=0.55%, sys=0.26%, ctx=65570, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169923,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11971: Fri Aug 13 21:22:57 2021
read: IOPS=2752, BW=10.8MiB/s (11.3MB/s)(645MiB/60037msec)
slat (nsec): min=110, max=975915, avg=351.44, stdev=3478.57
clat (usec): min=1436, max=104853, avg=11384.33, stdev=4939.44
lat (usec): min=1437, max=104854, avg=11384.68, stdev=4939.47
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 62], 99.95th=[ 66],
| 99.99th=[ 102]
bw ( KiB/s): min= 5120, max=15016, per=0.20%, avg=11199.22, stdev=1845.10, samples=117
iops : min= 1280, max= 3754, avg=2799.75, stdev=461.27, samples=117
lat (msec) : 2=0.01%, 4=0.11%, 10=46.50%, 20=49.63%, 50=3.50%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.46%, sys=0.36%, ctx=64591, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.5%, 16=56.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=0.7%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165244,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11972: Fri Aug 13 21:22:57 2021
read: IOPS=2576, BW=10.1MiB/s (10.6MB/s)(604MiB/60003msec)
slat (nsec): min=110, max=21778k, avg=551.53, stdev=58068.64
clat (usec): min=177, max=115883, avg=12178.14, stdev=6619.25
lat (usec): min=204, max=115884, avg=12178.69, stdev=6619.35
clat percentiles (usec):
| 1.00th=[ 6915], 5.00th=[ 7701], 10.00th=[ 8160], 20.00th=[ 8717],
| 30.00th=[ 9372], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[11207],
| 70.00th=[12256], 80.00th=[13698], 90.00th=[16909], 95.00th=[21890],
| 99.00th=[42206], 99.50th=[54264], 99.90th=[81265], 99.95th=[95945],
| 99.99th=[96994]
bw ( KiB/s): min= 4096, max=14544, per=0.18%, avg=10487.16, stdev=1976.80, samples=117
iops : min= 1024, max= 3636, avg=2621.72, stdev=494.23, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=41.96%, 20=51.60%, 50=5.79%
lat (msec) : 100=0.61%, 250=0.01%
cpu : usr=0.46%, sys=0.30%, ctx=64667, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.6%, 16=0.3%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=154625,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11973: Fri Aug 13 21:22:57 2021
read: IOPS=2612, BW=10.2MiB/s (10.7MB/s)(612MiB/60013msec)
slat (nsec): min=120, max=384033, avg=350.64, stdev=1348.06
clat (usec): min=1348, max=108118, avg=12004.09, stdev=5733.23
lat (usec): min=1348, max=108119, avg=12004.44, stdev=5733.26
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 35], 99.50th=[ 43], 99.90th=[ 71], 99.95th=[ 84],
| 99.99th=[ 108]
bw ( KiB/s): min= 4854, max=14568, per=0.19%, avg=10651.06, stdev=1884.70, samples=117
iops : min= 1213, max= 3642, avg=2662.69, stdev=471.18, samples=117
lat (msec) : 2=0.01%, 4=0.02%, 10=41.68%, 20=52.37%, 50=5.61%
lat (msec) : 100=0.29%, 250=0.02%
cpu : usr=0.52%, sys=0.29%, ctx=64055, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.1%, 16=63.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.2%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=156796,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11974: Fri Aug 13 21:22:57 2021
read: IOPS=2705, BW=10.6MiB/s (11.1MB/s)(634MiB/60010msec)
slat (nsec): min=110, max=7384.6k, avg=374.63, stdev=18335.70
clat (usec): min=1461, max=441618, avg=11713.15, stdev=8660.50
lat (usec): min=1461, max=441619, avg=11713.53, stdev=8660.50
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 54], 99.90th=[ 92], 99.95th=[ 131],
| 99.99th=[ 435]
bw ( KiB/s): min= 4544, max=24271, per=0.19%, avg=10914.36, stdev=2493.26, samples=118
iops : min= 1136, max= 6067, avg=2728.54, stdev=623.27, samples=118
lat (msec) : 2=0.01%, 4=1.91%, 10=42.82%, 20=50.23%, 50=4.48%
lat (msec) : 100=0.48%, 250=0.06%, 500=0.02%
cpu : usr=0.48%, sys=0.25%, ctx=60586, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.4%, 16=0.8%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162377,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11975: Fri Aug 13 21:22:57 2021
read: IOPS=2724, BW=10.6MiB/s (11.2MB/s)(639MiB/60004msec)
slat (nsec): min=119, max=371233, avg=335.48, stdev=1853.96
clat (usec): min=193, max=162237, avg=11522.57, stdev=5857.51
lat (usec): min=219, max=162237, avg=11522.91, stdev=5857.55
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 45], 99.90th=[ 86], 99.95th=[ 90],
| 99.99th=[ 161]
bw ( KiB/s): min= 4864, max=15440, per=0.19%, avg=11092.12, stdev=2165.52, samples=117
iops : min= 1216, max= 3860, avg=2772.97, stdev=541.40, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=47.74%, 20=47.98%, 50=3.82%
lat (msec) : 100=0.32%, 250=0.03%
cpu : usr=0.48%, sys=0.32%, ctx=65842, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.4%, 16=61.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.6%, 16=1.3%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=163500,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11976: Fri Aug 13 21:22:57 2021
read: IOPS=2863, BW=11.2MiB/s (11.7MB/s)(671MiB/60005msec)
slat (nsec): min=110, max=143796, avg=324.32, stdev=754.46
clat (msec): min=2, max=128, avg=11.02, stdev= 4.96
lat (msec): min=2, max=128, avg=11.02, stdev= 4.96
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 40], 99.90th=[ 63], 99.95th=[ 72],
| 99.99th=[ 128]
bw ( KiB/s): min= 4096, max=18906, per=0.20%, avg=11570.75, stdev=2115.79, samples=118
iops : min= 1024, max= 4726, avg=2892.62, stdev=528.93, samples=118
lat (msec) : 4=0.96%, 10=51.01%, 20=44.43%, 50=3.34%, 100=0.23%
lat (msec) : 250=0.02%
cpu : usr=0.53%, sys=0.28%, ctx=66121, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.9%, 16=60.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.6%, 16=0.6%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=171840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11977: Fri Aug 13 21:22:57 2021
read: IOPS=2715, BW=10.6MiB/s (11.1MB/s)(637MiB/60035msec)
slat (nsec): min=110, max=95629, avg=326.98, stdev=640.15
clat (usec): min=470, max=136825, avg=11563.31, stdev=6329.29
lat (usec): min=476, max=136826, avg=11563.64, stdev=6329.32
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 83], 99.95th=[ 100],
| 99.99th=[ 138]
bw ( KiB/s): min= 5416, max=15584, per=0.19%, avg=11070.09, stdev=2268.08, samples=117
iops : min= 1354, max= 3896, avg=2767.45, stdev=567.03, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.11%, 10=49.99%, 20=44.95%, 50=4.50%, 100=0.40%
lat (msec) : 250=0.04%
cpu : usr=0.49%, sys=0.28%, ctx=61089, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.1%, 16=54.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163042,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11978: Fri Aug 13 21:22:57 2021
read: IOPS=2558, BW=10.00MiB/s (10.5MB/s)(600MiB/60016msec)
slat (nsec): min=120, max=305309, avg=334.99, stdev=1110.56
clat (msec): min=2, max=232, avg=12.26, stdev= 6.67
lat (msec): min=2, max=232, avg=12.26, stdev= 6.67
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 46], 99.90th=[ 73], 99.95th=[ 92],
| 99.99th=[ 232]
bw ( KiB/s): min= 5368, max=15160, per=0.18%, avg=10410.97, stdev=2104.95, samples=117
iops : min= 1342, max= 3790, avg=2602.68, stdev=526.21, samples=117
lat (msec) : 4=0.16%, 10=38.06%, 20=55.90%, 50=5.47%, 100=0.38%
lat (msec) : 250=0.02%
cpu : usr=0.44%, sys=0.33%, ctx=64331, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.5%, 16=60.6%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.4%, 16=1.7%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=153579,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11979: Fri Aug 13 21:22:57 2021
read: IOPS=2838, BW=11.1MiB/s (11.6MB/s)(665MiB/60017msec)
slat (nsec): min=120, max=866912, avg=344.12, stdev=3099.38
clat (usec): min=285, max=311738, avg=11049.63, stdev=6855.27
lat (usec): min=290, max=311738, avg=11049.97, stdev=6855.27
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 67], 99.95th=[ 92],
| 99.99th=[ 292]
bw ( KiB/s): min= 3824, max=15104, per=0.20%, avg=11554.71, stdev=2037.97, samples=117
iops : min= 956, max= 3776, avg=2888.62, stdev=509.48, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=52.33%, 20=44.26%, 50=3.07%
lat (msec) : 100=0.18%, 250=0.01%, 500=0.04%
cpu : usr=0.54%, sys=0.28%, ctx=65038, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.8%, 16=61.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.7%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=170351,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11980: Fri Aug 13 21:22:57 2021
read: IOPS=2570, BW=10.0MiB/s (10.5MB/s)(603MiB/60012msec)
slat (nsec): min=110, max=7558.4k, avg=424.54, stdev=21879.85
clat (usec): min=530, max=129657, avg=12234.78, stdev=7011.81
lat (usec): min=1089, max=129657, avg=12235.20, stdev=7011.76
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 41], 99.50th=[ 55], 99.90th=[ 100], 99.95th=[ 113],
| 99.99th=[ 120]
bw ( KiB/s): min= 766, max=15232, per=0.18%, avg=10369.03, stdev=2200.62, samples=118
iops : min= 191, max= 3808, avg=2592.19, stdev=550.17, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=41.57%, 20=52.22%, 50=5.53%
lat (msec) : 100=0.49%, 250=0.07%
cpu : usr=0.46%, sys=0.33%, ctx=65388, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.0%, 16=56.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=154268,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11981: Fri Aug 13 21:22:57 2021
read: IOPS=2756, BW=10.8MiB/s (11.3MB/s)(646MiB/60008msec)
slat (nsec): min=110, max=757947, avg=333.27, stdev=2022.52
clat (usec): min=175, max=158411, avg=11388.42, stdev=6007.03
lat (usec): min=181, max=158412, avg=11388.76, stdev=6007.07
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 44], 99.90th=[ 90], 99.95th=[ 111],
| 99.99th=[ 159]
bw ( KiB/s): min= 4096, max=14632, per=0.20%, avg=11216.61, stdev=2219.62, samples=117
iops : min= 1024, max= 3658, avg=2804.10, stdev=554.90, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.13%, 10=48.20%, 20=47.53%, 50=3.82%, 100=0.24%
lat (msec) : 250=0.08%
cpu : usr=0.48%, sys=0.34%, ctx=63361, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.3%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=165439,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11982: Fri Aug 13 21:22:57 2021
read: IOPS=2809, BW=11.0MiB/s (11.5MB/s)(659MiB/60016msec)
slat (nsec): min=110, max=30769k, avg=531.37, stdev=75192.41
clat (usec): min=71, max=564817, avg=11192.65, stdev=8547.79
lat (usec): min=345, max=564818, avg=11193.18, stdev=8547.90
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 37], 99.90th=[ 77], 99.95th=[ 105],
| 99.99th=[ 558]
bw ( KiB/s): min= 1532, max=15352, per=0.20%, avg=11345.69, stdev=2221.23, samples=118
iops : min= 383, max= 3838, avg=2836.36, stdev=555.29, samples=118
lat (usec) : 100=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 4=0.06%, 10=51.14%, 20=45.21%, 50=3.33%, 100=0.20%
lat (msec) : 250=0.04%, 750=0.02%
cpu : usr=0.50%, sys=0.32%, ctx=67319, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=62.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=168642,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11983: Fri Aug 13 21:22:57 2021
read: IOPS=2952, BW=11.5MiB/s (12.1MB/s)(692MiB/60042msec)
slat (nsec): min=110, max=128467, avg=313.59, stdev=603.86
clat (usec): min=735, max=126904, avg=10805.40, stdev=4719.95
lat (usec): min=735, max=126905, avg=10805.71, stdev=4719.97
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 55], 99.95th=[ 63],
| 99.99th=[ 122]
bw ( KiB/s): min= 5320, max=32825, per=0.21%, avg=11835.55, stdev=2734.38, samples=119
iops : min= 1330, max= 8206, avg=2958.82, stdev=683.60, samples=119
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=2.43%, 10=50.58%, 20=43.51%, 50=3.35%
lat (msec) : 100=0.11%, 250=0.02%
cpu : usr=0.50%, sys=0.25%, ctx=65953, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=177253,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11984: Fri Aug 13 21:22:57 2021
read: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(716MiB/60009msec)
slat (nsec): min=110, max=4906.7k, avg=345.52, stdev=11922.28
clat (usec): min=39, max=131595, avg=10448.25, stdev=4697.54
lat (usec): min=311, max=131595, avg=10448.60, stdev=4697.49
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 27], 99.50th=[ 33], 99.90th=[ 63], 99.95th=[ 87],
| 99.99th=[ 132]
bw ( KiB/s): min= 5448, max=23249, per=0.22%, avg=12240.22, stdev=2222.47, samples=119
iops : min= 1362, max= 5812, avg=3059.98, stdev=555.62, samples=119
lat (usec) : 50=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=2.16%, 10=57.15%, 20=38.22%, 50=2.25%
lat (msec) : 100=0.19%, 250=0.02%
cpu : usr=0.54%, sys=0.23%, ctx=62597, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.4%, 16=58.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.4%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=183211,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11985: Fri Aug 13 21:22:57 2021
read: IOPS=2819, BW=11.0MiB/s (11.5MB/s)(661MiB/60044msec)
slat (nsec): min=110, max=605241, avg=337.66, stdev=2053.01
clat (usec): min=281, max=229735, avg=11106.59, stdev=6043.19
lat (usec): min=304, max=229737, avg=11106.93, stdev=6043.24
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 39], 99.90th=[ 99], 99.95th=[ 118],
| 99.99th=[ 207]
bw ( KiB/s): min= 510, max=15360, per=0.20%, avg=11508.82, stdev=2108.89, samples=117
iops : min= 127, max= 3840, avg=2877.13, stdev=527.22, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=51.46%, 20=45.36%, 50=2.81%
lat (msec) : 100=0.20%, 250=0.09%
cpu : usr=0.51%, sys=0.29%, ctx=59812, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.6%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=169283,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11986: Fri Aug 13 21:22:57 2021
read: IOPS=2800, BW=10.9MiB/s (11.5MB/s)(657MiB/60008msec)
slat (nsec): min=120, max=239355, avg=331.72, stdev=1212.38
clat (usec): min=692, max=118886, avg=11216.52, stdev=4624.14
lat (usec): min=693, max=118886, avg=11216.85, stdev=4624.17
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 54], 99.95th=[ 73],
| 99.99th=[ 116]
bw ( KiB/s): min= 6536, max=14850, per=0.20%, avg=11394.26, stdev=1704.17, samples=117
iops : min= 1634, max= 3712, avg=2848.51, stdev=426.05, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=48.53%, 20=48.10%, 50=3.17%
lat (msec) : 100=0.12%, 250=0.02%
cpu : usr=0.44%, sys=0.37%, ctx=64610, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.4%, 16=63.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.1%, 16=1.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=168066,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11987: Fri Aug 13 21:22:57 2021
read: IOPS=2708, BW=10.6MiB/s (11.1MB/s)(635MiB/60044msec)
slat (nsec): min=110, max=24689k, avg=599.16, stdev=71995.65
clat (usec): min=891, max=122104, avg=11618.70, stdev=5378.64
lat (usec): min=891, max=122105, avg=11619.30, stdev=5378.98
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 73], 99.95th=[ 89],
| 99.99th=[ 118]
bw ( KiB/s): min= 487, max=15872, per=0.19%, avg=10958.44, stdev=2113.46, samples=118
iops : min= 121, max= 3968, avg=2739.55, stdev=528.39, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=44.49%, 20=51.12%, 50=3.99%
lat (msec) : 100=0.25%, 250=0.02%
cpu : usr=0.48%, sys=0.33%, ctx=65788, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.5%, 16=62.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.1%, 16=2.3%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162615,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11988: Fri Aug 13 21:22:57 2021
read: IOPS=2660, BW=10.4MiB/s (10.9MB/s)(624MiB/60024msec)
slat (nsec): min=110, max=2958.2k, avg=343.92, stdev=7459.80
clat (usec): min=308, max=155252, avg=11804.34, stdev=6396.70
lat (usec): min=335, max=155252, avg=11804.68, stdev=6396.71
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 90], 99.95th=[ 99],
| 99.99th=[ 148]
bw ( KiB/s): min= 5376, max=14848, per=0.19%, avg=10816.80, stdev=1972.25, samples=117
iops : min= 1344, max= 3712, avg=2704.15, stdev=493.06, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=44.57%, 20=50.11%, 50=4.78%
lat (msec) : 100=0.35%, 250=0.04%
cpu : usr=0.53%, sys=0.27%, ctx=68757, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.1%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=159684,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11989: Fri Aug 13 21:22:57 2021
read: IOPS=2854, BW=11.2MiB/s (11.7MB/s)(669MiB/60004msec)
slat (nsec): min=99, max=120568, avg=325.89, stdev=646.58
clat (msec): min=2, max=196, avg=11.00, stdev= 5.71
lat (msec): min=2, max=196, avg=11.00, stdev= 5.71
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 40], 99.90th=[ 67], 99.95th=[ 128],
| 99.99th=[ 192]
bw ( KiB/s): min= 3328, max=15648, per=0.20%, avg=11639.40, stdev=2161.42, samples=117
iops : min= 832, max= 3912, avg=2909.79, stdev=540.37, samples=117
lat (msec) : 4=0.19%, 10=52.97%, 20=43.66%, 50=2.95%, 100=0.16%
lat (msec) : 250=0.07%
cpu : usr=0.51%, sys=0.30%, ctx=61981, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=171303,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11990: Fri Aug 13 21:22:57 2021
read: IOPS=2809, BW=11.0MiB/s (11.5MB/s)(659MiB/60009msec)
slat (nsec): min=119, max=11638k, avg=387.05, stdev=28368.40
clat (msec): min=2, max=228, avg=11.16, stdev= 5.12
lat (msec): min=2, max=228, avg=11.16, stdev= 5.12
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 27], 99.50th=[ 33], 99.90th=[ 57], 99.95th=[ 73],
| 99.99th=[ 220]
bw ( KiB/s): min= 7217, max=14592, per=0.20%, avg=11436.29, stdev=1739.74, samples=117
iops : min= 1804, max= 3648, avg=2859.02, stdev=434.94, samples=117
lat (msec) : 4=0.07%, 10=50.16%, 20=46.40%, 50=3.24%, 100=0.10%
lat (msec) : 250=0.03%
cpu : usr=0.50%, sys=0.30%, ctx=65556, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.0%, 16=57.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.4%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=168583,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11991: Fri Aug 13 21:22:57 2021
read: IOPS=2886, BW=11.3MiB/s (11.8MB/s)(677MiB/60023msec)
slat (nsec): min=110, max=517849, avg=322.26, stdev=1669.32
clat (msec): min=3, max=165, avg=10.95, stdev= 5.39
lat (msec): min=3, max=165, avg=10.95, stdev= 5.39
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 68], 99.95th=[ 118],
| 99.99th=[ 165]
bw ( KiB/s): min= 4352, max=15816, per=0.20%, avg=11657.49, stdev=1998.04, samples=118
iops : min= 1088, max= 3954, avg=2914.31, stdev=499.52, samples=118
lat (msec) : 4=0.16%, 10=52.37%, 20=44.68%, 50=2.50%, 100=0.24%
lat (msec) : 250=0.06%
cpu : usr=0.52%, sys=0.28%, ctx=65882, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.4%, 16=51.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=173276,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11992: Fri Aug 13 21:22:57 2021
read: IOPS=2982, BW=11.7MiB/s (12.2MB/s)(699MiB/60030msec)
slat (nsec): min=119, max=95269, avg=324.86, stdev=666.61
clat (usec): min=1629, max=63583, avg=10625.93, stdev=3898.52
lat (usec): min=1629, max=63583, avg=10626.26, stdev=3898.54
clat percentiles (usec):
| 1.00th=[ 4621], 5.00th=[ 7242], 10.00th=[ 7767], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14353], 95.00th=[16712],
| 99.00th=[26870], 99.50th=[32375], 99.90th=[45351], 99.95th=[53740],
| 99.99th=[60556]
bw ( KiB/s): min= 5632, max=18650, per=0.21%, avg=12083.74, stdev=1870.13, samples=118
iops : min= 1408, max= 4662, avg=3020.87, stdev=467.49, samples=118
lat (msec) : 2=0.01%, 4=0.64%, 10=55.53%, 20=41.41%, 50=2.35%
lat (msec) : 100=0.07%
cpu : usr=0.55%, sys=0.27%, ctx=61507, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.3%, 16=59.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=1.1%, 16=0.7%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=179066,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11993: Fri Aug 13 21:22:57 2021
read: IOPS=2799, BW=10.9MiB/s (11.5MB/s)(656MiB/60013msec)
slat (nsec): min=100, max=77368k, avg=1078.11, stdev=192948.44
clat (usec): min=117, max=135672, avg=11199.64, stdev=5679.00
lat (usec): min=548, max=135672, avg=11200.72, stdev=5682.30
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 42], 99.90th=[ 82], 99.95th=[ 100],
| 99.99th=[ 131]
bw ( KiB/s): min= 6136, max=15616, per=0.20%, avg=11412.35, stdev=2056.04, samples=117
iops : min= 1534, max= 3904, avg=2853.01, stdev=514.02, samples=117
lat (usec) : 250=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=52.65%, 20=43.02%, 50=3.92%
lat (msec) : 100=0.27%, 250=0.03%
cpu : usr=0.51%, sys=0.31%, ctx=61856, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.1%, 16=56.0%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.5%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=167989,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11994: Fri Aug 13 21:22:57 2021
read: IOPS=2902, BW=11.3MiB/s (11.9MB/s)(680MiB/60002msec)
slat (nsec): min=110, max=3076.6k, avg=330.27, stdev=7390.43
clat (usec): min=598, max=205164, avg=10802.25, stdev=4901.82
lat (usec): min=598, max=205164, avg=10802.58, stdev=4902.03
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 27], 99.50th=[ 35], 99.90th=[ 63], 99.95th=[ 83],
| 99.99th=[ 203]
bw ( KiB/s): min= 4031, max=15096, per=0.21%, avg=11817.40, stdev=1902.38, samples=117
iops : min= 1007, max= 3774, avg=2954.28, stdev=475.64, samples=117
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=54.30%, 20=42.94%, 50=2.39%
lat (msec) : 100=0.21%, 250=0.02%
cpu : usr=0.50%, sys=0.31%, ctx=63317, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.8%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.9%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=174152,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11995: Fri Aug 13 21:22:57 2021
read: IOPS=2870, BW=11.2MiB/s (11.8MB/s)(673MiB/60013msec)
slat (nsec): min=110, max=52662k, avg=636.98, stdev=126946.21
clat (usec): min=305, max=179740, avg=10905.50, stdev=5240.98
lat (usec): min=352, max=179740, avg=10906.14, stdev=5241.92
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 71], 99.95th=[ 111],
| 99.99th=[ 159]
bw ( KiB/s): min= 6179, max=15360, per=0.21%, avg=11707.23, stdev=1934.40, samples=117
iops : min= 1544, max= 3840, avg=2926.76, stdev=483.63, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.20%, 10=54.34%, 20=42.17%, 50=3.05%
lat (msec) : 100=0.16%, 250=0.06%
cpu : usr=0.48%, sys=0.33%, ctx=66636, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.9%, 16=52.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=172287,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11996: Fri Aug 13 21:22:57 2021
read: IOPS=2825, BW=11.0MiB/s (11.6MB/s)(662MiB/60025msec)
slat (nsec): min=110, max=2645.2k, avg=340.47, stdev=7646.99
clat (usec): min=354, max=83944, avg=11101.08, stdev=4274.81
lat (usec): min=354, max=83944, avg=11101.42, stdev=4274.89
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11469], 80.00th=[12649], 90.00th=[14746], 95.00th=[17433],
| 99.00th=[28181], 99.50th=[33817], 99.90th=[57410], 99.95th=[61604],
| 99.99th=[68682]
bw ( KiB/s): min= 6400, max=15120, per=0.20%, avg=11541.91, stdev=1684.48, samples=117
iops : min= 1600, max= 3780, avg=2885.42, stdev=421.13, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=48.68%, 20=47.84%, 50=3.17%
lat (msec) : 100=0.15%
cpu : usr=0.45%, sys=0.35%, ctx=60413, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.1%, 16=57.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=169586,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11997: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60005msec)
slat (nsec): min=110, max=3123.2k, avg=343.50, stdev=7871.12
clat (usec): min=47, max=142073, avg=10927.10, stdev=4844.97
lat (usec): min=641, max=142074, avg=10927.44, stdev=4845.31
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 26], 99.50th=[ 31], 99.90th=[ 55], 99.95th=[ 112],
| 99.99th=[ 142]
bw ( KiB/s): min= 6890, max=15616, per=0.21%, avg=11703.73, stdev=1759.37, samples=117
iops : min= 1722, max= 3904, avg=2925.85, stdev=439.85, samples=117
lat (usec) : 50=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=54.06%, 20=42.87%, 50=2.85%
lat (msec) : 100=0.05%, 250=0.07%
cpu : usr=0.48%, sys=0.33%, ctx=64981, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.0%, 16=59.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.6%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=172525,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11998: Fri Aug 13 21:22:57 2021
read: IOPS=2811, BW=11.0MiB/s (11.5MB/s)(659MiB/60009msec)
slat (nsec): min=110, max=329324, avg=308.99, stdev=981.31
clat (usec): min=1096, max=101524, avg=11131.08, stdev=4715.80
lat (usec): min=1097, max=101524, avg=11131.39, stdev=4715.82
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[14877], 95.00th=[18220],
| 99.00th=[30278], 99.50th=[35914], 99.90th=[56361], 99.95th=[79168],
| 99.99th=[98042]
bw ( KiB/s): min= 5820, max=15304, per=0.20%, avg=11461.86, stdev=1831.11, samples=117
iops : min= 1455, max= 3826, avg=2865.40, stdev=457.80, samples=117
lat (msec) : 2=0.01%, 4=0.06%, 10=50.79%, 20=45.36%, 50=3.63%
lat (msec) : 100=0.15%, 250=0.01%
cpu : usr=0.48%, sys=0.31%, ctx=62630, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=168732,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=11999: Fri Aug 13 21:22:57 2021
read: IOPS=2584, BW=10.1MiB/s (10.6MB/s)(606MiB/60037msec)
slat (nsec): min=119, max=1537.0k, avg=360.73, stdev=5200.61
clat (usec): min=281, max=108218, avg=12151.61, stdev=6475.84
lat (usec): min=555, max=108219, avg=12151.97, stdev=6475.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 42], 99.50th=[ 53], 99.90th=[ 86], 99.95th=[ 97],
| 99.99th=[ 106]
bw ( KiB/s): min= 5013, max=15360, per=0.19%, avg=10534.68, stdev=1994.63, samples=117
iops : min= 1253, max= 3840, avg=2633.61, stdev=498.67, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=41.59%, 20=52.23%, 50=5.53%
lat (msec) : 100=0.56%, 250=0.01%
cpu : usr=0.43%, sys=0.35%, ctx=61753, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.8%, 16=61.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.6%, 16=1.5%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=155175,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12000: Fri Aug 13 21:22:57 2021
read: IOPS=2833, BW=11.1MiB/s (11.6MB/s)(664MiB/60009msec)
slat (nsec): min=109, max=18130k, avg=457.24, stdev=44428.10
clat (usec): min=187, max=231727, avg=11023.96, stdev=4339.81
lat (usec): min=238, max=231728, avg=11024.42, stdev=4339.78
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[14877], 95.00th=[17171],
| 99.00th=[25822], 99.50th=[31327], 99.90th=[45876], 99.95th=[64750],
| 99.99th=[91751]
bw ( KiB/s): min= 5381, max=15488, per=0.20%, avg=11537.42, stdev=1849.83, samples=117
iops : min= 1345, max= 3872, avg=2884.28, stdev=462.46, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=50.48%, 20=46.48%, 50=2.84%
lat (msec) : 100=0.08%, 250=0.01%
cpu : usr=0.50%, sys=0.30%, ctx=63145, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=10.4%, 16=64.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.8%, 8=0.7%, 16=2.0%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=170022,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12001: Fri Aug 13 21:22:57 2021
read: IOPS=2729, BW=10.7MiB/s (11.2MB/s)(640MiB/60042msec)
slat (nsec): min=110, max=109418, avg=320.50, stdev=604.38
clat (usec): min=194, max=155273, avg=11530.02, stdev=5705.01
lat (usec): min=217, max=155274, avg=11530.34, stdev=5705.03
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 70], 99.95th=[ 77],
| 99.99th=[ 144]
bw ( KiB/s): min= 766, max=15104, per=0.19%, avg=11028.43, stdev=2260.65, samples=118
iops : min= 191, max= 3776, avg=2757.05, stdev=565.20, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=47.11%, 20=48.38%, 50=4.14%
lat (msec) : 100=0.29%, 250=0.04%
cpu : usr=0.46%, sys=0.34%, ctx=64060, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163898,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12002: Fri Aug 13 21:22:57 2021
read: IOPS=2810, BW=11.0MiB/s (11.5MB/s)(659MiB/60056msec)
slat (nsec): min=119, max=591296, avg=333.63, stdev=2004.30
clat (usec): min=1781, max=277269, avg=11126.37, stdev=6694.02
lat (usec): min=1782, max=277269, avg=11126.70, stdev=6694.04
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 78], 99.95th=[ 103],
| 99.99th=[ 275]
bw ( KiB/s): min= 3832, max=15872, per=0.20%, avg=11477.03, stdev=2239.71, samples=117
iops : min= 958, max= 3968, avg=2869.21, stdev=559.92, samples=117
lat (msec) : 2=0.01%, 4=0.17%, 10=51.97%, 20=44.45%, 50=3.05%
lat (msec) : 100=0.29%, 250=0.04%, 500=0.02%
cpu : usr=0.46%, sys=0.34%, ctx=64414, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.4%, 16=51.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=168769,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12003: Fri Aug 13 21:22:57 2021
read: IOPS=3005, BW=11.7MiB/s (12.3MB/s)(705MiB/60008msec)
slat (nsec): min=110, max=125807, avg=319.71, stdev=661.62
clat (usec): min=172, max=118918, avg=10615.28, stdev=5002.11
lat (usec): min=186, max=118918, avg=10615.60, stdev=5002.13
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 64], 99.95th=[ 91],
| 99.99th=[ 113]
bw ( KiB/s): min= 4896, max=34372, per=0.21%, avg=12034.18, stdev=3098.90, samples=119
iops : min= 1224, max= 8593, avg=3008.49, stdev=774.72, samples=119
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=3.37%, 10=53.61%, 20=39.87%, 50=2.96%
lat (msec) : 100=0.16%, 250=0.03%
cpu : usr=0.52%, sys=0.23%, ctx=65457, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.5%, 16=1.2%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=180362,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12004: Fri Aug 13 21:22:57 2021
read: IOPS=2792, BW=10.9MiB/s (11.4MB/s)(655MiB/60012msec)
slat (nsec): min=110, max=1079.5k, avg=339.11, stdev=3578.14
clat (usec): min=207, max=230632, avg=11355.18, stdev=5208.72
lat (usec): min=209, max=230632, avg=11355.52, stdev=5208.72
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 53], 99.95th=[ 74],
| 99.99th=[ 150]
bw ( KiB/s): min= 4617, max=15080, per=0.20%, avg=11202.71, stdev=1971.33, samples=119
iops : min= 1154, max= 3770, avg=2800.61, stdev=492.80, samples=119
lat (usec) : 250=0.01%
lat (msec) : 4=0.03%, 10=47.83%, 20=48.14%, 50=3.84%, 100=0.13%
lat (msec) : 250=0.02%
cpu : usr=0.50%, sys=0.24%, ctx=66206, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.7%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=167554,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12005: Fri Aug 13 21:22:57 2021
read: IOPS=2880, BW=11.2MiB/s (11.8MB/s)(675MiB/60035msec)
slat (nsec): min=100, max=593006, avg=319.69, stdev=1682.09
clat (usec): min=1650, max=174555, avg=11047.09, stdev=5201.08
lat (usec): min=1650, max=174555, avg=11047.41, stdev=5201.18
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 66], 99.95th=[ 97],
| 99.99th=[ 150]
bw ( KiB/s): min= 1282, max=15360, per=0.20%, avg=11546.58, stdev=2076.71, samples=119
iops : min= 320, max= 3840, avg=2886.55, stdev=519.20, samples=119
lat (msec) : 2=0.01%, 4=0.08%, 10=52.59%, 20=43.97%, 50=3.21%
lat (msec) : 100=0.11%, 250=0.04%
cpu : usr=0.52%, sys=0.30%, ctx=64939, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.4%, 16=54.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=172904,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12006: Fri Aug 13 21:22:57 2021
read: IOPS=2865, BW=11.2MiB/s (11.7MB/s)(672MiB/60015msec)
slat (nsec): min=110, max=689989, avg=319.43, stdev=1959.51
clat (usec): min=932, max=97307, avg=10969.13, stdev=4319.90
lat (usec): min=933, max=97308, avg=10969.45, stdev=4319.92
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11469], 80.00th=[12649], 90.00th=[14746], 95.00th=[17695],
| 99.00th=[27132], 99.50th=[32113], 99.90th=[53740], 99.95th=[79168],
| 99.99th=[95945]
bw ( KiB/s): min= 5464, max=15568, per=0.21%, avg=11700.07, stdev=1837.83, samples=117
iops : min= 1366, max= 3892, avg=2924.94, stdev=459.43, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=51.75%, 20=44.98%, 50=3.06%
lat (msec) : 100=0.13%
cpu : usr=0.50%, sys=0.32%, ctx=65605, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=171993,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12007: Fri Aug 13 21:22:57 2021
read: IOPS=2852, BW=11.1MiB/s (11.7MB/s)(669MiB/60013msec)
slat (nsec): min=110, max=2440.8k, avg=336.21, stdev=6146.20
clat (usec): min=165, max=220561, avg=11050.52, stdev=5374.99
lat (usec): min=208, max=220561, avg=11050.86, stdev=5375.07
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 83], 99.95th=[ 90],
| 99.99th=[ 148]
bw ( KiB/s): min= 4087, max=15824, per=0.20%, avg=11510.86, stdev=2181.75, samples=118
iops : min= 1021, max= 3956, avg=2877.65, stdev=545.49, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=52.68%, 20=44.07%, 50=2.97%
lat (msec) : 100=0.20%, 250=0.03%
cpu : usr=0.52%, sys=0.28%, ctx=64806, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.5%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=171200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12008: Fri Aug 13 21:22:57 2021
read: IOPS=2732, BW=10.7MiB/s (11.2MB/s)(641MiB/60008msec)
slat (nsec): min=110, max=1071.5k, avg=332.01, stdev=3006.29
clat (usec): min=113, max=147283, avg=11505.31, stdev=5557.16
lat (usec): min=137, max=147283, avg=11505.65, stdev=5557.21
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 69], 99.95th=[ 105],
| 99.99th=[ 148]
bw ( KiB/s): min= 5888, max=15160, per=0.20%, avg=11127.86, stdev=1949.39, samples=117
iops : min= 1472, max= 3790, avg=2781.91, stdev=487.37, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=45.44%, 20=50.30%, 50=3.90%
lat (msec) : 100=0.19%, 250=0.06%
cpu : usr=0.45%, sys=0.37%, ctx=64068, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.4%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=164000,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12009: Fri Aug 13 21:22:57 2021
read: IOPS=2894, BW=11.3MiB/s (11.9MB/s)(678MiB/60006msec)
slat (nsec): min=119, max=277611, avg=320.08, stdev=1024.33
clat (usec): min=1052, max=225101, avg=10961.43, stdev=5827.49
lat (usec): min=1052, max=225102, avg=10961.75, stdev=5827.51
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 37], 99.90th=[ 72], 99.95th=[ 104],
| 99.99th=[ 220]
bw ( KiB/s): min= 5820, max=15104, per=0.21%, avg=11683.97, stdev=1891.79, samples=118
iops : min= 1455, max= 3776, avg=2920.92, stdev=472.92, samples=118
lat (msec) : 2=0.01%, 4=0.61%, 10=52.26%, 20=44.14%, 50=2.79%
lat (msec) : 100=0.14%, 250=0.05%
cpu : usr=0.53%, sys=0.20%, ctx=61601, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.2%, 16=1.2%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=173671,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12010: Fri Aug 13 21:22:57 2021
read: IOPS=2730, BW=10.7MiB/s (11.2MB/s)(640MiB/60013msec)
slat (nsec): min=110, max=933725, avg=326.84, stdev=2517.24
clat (usec): min=153, max=104537, avg=11472.87, stdev=5511.22
lat (usec): min=202, max=104537, avg=11473.19, stdev=5511.22
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[13042], 90.00th=[15664], 95.00th=[19792],
| 99.00th=[34341], 99.50th=[42730], 99.90th=[68682], 99.95th=[80217],
| 99.99th=[92799]
bw ( KiB/s): min= 6656, max=15417, per=0.20%, avg=11113.74, stdev=2069.96, samples=117
iops : min= 1664, max= 3854, avg=2778.37, stdev=517.50, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=48.57%, 20=46.49%, 50=4.48%
lat (msec) : 100=0.34%, 250=0.01%
cpu : usr=0.48%, sys=0.33%, ctx=66896, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.4%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.6%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=163870,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12011: Fri Aug 13 21:22:57 2021
read: IOPS=2668, BW=10.4MiB/s (10.9MB/s)(625MiB/60012msec)
slat (nsec): min=110, max=13941k, avg=585.00, stdev=40887.91
clat (usec): min=98, max=140348, avg=11731.66, stdev=5713.66
lat (usec): min=539, max=140348, avg=11732.25, stdev=5713.72
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 84], 99.95th=[ 97],
| 99.99th=[ 131]
bw ( KiB/s): min= 4864, max=15656, per=0.19%, avg=10860.43, stdev=1978.51, samples=117
iops : min= 1216, max= 3914, avg=2715.04, stdev=494.62, samples=117
lat (usec) : 100=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.02%, 4=0.12%, 10=44.75%, 20=50.07%, 50=4.79%
lat (msec) : 100=0.21%, 250=0.04%
cpu : usr=0.46%, sys=0.33%, ctx=66325, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160121,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12012: Fri Aug 13 21:22:57 2021
read: IOPS=2847, BW=11.1MiB/s (11.7MB/s)(668MiB/60051msec)
slat (nsec): min=110, max=18978k, avg=566.71, stdev=50996.46
clat (usec): min=2, max=149544, avg=11049.55, stdev=4999.91
lat (usec): min=520, max=149545, avg=11050.12, stdev=5000.48
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 37], 99.90th=[ 64], 99.95th=[ 87],
| 99.99th=[ 128]
bw ( KiB/s): min= 2043, max=15784, per=0.20%, avg=11519.37, stdev=2300.75, samples=118
iops : min= 510, max= 3946, avg=2879.78, stdev=575.23, samples=118
lat (usec) : 4=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=52.41%, 20=43.79%, 50=3.47%
lat (msec) : 100=0.17%, 250=0.03%
cpu : usr=0.49%, sys=0.32%, ctx=66122, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.6%, 16=63.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.3%, 16=1.4%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=170984,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12013: Fri Aug 13 21:22:57 2021
read: IOPS=2770, BW=10.8MiB/s (11.3MB/s)(650MiB/60031msec)
slat (nsec): min=110, max=9098.9k, avg=702.00, stdev=40034.53
clat (usec): min=37, max=124830, avg=11321.22, stdev=4824.90
lat (usec): min=213, max=124831, avg=11321.93, stdev=4824.91
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 33], 99.90th=[ 63], 99.95th=[ 82],
| 99.99th=[ 121]
bw ( KiB/s): min= 6898, max=15144, per=0.20%, avg=11286.64, stdev=1883.70, samples=117
iops : min= 1724, max= 3786, avg=2821.60, stdev=470.91, samples=117
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=48.49%, 20=47.76%, 50=3.47%
lat (msec) : 100=0.15%, 250=0.04%
cpu : usr=0.54%, sys=0.28%, ctx=63873, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.1%, 16=62.0%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.3%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=166331,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12014: Fri Aug 13 21:22:57 2021
read: IOPS=2795, BW=10.9MiB/s (11.5MB/s)(655MiB/60008msec)
slat (nsec): min=110, max=730186, avg=319.35, stdev=1944.74
clat (usec): min=226, max=205780, avg=11236.37, stdev=5789.60
lat (usec): min=232, max=205781, avg=11236.69, stdev=5789.63
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 35], 99.90th=[ 71], 99.95th=[ 108],
| 99.99th=[ 205]
bw ( KiB/s): min= 4496, max=14896, per=0.20%, avg=11366.57, stdev=2056.44, samples=117
iops : min= 1124, max= 3724, avg=2841.58, stdev=514.13, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=50.92%, 20=44.99%, 50=3.84%
lat (msec) : 100=0.15%, 250=0.06%
cpu : usr=0.52%, sys=0.30%, ctx=66513, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=167747,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12015: Fri Aug 13 21:22:57 2021
read: IOPS=2786, BW=10.9MiB/s (11.4MB/s)(654MiB/60039msec)
slat (nsec): min=110, max=368794, avg=329.33, stdev=1213.83
clat (usec): min=478, max=169818, avg=11283.15, stdev=5905.19
lat (usec): min=483, max=169818, avg=11283.48, stdev=5905.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 78], 99.95th=[ 136],
| 99.99th=[ 169]
bw ( KiB/s): min= 199, max=15240, per=0.20%, avg=11271.86, stdev=2147.57, samples=118
iops : min= 49, max= 3810, avg=2817.91, stdev=536.93, samples=118
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=48.92%, 20=47.26%, 50=3.44%
lat (msec) : 100=0.21%, 250=0.08%
cpu : usr=0.55%, sys=0.27%, ctx=63988, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=10.0%, 16=65.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.0%, 16=1.9%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=167300,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12016: Fri Aug 13 21:22:57 2021
read: IOPS=2646, BW=10.3MiB/s (10.8MB/s)(620MiB/60005msec)
slat (nsec): min=119, max=2019.9k, avg=355.20, stdev=6249.13
clat (usec): min=275, max=114595, avg=11856.69, stdev=6047.65
lat (usec): min=286, max=114595, avg=11857.04, stdev=6047.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 47], 99.90th=[ 84], 99.95th=[ 97],
| 99.99th=[ 106]
bw ( KiB/s): min= 6099, max=15360, per=0.19%, avg=10759.87, stdev=2010.06, samples=117
iops : min= 1524, max= 3840, avg=2689.91, stdev=502.54, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=43.59%, 20=50.70%, 50=5.17%
lat (msec) : 100=0.38%, 250=0.03%
cpu : usr=0.47%, sys=0.33%, ctx=66400, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.0%, 16=60.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.4%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=158787,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12017: Fri Aug 13 21:22:57 2021
read: IOPS=2736, BW=10.7MiB/s (11.2MB/s)(642MiB/60007msec)
slat (nsec): min=119, max=2637.0k, avg=348.17, stdev=6663.40
clat (usec): min=793, max=421552, avg=11444.90, stdev=6775.72
lat (usec): min=793, max=421552, avg=11445.25, stdev=6776.38
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 73], 99.95th=[ 116],
| 99.99th=[ 288]
bw ( KiB/s): min= 207, max=15121, per=0.20%, avg=11154.39, stdev=2305.76, samples=117
iops : min= 51, max= 3780, avg=2788.54, stdev=576.47, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=48.93%, 20=46.64%, 50=4.05%
lat (msec) : 100=0.18%, 250=0.04%, 500=0.02%
cpu : usr=0.49%, sys=0.30%, ctx=62227, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.7%, 16=60.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.2%, 16=1.1%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=164230,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12018: Fri Aug 13 21:22:57 2021
read: IOPS=2826, BW=11.0MiB/s (11.6MB/s)(663MiB/60046msec)
slat (nsec): min=109, max=13701k, avg=431.05, stdev=35884.58
clat (usec): min=208, max=124071, avg=11073.66, stdev=4698.67
lat (usec): min=269, max=124072, avg=11074.09, stdev=4698.55
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 39], 99.90th=[ 61], 99.95th=[ 64],
| 99.99th=[ 116]
bw ( KiB/s): min= 6656, max=15049, per=0.20%, avg=11516.15, stdev=1850.03, samples=117
iops : min= 1664, max= 3762, avg=2878.98, stdev=462.53, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=52.90%, 20=43.29%, 50=3.52%
lat (msec) : 100=0.18%, 250=0.01%
cpu : usr=0.49%, sys=0.33%, ctx=62077, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.1%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=169744,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12019: Fri Aug 13 21:22:57 2021
read: IOPS=2658, BW=10.4MiB/s (10.9MB/s)(623MiB/60020msec)
slat (nsec): min=110, max=879811, avg=342.17, stdev=3027.61
clat (usec): min=118, max=144001, avg=11798.51, stdev=5788.86
lat (usec): min=142, max=144001, avg=11798.85, stdev=5788.87
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 81], 99.95th=[ 93],
| 99.99th=[ 144]
bw ( KiB/s): min= 6144, max=14824, per=0.19%, avg=10867.67, stdev=1951.44, samples=117
iops : min= 1536, max= 3706, avg=2716.85, stdev=487.88, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=42.63%, 20=52.36%, 50=4.57%
lat (msec) : 100=0.32%, 250=0.04%
cpu : usr=0.50%, sys=0.28%, ctx=64124, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=52.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=159585,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12020: Fri Aug 13 21:22:57 2021
read: IOPS=2807, BW=11.0MiB/s (11.5MB/s)(658MiB/60040msec)
slat (nsec): min=110, max=222517, avg=317.54, stdev=877.49
clat (usec): min=96, max=102809, avg=11360.18, stdev=5676.35
lat (usec): min=275, max=102809, avg=11360.50, stdev=5676.36
clat percentiles (usec):
| 1.00th=[ 3163], 5.00th=[ 7177], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[13042], 90.00th=[15664], 95.00th=[19530],
| 99.00th=[34341], 99.50th=[44827], 99.90th=[74974], 99.95th=[86508],
| 99.99th=[99091]
bw ( KiB/s): min= 5376, max=23855, per=0.20%, avg=11262.48, stdev=2414.81, samples=119
iops : min= 1344, max= 5963, avg=2815.54, stdev=603.67, samples=119
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=1.70%, 10=47.16%, 20=46.48%, 50=4.33%
lat (msec) : 100=0.32%, 250=0.01%
cpu : usr=0.51%, sys=0.23%, ctx=67028, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.3%, 16=55.7%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.3%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=168545,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12021: Fri Aug 13 21:22:57 2021
read: IOPS=2868, BW=11.2MiB/s (11.8MB/s)(672MiB/60007msec)
slat (nsec): min=100, max=2566.1k, avg=331.05, stdev=6220.72
clat (usec): min=181, max=131568, avg=10920.88, stdev=5042.95
lat (usec): min=221, max=131569, avg=10921.22, stdev=5042.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 38], 99.90th=[ 61], 99.95th=[ 68],
| 99.99th=[ 130]
bw ( KiB/s): min= 6288, max=15616, per=0.21%, avg=11694.51, stdev=2128.87, samples=117
iops : min= 1572, max= 3904, avg=2923.57, stdev=532.23, samples=117
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=55.43%, 20=41.02%, 50=3.26%
lat (msec) : 100=0.18%, 250=0.04%
cpu : usr=0.50%, sys=0.31%, ctx=67021, majf=0, minf=31
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.8%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=172142,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12022: Fri Aug 13 21:22:57 2021
read: IOPS=2503, BW=9.78MiB/s (10.3MB/s)(587MiB/60015msec)
slat (nsec): min=110, max=135665, avg=318.56, stdev=717.76
clat (usec): min=910, max=123486, avg=12548.31, stdev=7000.59
lat (usec): min=911, max=123487, avg=12548.63, stdev=7000.61
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 43], 99.50th=[ 57], 99.90th=[ 83], 99.95th=[ 107],
| 99.99th=[ 124]
bw ( KiB/s): min= 5128, max=14352, per=0.18%, avg=10200.91, stdev=1931.31, samples=117
iops : min= 1282, max= 3588, avg=2550.16, stdev=482.84, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 4=0.03%, 10=36.87%, 20=56.25%, 50=6.11%, 100=0.66%
lat (msec) : 250=0.08%
cpu : usr=0.45%, sys=0.30%, ctx=60571, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.2%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=150240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12023: Fri Aug 13 21:22:57 2021
read: IOPS=2934, BW=11.5MiB/s (12.0MB/s)(688MiB/60023msec)
slat (nsec): min=110, max=88910, avg=315.56, stdev=588.30
clat (usec): min=256, max=85421, avg=10681.45, stdev=3939.91
lat (usec): min=262, max=85422, avg=10681.76, stdev=3939.93
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14222], 95.00th=[16581],
| 99.00th=[25035], 99.50th=[30802], 99.90th=[52167], 99.95th=[68682],
| 99.99th=[78119]
bw ( KiB/s): min= 5352, max=15072, per=0.21%, avg=11955.37, stdev=1803.50, samples=117
iops : min= 1338, max= 3768, avg=2988.75, stdev=450.93, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.07%, 10=55.54%, 20=41.91%, 50=2.37%, 100=0.11%
cpu : usr=0.58%, sys=0.24%, ctx=64783, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.1%, 16=2.2%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=176161,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12024: Fri Aug 13 21:22:57 2021
read: IOPS=2691, BW=10.5MiB/s (11.0MB/s)(631MiB/60046msec)
slat (nsec): min=110, max=800638, avg=328.15, stdev=2276.95
clat (usec): min=268, max=115240, avg=11690.20, stdev=5977.70
lat (usec): min=275, max=115240, avg=11690.53, stdev=5977.72
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 32], 99.50th=[ 44], 99.90th=[ 87], 99.95th=[ 108],
| 99.99th=[ 113]
bw ( KiB/s): min= 6280, max=14848, per=0.19%, avg=10982.76, stdev=1978.28, samples=117
iops : min= 1570, max= 3712, avg=2745.63, stdev=494.59, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=46.61%, 20=48.06%, 50=4.73%
lat (msec) : 100=0.39%, 250=0.05%
cpu : usr=0.50%, sys=0.30%, ctx=62995, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.3%, 16=57.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.3%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=161597,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12025: Fri Aug 13 21:22:57 2021
read: IOPS=2678, BW=10.5MiB/s (11.0MB/s)(628MiB/60004msec)
slat (nsec): min=110, max=5153.4k, avg=520.25, stdev=25127.27
clat (usec): min=212, max=174016, avg=11740.59, stdev=6399.90
lat (usec): min=276, max=174020, avg=11741.11, stdev=6399.81
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 46], 99.90th=[ 81], 99.95th=[ 121],
| 99.99th=[ 169]
bw ( KiB/s): min= 5888, max=14848, per=0.19%, avg=10876.41, stdev=2045.80, samples=117
iops : min= 1472, max= 3712, avg=2719.05, stdev=511.46, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=47.60%, 20=46.40%, 50=5.57%
lat (msec) : 100=0.27%, 250=0.08%
cpu : usr=0.49%, sys=0.31%, ctx=63839, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160708,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12026: Fri Aug 13 21:22:57 2021
read: IOPS=2796, BW=10.9MiB/s (11.5MB/s)(656MiB/60040msec)
slat (nsec): min=110, max=857747, avg=325.95, stdev=2292.43
clat (msec): min=2, max=105, avg=11.21, stdev= 4.73
lat (msec): min=2, max=105, avg=11.21, stdev= 4.73
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 66], 99.95th=[ 81],
| 99.99th=[ 102]
bw ( KiB/s): min= 6664, max=15321, per=0.20%, avg=11416.11, stdev=1728.37, samples=117
iops : min= 1666, max= 3830, avg=2853.97, stdev=432.12, samples=117
lat (msec) : 4=0.05%, 10=47.76%, 20=48.60%, 50=3.38%, 100=0.19%
lat (msec) : 250=0.02%
cpu : usr=0.51%, sys=0.31%, ctx=65710, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.1%, 16=60.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.9%, 16=0.9%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=167931,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12027: Fri Aug 13 21:22:57 2021
read: IOPS=2788, BW=10.9MiB/s (11.4MB/s)(654MiB/60007msec)
slat (nsec): min=110, max=13159k, avg=467.98, stdev=35150.02
clat (usec): min=73, max=512394, avg=11316.02, stdev=7895.85
lat (usec): min=326, max=512396, avg=11316.49, stdev=7895.78
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 40], 99.90th=[ 56], 99.95th=[ 71],
| 99.99th=[ 510]
bw ( KiB/s): min= 1184, max=16606, per=0.20%, avg=11245.43, stdev=2334.77, samples=118
iops : min= 296, max= 4151, avg=2811.30, stdev=583.68, samples=118
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.98%, 10=48.86%, 20=45.93%, 50=4.08%
lat (msec) : 100=0.13%, 250=0.01%, 750=0.02%
cpu : usr=0.49%, sys=0.31%, ctx=63870, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.0%, 16=1.3%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=167301,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12028: Fri Aug 13 21:22:57 2021
read: IOPS=2769, BW=10.8MiB/s (11.3MB/s)(650MiB/60044msec)
slat (nsec): min=110, max=414875, avg=310.37, stdev=1183.68
clat (usec): min=927, max=380031, avg=11288.71, stdev=6164.80
lat (usec): min=927, max=380031, avg=11289.02, stdev=6164.90
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 64], 99.95th=[ 110],
| 99.99th=[ 236]
bw ( KiB/s): min= 215, max=15329, per=0.20%, avg=11302.21, stdev=2104.81, samples=117
iops : min= 53, max= 3832, avg=2825.49, stdev=526.25, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 4=0.14%, 10=48.30%, 20=48.03%, 50=3.35%, 100=0.11%
lat (msec) : 250=0.05%, 500=0.01%
cpu : usr=0.47%, sys=0.32%, ctx=64386, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.9%, 16=59.1%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.5%, 16=1.3%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=166304,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12029: Fri Aug 13 21:22:57 2021
read: IOPS=2621, BW=10.2MiB/s (10.7MB/s)(615MiB/60009msec)
slat (nsec): min=120, max=3013.9k, avg=384.65, stdev=7797.20
clat (usec): min=255, max=110499, avg=11959.10, stdev=5868.42
lat (usec): min=330, max=110503, avg=11959.48, stdev=5868.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 45], 99.90th=[ 73], 99.95th=[ 88],
| 99.99th=[ 111]
bw ( KiB/s): min= 4096, max=14848, per=0.19%, avg=10661.74, stdev=1994.89, samples=117
iops : min= 1024, max= 3712, avg=2665.38, stdev=498.73, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.02%, 10=42.00%, 20=52.41%, 50=5.19%
lat (msec) : 100=0.34%, 250=0.04%
cpu : usr=0.49%, sys=0.30%, ctx=66716, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.5%, 16=51.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=157330,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12030: Fri Aug 13 21:22:57 2021
read: IOPS=2702, BW=10.6MiB/s (11.1MB/s)(634MiB/60037msec)
slat (nsec): min=110, max=2106.2k, avg=364.35, stdev=7992.46
clat (usec): min=507, max=94427, avg=11618.25, stdev=5313.17
lat (usec): min=507, max=94427, avg=11618.61, stdev=5313.35
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7504], 10.00th=[ 7963], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[10945],
| 70.00th=[11994], 80.00th=[13435], 90.00th=[16319], 95.00th=[19530],
| 99.00th=[33424], 99.50th=[40109], 99.90th=[63177], 99.95th=[76022],
| 99.99th=[91751]
bw ( KiB/s): min= 3656, max=15360, per=0.19%, avg=11009.38, stdev=2038.47, samples=117
iops : min= 914, max= 3840, avg=2752.29, stdev=509.64, samples=117
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=45.35%, 20=49.87%, 50=4.36%
lat (msec) : 100=0.31%
cpu : usr=0.49%, sys=0.31%, ctx=66074, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162261,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12031: Fri Aug 13 21:22:57 2021
read: IOPS=2795, BW=10.9MiB/s (11.5MB/s)(655MiB/60013msec)
slat (nsec): min=110, max=586040, avg=339.52, stdev=1700.93
clat (usec): min=144, max=141751, avg=11255.13, stdev=5357.31
lat (usec): min=163, max=141753, avg=11255.47, stdev=5357.34
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 70], 99.95th=[ 105],
| 99.99th=[ 142]
bw ( KiB/s): min= 6688, max=15360, per=0.20%, avg=11380.22, stdev=2014.62, samples=117
iops : min= 1672, max= 3840, avg=2844.97, stdev=503.67, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 4=0.06%, 10=49.73%, 20=46.43%, 50=3.58%, 100=0.13%
lat (msec) : 250=0.07%
cpu : usr=0.51%, sys=0.29%, ctx=64045, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.9%, 16=57.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=167773,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12032: Fri Aug 13 21:22:57 2021
read: IOPS=2717, BW=10.6MiB/s (11.1MB/s)(637MiB/60003msec)
slat (nsec): min=110, max=16331k, avg=450.06, stdev=40755.33
clat (usec): min=322, max=115752, avg=11534.71, stdev=5710.16
lat (usec): min=371, max=115752, avg=11535.16, stdev=5710.15
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 44], 99.90th=[ 74], 99.95th=[ 91],
| 99.99th=[ 107]
bw ( KiB/s): min= 3328, max=15496, per=0.19%, avg=11053.14, stdev=1972.39, samples=117
iops : min= 832, max= 3874, avg=2763.21, stdev=493.12, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=47.53%, 20=47.65%, 50=4.32%
lat (msec) : 100=0.31%, 250=0.04%
cpu : usr=0.46%, sys=0.34%, ctx=65348, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.7%, 16=59.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.5%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=163074,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12033: Fri Aug 13 21:22:57 2021
read: IOPS=2763, BW=10.8MiB/s (11.3MB/s)(648MiB/60008msec)
slat (nsec): min=100, max=542392, avg=331.56, stdev=1545.51
clat (usec): min=217, max=134431, avg=11336.98, stdev=5706.46
lat (usec): min=253, max=134432, avg=11337.31, stdev=5706.48
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 34], 99.50th=[ 44], 99.90th=[ 79], 99.95th=[ 97],
| 99.99th=[ 113]
bw ( KiB/s): min= 5876, max=14872, per=0.20%, avg=11287.01, stdev=1959.29, samples=117
iops : min= 1469, max= 3718, avg=2821.69, stdev=489.83, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=50.43%, 20=45.38%, 50=3.86%
lat (msec) : 100=0.25%, 250=0.04%
cpu : usr=0.47%, sys=0.32%, ctx=62427, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.8%, 16=54.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=165855,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12034: Fri Aug 13 21:22:57 2021
read: IOPS=2701, BW=10.6MiB/s (11.1MB/s)(634MiB/60044msec)
slat (nsec): min=100, max=1638.3k, avg=346.88, stdev=5159.42
clat (usec): min=639, max=110661, avg=11644.24, stdev=5049.58
lat (usec): min=639, max=110662, avg=11644.59, stdev=5049.61
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7504], 10.00th=[ 8029], 20.00th=[ 8717],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[12256], 80.00th=[13566], 90.00th=[16188], 95.00th=[19530],
| 99.00th=[31589], 99.50th=[39584], 99.90th=[57410], 99.95th=[63177],
| 99.99th=[96994]
bw ( KiB/s): min= 255, max=15080, per=0.19%, avg=10911.70, stdev=2282.96, samples=118
iops : min= 63, max= 3770, avg=2727.86, stdev=570.76, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=44.90%, 20=50.59%, 50=4.19%
lat (msec) : 100=0.22%, 250=0.01%
cpu : usr=0.43%, sys=0.36%, ctx=63689, majf=0, minf=31
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.6%, 16=56.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.6%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162183,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12035: Fri Aug 13 21:22:57 2021
read: IOPS=2681, BW=10.5MiB/s (11.0MB/s)(629MiB/60015msec)
slat (nsec): min=109, max=250504, avg=332.53, stdev=1090.65
clat (usec): min=1484, max=206462, avg=11885.34, stdev=7438.62
lat (usec): min=1484, max=206463, avg=11885.67, stdev=7438.64
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 44], 99.50th=[ 58], 99.90th=[ 91], 99.95th=[ 104],
| 99.99th=[ 199]
bw ( KiB/s): min= 4360, max=28087, per=0.19%, avg=10740.39, stdev=2870.42, samples=119
iops : min= 1090, max= 7021, avg=2685.03, stdev=717.57, samples=119
lat (msec) : 2=0.01%, 4=3.73%, 10=40.58%, 20=49.72%, 50=5.22%
lat (msec) : 100=0.68%, 250=0.07%
cpu : usr=0.50%, sys=0.22%, ctx=60775, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.7%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160930,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12036: Fri Aug 13 21:22:57 2021
read: IOPS=2720, BW=10.6MiB/s (11.1MB/s)(638MiB/60010msec)
slat (nsec): min=110, max=408739, avg=326.40, stdev=1354.26
clat (usec): min=207, max=110777, avg=11529.98, stdev=6007.86
lat (usec): min=213, max=110777, avg=11530.31, stdev=6007.89
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15664], 95.00th=[20317],
| 99.00th=[38536], 99.50th=[46924], 99.90th=[72877], 99.95th=[83362],
| 99.99th=[96994]
bw ( KiB/s): min= 5520, max=15104, per=0.19%, avg=11071.57, stdev=2152.22, samples=117
iops : min= 1380, max= 3776, avg=2767.82, stdev=538.08, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=49.36%, 20=45.29%, 50=4.83%
lat (msec) : 100=0.43%, 250=0.01%
cpu : usr=0.47%, sys=0.34%, ctx=62711, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.5%, 16=58.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=163271,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12037: Fri Aug 13 21:22:57 2021
read: IOPS=2843, BW=11.1MiB/s (11.6MB/s)(667MiB/60014msec)
slat (nsec): min=110, max=6543.3k, avg=418.96, stdev=19962.00
clat (usec): min=320, max=108801, avg=11039.38, stdev=4477.46
lat (usec): min=350, max=108801, avg=11039.80, stdev=4477.41
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 36], 99.90th=[ 53], 99.95th=[ 82],
| 99.99th=[ 102]
bw ( KiB/s): min= 6264, max=15360, per=0.20%, avg=11590.85, stdev=1717.42, samples=117
iops : min= 1566, max= 3840, avg=2897.65, stdev=429.35, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=51.03%, 20=45.81%, 50=2.87%
lat (msec) : 100=0.12%, 250=0.01%
cpu : usr=0.55%, sys=0.26%, ctx=64526, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.9%, 16=60.2%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.8%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=170626,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12038: Fri Aug 13 21:22:57 2021
read: IOPS=2921, BW=11.4MiB/s (12.0MB/s)(685MiB/60034msec)
slat (nsec): min=100, max=942203, avg=318.02, stdev=2337.65
clat (usec): min=252, max=233463, avg=10881.35, stdev=5600.10
lat (usec): min=257, max=233463, avg=10881.67, stdev=5600.13
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 62], 99.95th=[ 78],
| 99.99th=[ 232]
bw ( KiB/s): min= 5892, max=28103, per=0.21%, avg=11814.25, stdev=2545.18, samples=118
iops : min= 1473, max= 7025, avg=2953.49, stdev=636.26, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=1.33%, 10=52.67%, 20=42.71%, 50=3.09%
lat (msec) : 100=0.16%, 250=0.03%
cpu : usr=0.53%, sys=0.27%, ctx=65304, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.8%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=175371,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12039: Fri Aug 13 21:22:57 2021
read: IOPS=2860, BW=11.2MiB/s (11.7MB/s)(670MiB/60005msec)
slat (nsec): min=110, max=2511.4k, avg=331.88, stdev=6147.05
clat (usec): min=1033, max=146241, avg=10947.27, stdev=4859.30
lat (usec): min=1033, max=146241, avg=10947.61, stdev=4859.39
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 63], 99.95th=[ 77],
| 99.99th=[ 142]
bw ( KiB/s): min= 4598, max=15072, per=0.20%, avg=11635.73, stdev=1976.07, samples=117
iops : min= 1149, max= 3768, avg=2908.87, stdev=494.03, samples=117
lat (msec) : 2=0.01%, 4=0.20%, 10=53.15%, 20=43.29%, 50=3.17%
lat (msec) : 100=0.15%, 250=0.04%
cpu : usr=0.51%, sys=0.31%, ctx=65022, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=171626,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12040: Fri Aug 13 21:22:57 2021
read: IOPS=2736, BW=10.7MiB/s (11.2MB/s)(641MiB/60010msec)
slat (nsec): min=110, max=5192.1k, avg=485.20, stdev=21988.76
clat (usec): min=259, max=174448, avg=11453.20, stdev=5553.66
lat (usec): min=269, max=174449, avg=11453.68, stdev=5553.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 65], 99.95th=[ 83],
| 99.99th=[ 157]
bw ( KiB/s): min= 5120, max=14848, per=0.20%, avg=11131.56, stdev=2109.38, samples=117
iops : min= 1280, max= 3712, avg=2782.84, stdev=527.38, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=47.35%, 20=47.93%, 50=4.30%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.52%, sys=0.28%, ctx=66783, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=164219,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12041: Fri Aug 13 21:22:57 2021
read: IOPS=2819, BW=11.0MiB/s (11.5MB/s)(661MiB/60016msec)
slat (nsec): min=110, max=2468.0k, avg=373.74, stdev=8632.76
clat (usec): min=575, max=97807, avg=11175.94, stdev=5388.02
lat (usec): min=576, max=97808, avg=11176.32, stdev=5387.99
clat percentiles (usec):
| 1.00th=[ 4817], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[15270], 95.00th=[19530],
| 99.00th=[32113], 99.50th=[42206], 99.90th=[67634], 99.95th=[90702],
| 99.99th=[91751]
bw ( KiB/s): min= 5365, max=18906, per=0.20%, avg=11413.68, stdev=2206.83, samples=118
iops : min= 1341, max= 4726, avg=2853.36, stdev=551.68, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.50%, 10=53.14%, 20=41.61%, 50=4.47%
lat (msec) : 100=0.27%
cpu : usr=0.47%, sys=0.33%, ctx=60944, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.6%, 16=60.5%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=1.1%, 16=1.1%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=169212,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12042: Fri Aug 13 21:22:57 2021
read: IOPS=2735, BW=10.7MiB/s (11.2MB/s)(641MiB/60009msec)
slat (nsec): min=110, max=14606k, avg=604.47, stdev=50756.73
clat (usec): min=93, max=273739, avg=11503.28, stdev=6340.72
lat (usec): min=408, max=273744, avg=11503.88, stdev=6340.82
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 70], 99.95th=[ 91],
| 99.99th=[ 268]
bw ( KiB/s): min= 510, max=15872, per=0.19%, avg=11044.19, stdev=2322.98, samples=118
iops : min= 127, max= 3968, avg=2760.98, stdev=580.73, samples=118
lat (usec) : 100=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=47.97%, 20=47.02%, 50=4.57%
lat (msec) : 100=0.22%, 250=0.02%, 500=0.01%
cpu : usr=0.47%, sys=0.35%, ctx=64490, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.4%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=164172,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12043: Fri Aug 13 21:22:57 2021
read: IOPS=2898, BW=11.3MiB/s (11.9MB/s)(679MiB/60004msec)
slat (nsec): min=110, max=297418, avg=318.76, stdev=893.60
clat (usec): min=280, max=127382, avg=10806.57, stdev=4932.13
lat (usec): min=285, max=127382, avg=10806.89, stdev=4932.19
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 56], 99.95th=[ 74],
| 99.99th=[ 126]
bw ( KiB/s): min= 4854, max=15632, per=0.21%, avg=11794.63, stdev=2156.32, samples=117
iops : min= 1213, max= 3908, avg=2948.58, stdev=539.10, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.17%, 10=56.35%, 20=40.02%, 50=3.27%
lat (msec) : 100=0.18%, 250=0.02%
cpu : usr=0.55%, sys=0.26%, ctx=64701, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.6%, 16=53.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=173920,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12044: Fri Aug 13 21:22:57 2021
read: IOPS=2643, BW=10.3MiB/s (10.8MB/s)(620MiB/60014msec)
slat (nsec): min=110, max=2934.5k, avg=369.41, stdev=10278.72
clat (usec): min=650, max=150482, avg=11868.49, stdev=6048.20
lat (usec): min=656, max=150483, avg=11868.86, stdev=6048.19
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 36], 99.50th=[ 50], 99.90th=[ 80], 99.95th=[ 100],
| 99.99th=[ 150]
bw ( KiB/s): min= 5120, max=16080, per=0.19%, avg=10768.10, stdev=1878.41, samples=117
iops : min= 1280, max= 4020, avg=2691.95, stdev=469.61, samples=117
lat (usec) : 750=0.01%
lat (msec) : 4=0.15%, 10=41.83%, 20=53.22%, 50=4.33%, 100=0.42%
lat (msec) : 250=0.05%
cpu : usr=0.48%, sys=0.31%, ctx=62701, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.2%, 16=1.3%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=158618,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12045: Fri Aug 13 21:22:57 2021
read: IOPS=2819, BW=11.0MiB/s (11.5MB/s)(661MiB/60023msec)
slat (nsec): min=110, max=1885.4k, avg=410.50, stdev=9966.76
clat (usec): min=63, max=67175, avg=11106.34, stdev=4380.33
lat (usec): min=176, max=67176, avg=11106.75, stdev=4380.23
clat percentiles (usec):
| 1.00th=[ 6390], 5.00th=[ 7504], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11469], 80.00th=[12780], 90.00th=[15139], 95.00th=[18220],
| 99.00th=[30278], 99.50th=[35914], 99.90th=[47449], 99.95th=[52167],
| 99.99th=[63177]
bw ( KiB/s): min= 6432, max=15760, per=0.20%, avg=11481.96, stdev=1901.99, samples=117
iops : min= 1608, max= 3940, avg=2870.44, stdev=475.50, samples=117
lat (usec) : 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.19%, 10=51.76%, 20=44.22%, 50=3.72%
lat (msec) : 100=0.09%
cpu : usr=0.51%, sys=0.30%, ctx=64930, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.7%, 16=58.4%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.7%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=169214,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12046: Fri Aug 13 21:22:57 2021
read: IOPS=2892, BW=11.3MiB/s (11.8MB/s)(678MiB/60012msec)
slat (nsec): min=110, max=2408.4k, avg=354.39, stdev=6752.44
clat (usec): min=218, max=106069, avg=10822.59, stdev=4191.31
lat (usec): min=294, max=106070, avg=10822.94, stdev=4191.29
clat percentiles (usec):
| 1.00th=[ 6194], 5.00th=[ 7504], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14353], 95.00th=[16712],
| 99.00th=[26084], 99.50th=[33162], 99.90th=[53216], 99.95th=[70779],
| 99.99th=[92799]
bw ( KiB/s): min= 6704, max=15512, per=0.21%, avg=11808.57, stdev=1768.33, samples=117
iops : min= 1676, max= 3878, avg=2952.08, stdev=442.11, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=52.91%, 20=44.34%, 50=2.52%
lat (msec) : 100=0.12%, 250=0.01%
cpu : usr=0.50%, sys=0.30%, ctx=65994, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.9%, 16=61.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.3%, 16=1.7%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=173580,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12047: Fri Aug 13 21:22:57 2021
read: IOPS=2811, BW=11.0MiB/s (11.5MB/s)(659MiB/60006msec)
slat (nsec): min=110, max=152184, avg=318.97, stdev=788.75
clat (usec): min=554, max=156006, avg=11201.99, stdev=5117.50
lat (usec): min=576, max=156007, avg=11202.30, stdev=5117.51
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 68], 99.95th=[ 89],
| 99.99th=[ 157]
bw ( KiB/s): min= 2570, max=15408, per=0.20%, avg=11351.64, stdev=2079.62, samples=118
iops : min= 642, max= 3852, avg=2837.86, stdev=519.91, samples=118
lat (usec) : 750=0.01%
lat (msec) : 4=0.11%, 10=49.62%, 20=46.71%, 50=3.37%, 100=0.15%
lat (msec) : 250=0.04%
cpu : usr=0.49%, sys=0.33%, ctx=66244, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=60.9%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=0.6%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=168704,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12048: Fri Aug 13 21:22:57 2021
read: IOPS=2949, BW=11.5MiB/s (12.1MB/s)(691MiB/60006msec)
slat (nsec): min=110, max=2050.7k, avg=327.26, stdev=4969.69
clat (usec): min=666, max=78379, avg=10620.92, stdev=3874.05
lat (usec): min=672, max=78379, avg=10621.25, stdev=3874.06
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7308], 10.00th=[ 7767], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14091], 95.00th=[16909],
| 99.00th=[25822], 99.50th=[30278], 99.90th=[51119], 99.95th=[58459],
| 99.99th=[69731]
bw ( KiB/s): min= 7168, max=15360, per=0.21%, avg=12007.86, stdev=1892.12, samples=117
iops : min= 1792, max= 3840, avg=3001.91, stdev=473.05, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=56.52%, 20=40.61%, 50=2.64%
lat (msec) : 100=0.10%
cpu : usr=0.49%, sys=0.30%, ctx=64688, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.3%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=176977,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12049: Fri Aug 13 21:22:57 2021
read: IOPS=2797, BW=10.9MiB/s (11.5MB/s)(656MiB/60006msec)
slat (nsec): min=100, max=3775.3k, avg=348.99, stdev=9360.97
clat (usec): min=1404, max=160135, avg=11202.55, stdev=4985.72
lat (usec): min=1404, max=160136, avg=11202.90, stdev=4985.82
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 33], 99.90th=[ 63], 99.95th=[ 72],
| 99.99th=[ 161]
bw ( KiB/s): min= 5413, max=14616, per=0.20%, avg=11406.24, stdev=1838.00, samples=117
iops : min= 1353, max= 3654, avg=2851.48, stdev=459.53, samples=117
lat (msec) : 2=0.01%, 4=0.06%, 10=49.25%, 20=47.34%, 50=3.21%
lat (msec) : 100=0.09%, 250=0.05%
cpu : usr=0.47%, sys=0.34%, ctx=64554, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.4%, 16=54.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=167882,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12050: Fri Aug 13 21:22:57 2021
read: IOPS=2709, BW=10.6MiB/s (11.1MB/s)(635MiB/60013msec)
slat (nsec): min=110, max=33300k, avg=699.86, stdev=94017.16
clat (usec): min=76, max=101027, avg=11540.59, stdev=5412.56
lat (usec): min=1214, max=101028, avg=11541.29, stdev=5413.53
clat percentiles (usec):
| 1.00th=[ 6915], 5.00th=[ 7701], 10.00th=[ 8094], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10814],
| 70.00th=[11863], 80.00th=[13173], 90.00th=[15533], 95.00th=[19530],
| 99.00th=[34866], 99.50th=[43254], 99.90th=[72877], 99.95th=[80217],
| 99.99th=[95945]
bw ( KiB/s): min= 1604, max=15104, per=0.19%, avg=11048.70, stdev=2178.49, samples=117
iops : min= 401, max= 3776, avg=2762.09, stdev=544.66, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=48.18%, 20=47.06%, 50=4.43%
lat (msec) : 100=0.28%, 250=0.01%
cpu : usr=0.41%, sys=0.39%, ctx=63620, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.5%, 16=62.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=0.7%, 16=2.0%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162624,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12051: Fri Aug 13 21:22:57 2021
read: IOPS=2601, BW=10.2MiB/s (10.7MB/s)(610MiB/60010msec)
slat (nsec): min=119, max=353922, avg=343.80, stdev=1482.11
clat (usec): min=300, max=110845, avg=12043.80, stdev=6187.11
lat (usec): min=359, max=110845, avg=12044.14, stdev=6187.13
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 48], 99.90th=[ 75], 99.95th=[ 82],
| 99.99th=[ 101]
bw ( KiB/s): min= 5912, max=14976, per=0.19%, avg=10592.10, stdev=2131.65, samples=117
iops : min= 1478, max= 3744, avg=2647.96, stdev=532.93, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=44.44%, 20=48.94%, 50=6.16%
lat (msec) : 100=0.43%, 250=0.01%
cpu : usr=0.49%, sys=0.29%, ctx=63680, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.3%, 16=63.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.9%, 16=1.5%, 32=1.4%, 64=0.0%, >=64=0.0%
issued rwts: total=156099,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12052: Fri Aug 13 21:22:57 2021
read: IOPS=2912, BW=11.4MiB/s (11.9MB/s)(683MiB/60007msec)
slat (nsec): min=110, max=220898, avg=328.55, stdev=973.31
clat (usec): min=1411, max=97915, avg=10746.28, stdev=3913.61
lat (usec): min=1412, max=97915, avg=10746.61, stdev=3913.62
clat percentiles (usec):
| 1.00th=[ 6063], 5.00th=[ 7373], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14353], 95.00th=[16909],
| 99.00th=[25822], 99.50th=[30278], 99.90th=[43779], 99.95th=[59507],
| 99.99th=[88605]
bw ( KiB/s): min= 5980, max=15360, per=0.21%, avg=11859.98, stdev=1669.43, samples=117
iops : min= 1495, max= 3840, avg=2964.92, stdev=417.35, samples=117
lat (msec) : 2=0.01%, 4=0.13%, 10=53.61%, 20=43.43%, 50=2.75%
lat (msec) : 100=0.07%
cpu : usr=0.52%, sys=0.29%, ctx=67339, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.9%, 16=59.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.3%, 16=1.4%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=174750,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12053: Fri Aug 13 21:22:57 2021
read: IOPS=2716, BW=10.6MiB/s (11.1MB/s)(637MiB/60006msec)
slat (nsec): min=110, max=7580.0k, avg=444.88, stdev=22134.51
clat (usec): min=96, max=114467, avg=11573.59, stdev=5338.55
lat (usec): min=750, max=114468, avg=11574.04, stdev=5338.72
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[10814],
| 70.00th=[11994], 80.00th=[13435], 90.00th=[16188], 95.00th=[20317],
| 99.00th=[33424], 99.50th=[39584], 99.90th=[64750], 99.95th=[77071],
| 99.99th=[93848]
bw ( KiB/s): min= 5972, max=15104, per=0.19%, avg=11054.97, stdev=2196.51, samples=117
iops : min= 1493, max= 3776, avg=2763.68, stdev=549.12, samples=117
lat (usec) : 100=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=48.43%, 20=46.32%, 50=4.93%
lat (msec) : 100=0.23%, 250=0.01%
cpu : usr=0.49%, sys=0.32%, ctx=66304, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.4%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=163009,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12054: Fri Aug 13 21:22:57 2021
read: IOPS=2781, BW=10.9MiB/s (11.4MB/s)(652MiB/60003msec)
slat (nsec): min=110, max=2083.5k, avg=340.55, stdev=6138.86
clat (usec): min=805, max=220708, avg=11248.20, stdev=5581.22
lat (usec): min=806, max=220708, avg=11248.54, stdev=5581.28
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 37], 99.90th=[ 63], 99.95th=[ 106],
| 99.99th=[ 213]
bw ( KiB/s): min= 4806, max=14648, per=0.20%, avg=11322.74, stdev=1931.84, samples=117
iops : min= 1201, max= 3662, avg=2830.62, stdev=482.98, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=48.41%, 20=48.40%, 50=2.90%
lat (msec) : 100=0.18%, 250=0.05%
cpu : usr=0.50%, sys=0.31%, ctx=62860, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166888,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12055: Fri Aug 13 21:22:57 2021
read: IOPS=2536, BW=9.91MiB/s (10.4MB/s)(595MiB/60021msec)
slat (nsec): min=119, max=1894.4k, avg=363.92, stdev=6188.06
clat (usec): min=52, max=202463, avg=12393.73, stdev=7167.04
lat (usec): min=584, max=202463, avg=12394.10, stdev=7167.03
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 47], 99.50th=[ 58], 99.90th=[ 89], 99.95th=[ 97],
| 99.99th=[ 106]
bw ( KiB/s): min= 2810, max=15360, per=0.18%, avg=10245.35, stdev=2162.74, samples=118
iops : min= 702, max= 3840, avg=2561.22, stdev=540.74, samples=118
lat (usec) : 100=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=41.82%, 20=51.70%, 50=5.65%
lat (msec) : 100=0.76%, 250=0.03%
cpu : usr=0.48%, sys=0.30%, ctx=66823, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.2%, 16=60.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.2%, 16=0.4%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=152259,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12056: Fri Aug 13 21:22:57 2021
read: IOPS=2886, BW=11.3MiB/s (11.8MB/s)(677MiB/60023msec)
slat (nsec): min=109, max=318017, avg=313.03, stdev=1362.94
clat (usec): min=960, max=179827, avg=10911.18, stdev=5142.10
lat (usec): min=960, max=179828, avg=10911.49, stdev=5142.11
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 39], 99.90th=[ 60], 99.95th=[ 69],
| 99.99th=[ 180]
bw ( KiB/s): min= 5616, max=15120, per=0.21%, avg=11676.96, stdev=1987.96, samples=118
iops : min= 1404, max= 3780, avg=2919.17, stdev=497.02, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=54.06%, 20=42.84%, 50=2.72%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.48%, sys=0.33%, ctx=64660, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=173248,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12057: Fri Aug 13 21:22:57 2021
read: IOPS=2820, BW=11.0MiB/s (11.6MB/s)(661MiB/60010msec)
slat (nsec): min=100, max=323529, avg=326.65, stdev=1025.80
clat (msec): min=2, max=145, avg=11.29, stdev= 5.88
lat (msec): min=2, max=145, avg=11.29, stdev= 5.88
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 79], 99.95th=[ 101],
| 99.99th=[ 146]
bw ( KiB/s): min= 3328, max=21803, per=0.20%, avg=11308.63, stdev=2527.32, samples=119
iops : min= 832, max= 5450, avg=2827.08, stdev=631.79, samples=119
lat (msec) : 4=1.62%, 10=48.99%, 20=45.00%, 50=4.04%, 100=0.30%
lat (msec) : 250=0.05%
cpu : usr=0.51%, sys=0.21%, ctx=64491, majf=0, minf=30
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.0%, 16=52.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=169257,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12058: Fri Aug 13 21:22:57 2021
read: IOPS=2713, BW=10.6MiB/s (11.1MB/s)(637MiB/60050msec)
slat (nsec): min=100, max=1282.4k, avg=347.41, stdev=4503.36
clat (usec): min=406, max=116496, avg=11552.49, stdev=6145.49
lat (usec): min=462, max=116501, avg=11552.84, stdev=6145.50
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 86], 99.95th=[ 91],
| 99.99th=[ 106]
bw ( KiB/s): min= 4352, max=15448, per=0.19%, avg=11059.85, stdev=2295.75, samples=117
iops : min= 1088, max= 3862, avg=2764.89, stdev=573.93, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=49.52%, 20=45.34%, 50=4.55%
lat (msec) : 100=0.41%, 250=0.03%
cpu : usr=0.51%, sys=0.28%, ctx=64746, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.4%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=1.0%, 16=0.2%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162973,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12059: Fri Aug 13 21:22:57 2021
read: IOPS=2704, BW=10.6MiB/s (11.1MB/s)(634MiB/60011msec)
slat (nsec): min=110, max=101710, avg=332.19, stdev=742.66
clat (usec): min=585, max=214393, avg=11633.23, stdev=5935.87
lat (usec): min=591, max=214394, avg=11633.56, stdev=5935.89
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 40], 99.90th=[ 69], 99.95th=[ 106],
| 99.99th=[ 213]
bw ( KiB/s): min= 510, max=15616, per=0.19%, avg=10935.04, stdev=2219.12, samples=118
iops : min= 127, max= 3904, avg=2733.69, stdev=554.80, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=45.14%, 20=50.35%, 50=4.19%
lat (msec) : 100=0.20%, 250=0.05%
cpu : usr=0.56%, sys=0.25%, ctx=63485, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162301,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12060: Fri Aug 13 21:22:57 2021
read: IOPS=2955, BW=11.5MiB/s (12.1MB/s)(693MiB/60008msec)
slat (nsec): min=110, max=3223.4k, avg=346.39, stdev=7768.27
clat (usec): min=117, max=89072, avg=10643.12, stdev=3827.46
lat (usec): min=170, max=90072, avg=10643.46, stdev=3827.84
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12256], 90.00th=[14091], 95.00th=[16188],
| 99.00th=[25297], 99.50th=[29492], 99.90th=[46924], 99.95th=[71828],
| 99.99th=[86508]
bw ( KiB/s): min= 7265, max=14592, per=0.21%, avg=12035.26, stdev=1548.70, samples=117
iops : min= 1816, max= 3648, avg=3008.74, stdev=387.18, samples=117
lat (usec) : 250=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=55.24%, 20=42.40%, 50=2.10%
lat (msec) : 100=0.09%
cpu : usr=0.54%, sys=0.29%, ctx=65492, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.3%, 16=58.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.6%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=177353,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12061: Fri Aug 13 21:22:57 2021
read: IOPS=2967, BW=11.6MiB/s (12.2MB/s)(696MiB/60008msec)
slat (nsec): min=110, max=13425k, avg=411.36, stdev=32255.27
clat (usec): min=147, max=75190, avg=10628.97, stdev=3842.41
lat (usec): min=174, max=75190, avg=10629.38, stdev=3843.27
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12125], 90.00th=[14091], 95.00th=[16581],
| 99.00th=[24773], 99.50th=[30540], 99.90th=[48497], 99.95th=[57410],
| 99.99th=[73925]
bw ( KiB/s): min= 2299, max=15192, per=0.21%, avg=11979.93, stdev=1799.21, samples=118
iops : min= 574, max= 3798, avg=2994.89, stdev=449.84, samples=118
lat (usec) : 250=0.01%
lat (msec) : 4=0.15%, 10=55.72%, 20=41.74%, 50=2.30%, 100=0.09%
cpu : usr=0.45%, sys=0.38%, ctx=61725, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=178064,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12062: Fri Aug 13 21:22:57 2021
read: IOPS=2574, BW=10.1MiB/s (10.5MB/s)(604MiB/60025msec)
slat (nsec): min=109, max=433086, avg=338.04, stdev=1767.30
clat (usec): min=287, max=113442, avg=12187.73, stdev=6662.17
lat (usec): min=519, max=113442, avg=12188.06, stdev=6662.18
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 54], 99.90th=[ 92], 99.95th=[ 102],
| 99.99th=[ 108]
bw ( KiB/s): min= 5416, max=14840, per=0.18%, avg=10470.99, stdev=1819.16, samples=117
iops : min= 1354, max= 3710, avg=2617.61, stdev=454.84, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=42.09%, 20=51.64%, 50=5.68%
lat (msec) : 100=0.50%, 250=0.06%
cpu : usr=0.50%, sys=0.27%, ctx=64345, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.1%, 16=63.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.6%, 8=1.9%, 16=1.0%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=154507,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12063: Fri Aug 13 21:22:57 2021
read: IOPS=2732, BW=10.7MiB/s (11.2MB/s)(641MiB/60038msec)
slat (nsec): min=100, max=128197, avg=332.26, stdev=697.77
clat (usec): min=1182, max=139784, avg=11508.07, stdev=5293.83
lat (usec): min=1182, max=139784, avg=11508.41, stdev=5293.86
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 38], 99.90th=[ 83], 99.95th=[ 96],
| 99.99th=[ 111]
bw ( KiB/s): min= 479, max=14392, per=0.19%, avg=11041.75, stdev=2063.27, samples=118
iops : min= 119, max= 3598, avg=2760.37, stdev=515.86, samples=118
lat (msec) : 2=0.01%, 4=0.06%, 10=47.12%, 20=48.70%, 50=3.94%
lat (msec) : 100=0.15%, 250=0.03%
cpu : usr=0.48%, sys=0.33%, ctx=63510, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.0%, 16=52.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164037,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12064: Fri Aug 13 21:22:57 2021
read: IOPS=2783, BW=10.9MiB/s (11.4MB/s)(653MiB/60007msec)
slat (nsec): min=109, max=528198, avg=325.15, stdev=1840.03
clat (usec): min=598, max=187109, avg=11290.38, stdev=5293.24
lat (usec): min=598, max=187109, avg=11290.70, stdev=5293.26
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 71], 99.95th=[ 85],
| 99.99th=[ 114]
bw ( KiB/s): min= 2506, max=15104, per=0.20%, avg=11256.89, stdev=2227.93, samples=118
iops : min= 626, max= 3776, avg=2814.16, stdev=556.99, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.17%, 10=49.39%, 20=46.15%, 50=4.05%
lat (msec) : 100=0.21%, 250=0.02%
cpu : usr=0.49%, sys=0.31%, ctx=66373, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=167050,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12065: Fri Aug 13 21:22:57 2021
read: IOPS=2802, BW=10.9MiB/s (11.5MB/s)(657MiB/60013msec)
slat (nsec): min=110, max=1692.7k, avg=361.87, stdev=6882.42
clat (usec): min=321, max=237743, avg=11155.91, stdev=5896.31
lat (usec): min=321, max=237743, avg=11156.27, stdev=5896.33
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 38], 99.90th=[ 86], 99.95th=[ 122],
| 99.99th=[ 234]
bw ( KiB/s): min= 3832, max=15616, per=0.20%, avg=11429.73, stdev=2153.46, samples=117
iops : min= 958, max= 3904, avg=2857.30, stdev=538.35, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=51.12%, 20=45.20%, 50=3.35%
lat (msec) : 100=0.13%, 250=0.06%
cpu : usr=0.46%, sys=0.33%, ctx=62458, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.1%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.4%, 16=1.4%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=168173,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12066: Fri Aug 13 21:22:57 2021
read: IOPS=2712, BW=10.6MiB/s (11.1MB/s)(636MiB/60006msec)
slat (nsec): min=110, max=1184.5k, avg=332.87, stdev=3272.89
clat (usec): min=107, max=140799, avg=11546.42, stdev=5748.40
lat (usec): min=130, max=140799, avg=11546.75, stdev=5748.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 46], 99.90th=[ 69], 99.95th=[ 95],
| 99.99th=[ 114]
bw ( KiB/s): min= 4598, max=14970, per=0.19%, avg=11051.66, stdev=2216.76, samples=117
iops : min= 1149, max= 3742, avg=2762.80, stdev=554.19, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.09%, 10=48.37%, 20=46.54%, 50=4.61%, 100=0.35%
lat (msec) : 250=0.03%
cpu : usr=0.50%, sys=0.30%, ctx=62592, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.0%, 16=62.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.0%, 16=1.0%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=162794,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12067: Fri Aug 13 21:22:57 2021
read: IOPS=2503, BW=9.78MiB/s (10.3MB/s)(587MiB/60046msec)
slat (nsec): min=119, max=1788.4k, avg=347.92, stdev=4803.30
clat (usec): min=1318, max=153355, avg=12547.20, stdev=7520.21
lat (usec): min=1318, max=153355, avg=12547.54, stdev=7520.33
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 44], 99.50th=[ 55], 99.90th=[ 96], 99.95th=[ 109],
| 99.99th=[ 150]
bw ( KiB/s): min= 4352, max=14592, per=0.18%, avg=10220.38, stdev=2074.97, samples=117
iops : min= 1088, max= 3648, avg=2554.97, stdev=518.70, samples=117
lat (msec) : 2=0.01%, 4=0.08%, 10=40.50%, 20=52.00%, 50=6.72%
lat (msec) : 100=0.61%, 250=0.08%
cpu : usr=0.48%, sys=0.26%, ctx=63506, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.0%, 16=60.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.3%, 16=1.3%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=150329,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12068: Fri Aug 13 21:22:57 2021
read: IOPS=2859, BW=11.2MiB/s (11.7MB/s)(671MiB/60033msec)
slat (nsec): min=110, max=172902, avg=328.45, stdev=727.00
clat (usec): min=834, max=144826, avg=11019.70, stdev=4978.18
lat (usec): min=835, max=144827, avg=11020.03, stdev=4978.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 59], 99.95th=[ 100],
| 99.99th=[ 132]
bw ( KiB/s): min= 1357, max=15104, per=0.20%, avg=11551.26, stdev=2211.48, samples=118
iops : min= 339, max= 3776, avg=2887.69, stdev=552.87, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=52.94%, 20=43.21%, 50=3.59%
lat (msec) : 100=0.11%, 250=0.04%
cpu : usr=0.50%, sys=0.30%, ctx=61318, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.3%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.2%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=171656,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12069: Fri Aug 13 21:22:57 2021
read: IOPS=2683, BW=10.5MiB/s (11.0MB/s)(629MiB/60007msec)
slat (nsec): min=110, max=1779.8k, avg=346.74, stdev=4515.53
clat (usec): min=1151, max=121825, avg=11682.85, stdev=5747.95
lat (usec): min=1152, max=121826, avg=11683.20, stdev=5748.18
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 44], 99.90th=[ 71], 99.95th=[ 84],
| 99.99th=[ 123]
bw ( KiB/s): min= 6144, max=14786, per=0.19%, avg=10932.35, stdev=2106.62, samples=117
iops : min= 1536, max= 3696, avg=2732.97, stdev=526.67, samples=117
lat (msec) : 2=0.01%, 4=0.09%, 10=46.67%, 20=47.98%, 50=4.92%
lat (msec) : 100=0.31%, 250=0.04%
cpu : usr=0.49%, sys=0.31%, ctx=62561, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.7%, 16=55.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.9%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=161038,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12070: Fri Aug 13 21:22:57 2021
read: IOPS=2577, BW=10.1MiB/s (10.6MB/s)(604MiB/60010msec)
slat (nsec): min=110, max=1589.1k, avg=337.56, stdev=4155.04
clat (usec): min=262, max=152076, avg=12187.37, stdev=6879.77
lat (usec): min=269, max=152076, avg=12187.71, stdev=6879.78
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 50], 99.90th=[ 97], 99.95th=[ 114],
| 99.99th=[ 140]
bw ( KiB/s): min= 4598, max=14592, per=0.18%, avg=10504.79, stdev=2065.80, samples=117
iops : min= 1149, max= 3648, avg=2626.08, stdev=516.45, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 4=0.06%, 10=41.52%, 20=52.39%, 50=5.55%, 100=0.39%
lat (msec) : 250=0.08%
cpu : usr=0.52%, sys=0.26%, ctx=63745, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=154657,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12071: Fri Aug 13 21:22:57 2021
read: IOPS=2823, BW=11.0MiB/s (11.6MB/s)(662MiB/60010msec)
slat (nsec): min=110, max=13298k, avg=484.98, stdev=42523.54
clat (usec): min=36, max=84561, avg=11224.80, stdev=4876.84
lat (usec): min=177, max=84562, avg=11225.28, stdev=4876.88
clat percentiles (usec):
| 1.00th=[ 4228], 5.00th=[ 7242], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[13042], 90.00th=[15664], 95.00th=[19006],
| 99.00th=[30278], 99.50th=[38536], 99.90th=[58983], 99.95th=[67634],
| 99.99th=[84411]
bw ( KiB/s): min= 253, max=22994, per=0.20%, avg=11304.39, stdev=2411.41, samples=119
iops : min= 63, max= 5748, avg=2825.97, stdev=602.83, samples=119
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.78%, 10=49.12%, 20=45.96%, 50=3.91%
lat (msec) : 100=0.21%
cpu : usr=0.53%, sys=0.19%, ctx=60287, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.7%, 16=58.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.7%, 16=1.1%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=169430,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12072: Fri Aug 13 21:22:57 2021
read: IOPS=2739, BW=10.7MiB/s (11.2MB/s)(642MiB/60020msec)
slat (nsec): min=119, max=2612.8k, avg=343.00, stdev=7547.00
clat (usec): min=309, max=130053, avg=11452.94, stdev=4983.44
lat (usec): min=429, max=130053, avg=11453.28, stdev=4983.52
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8586],
| 30.00th=[ 9110], 40.00th=[ 9634], 50.00th=[10159], 60.00th=[10814],
| 70.00th=[11731], 80.00th=[13173], 90.00th=[15795], 95.00th=[19268],
| 99.00th=[31589], 99.50th=[39060], 99.90th=[64226], 99.95th=[69731],
| 99.99th=[98042]
bw ( KiB/s): min= 5632, max=14818, per=0.20%, avg=11158.48, stdev=1747.63, samples=117
iops : min= 1408, max= 3704, avg=2789.50, stdev=436.89, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=47.47%, 20=47.95%, 50=4.30%
lat (msec) : 100=0.17%, 250=0.01%
cpu : usr=0.46%, sys=0.36%, ctx=68263, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.2%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.3%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=164445,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12073: Fri Aug 13 21:22:57 2021
read: IOPS=2869, BW=11.2MiB/s (11.8MB/s)(673MiB/60013msec)
slat (nsec): min=119, max=1713.3k, avg=354.92, stdev=5105.40
clat (usec): min=412, max=90117, avg=10926.83, stdev=4006.38
lat (usec): min=418, max=90119, avg=10927.19, stdev=4006.36
clat percentiles (usec):
| 1.00th=[ 6325], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11469], 80.00th=[12649], 90.00th=[15008], 95.00th=[17695],
| 99.00th=[25035], 99.50th=[30016], 99.90th=[41681], 99.95th=[67634],
| 99.99th=[88605]
bw ( KiB/s): min= 7000, max=15329, per=0.21%, avg=11674.53, stdev=1686.13, samples=117
iops : min= 1750, max= 3832, avg=2918.50, stdev=421.54, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=52.22%, 20=44.93%, 50=2.63%
lat (msec) : 100=0.08%
cpu : usr=0.46%, sys=0.35%, ctx=62123, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.1%, 16=53.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=172222,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12074: Fri Aug 13 21:22:57 2021
read: IOPS=2599, BW=10.2MiB/s (10.6MB/s)(609MiB/60007msec)
slat (nsec): min=109, max=406076, avg=351.64, stdev=1756.33
clat (usec): min=579, max=108083, avg=12127.52, stdev=6497.44
lat (usec): min=580, max=108084, avg=12127.87, stdev=6497.48
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 41], 99.50th=[ 54], 99.90th=[ 81], 99.95th=[ 87],
| 99.99th=[ 106]
bw ( KiB/s): min= 3808, max=15368, per=0.18%, avg=10481.07, stdev=2246.87, samples=118
iops : min= 952, max= 3842, avg=2620.14, stdev=561.74, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=43.43%, 20=50.05%, 50=5.90%
lat (msec) : 100=0.54%, 250=0.02%
cpu : usr=0.49%, sys=0.29%, ctx=63037, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.3%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=155969,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12075: Fri Aug 13 21:22:57 2021
read: IOPS=2828, BW=11.0MiB/s (11.6MB/s)(663MiB/60045msec)
slat (nsec): min=119, max=170042, avg=330.06, stdev=1065.56
clat (usec): min=476, max=249434, avg=11093.61, stdev=6301.05
lat (usec): min=482, max=249435, avg=11093.94, stdev=6301.07
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 42], 99.90th=[ 89], 99.95th=[ 112],
| 99.99th=[ 228]
bw ( KiB/s): min= 5120, max=15088, per=0.20%, avg=11544.68, stdev=1995.72, samples=117
iops : min= 1280, max= 3772, avg=2886.09, stdev=498.91, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=53.73%, 20=42.66%, 50=3.15%
lat (msec) : 100=0.31%, 250=0.07%
cpu : usr=0.49%, sys=0.30%, ctx=63252, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=169821,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12076: Fri Aug 13 21:22:57 2021
read: IOPS=2958, BW=11.6MiB/s (12.1MB/s)(694MiB/60011msec)
slat (nsec): min=110, max=5964.7k, avg=420.56, stdev=21523.47
clat (usec): min=24, max=84869, avg=10592.64, stdev=3991.47
lat (usec): min=554, max=84870, avg=10593.06, stdev=3991.38
clat percentiles (usec):
| 1.00th=[ 6063], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9634], 60.00th=[10159],
| 70.00th=[10945], 80.00th=[12125], 90.00th=[13960], 95.00th=[16319],
| 99.00th=[26608], 99.50th=[31327], 99.90th=[52167], 99.95th=[56361],
| 99.99th=[69731]
bw ( KiB/s): min= 7704, max=15640, per=0.21%, avg=12045.18, stdev=1738.45, samples=117
iops : min= 1926, max= 3910, avg=3011.17, stdev=434.57, samples=117
lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.11%, 10=56.60%, 20=40.56%, 50=2.58%
lat (msec) : 100=0.13%
cpu : usr=0.48%, sys=0.34%, ctx=65870, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.0%, 16=62.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.7%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=177552,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12077: Fri Aug 13 21:22:57 2021
read: IOPS=2842, BW=11.1MiB/s (11.6MB/s)(667MiB/60055msec)
slat (nsec): min=110, max=17994k, avg=557.11, stdev=50740.22
clat (usec): min=4, max=176049, avg=11066.82, stdev=6056.87
lat (usec): min=217, max=176049, avg=11067.37, stdev=6056.81
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 32], 99.50th=[ 44], 99.90th=[ 78], 99.95th=[ 148],
| 99.99th=[ 169]
bw ( KiB/s): min= 1229, max=15592, per=0.20%, avg=11485.79, stdev=2274.54, samples=118
iops : min= 307, max= 3898, avg=2871.33, stdev=568.65, samples=118
lat (usec) : 10=0.01%, 100=0.01%, 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=51.61%, 20=44.90%, 50=3.02%
lat (msec) : 100=0.36%, 250=0.05%
cpu : usr=0.50%, sys=0.32%, ctx=64208, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=170728,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12078: Fri Aug 13 21:22:57 2021
read: IOPS=2666, BW=10.4MiB/s (10.9MB/s)(625MiB/60011msec)
slat (nsec): min=110, max=4017.6k, avg=413.80, stdev=14704.85
clat (usec): min=28, max=105797, avg=11769.76, stdev=5859.71
lat (usec): min=689, max=105797, avg=11770.18, stdev=5859.63
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 36], 99.50th=[ 45], 99.90th=[ 72], 99.95th=[ 85],
| 99.99th=[ 104]
bw ( KiB/s): min= 4312, max=15144, per=0.19%, avg=10852.61, stdev=2122.39, samples=117
iops : min= 1078, max= 3786, avg=2713.09, stdev=530.59, samples=117
lat (usec) : 50=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=45.74%, 20=48.26%, 50=5.52%
lat (msec) : 100=0.35%, 250=0.02%
cpu : usr=0.47%, sys=0.33%, ctx=65557, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.1%, 16=53.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=160041,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12079: Fri Aug 13 21:22:57 2021
read: IOPS=2712, BW=10.6MiB/s (11.1MB/s)(636MiB/60042msec)
slat (nsec): min=110, max=2653.9k, avg=336.83, stdev=6610.46
clat (usec): min=1812, max=163462, avg=11586.63, stdev=6272.07
lat (usec): min=1813, max=164537, avg=11586.97, stdev=6272.48
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 36], 99.50th=[ 49], 99.90th=[ 99], 99.95th=[ 111],
| 99.99th=[ 163]
bw ( KiB/s): min= 4571, max=14568, per=0.19%, avg=11078.88, stdev=2006.83, samples=117
iops : min= 1142, max= 3642, avg=2769.60, stdev=501.74, samples=117
lat (msec) : 2=0.01%, 4=0.05%, 10=47.25%, 20=48.37%, 50=3.91%
lat (msec) : 100=0.35%, 250=0.07%
cpu : usr=0.44%, sys=0.35%, ctx=64012, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162891,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12080: Fri Aug 13 21:22:57 2021
read: IOPS=2923, BW=11.4MiB/s (12.0MB/s)(686MiB/60051msec)
slat (nsec): min=110, max=181330, avg=307.52, stdev=665.09
clat (usec): min=203, max=257835, avg=10814.09, stdev=5343.44
lat (usec): min=207, max=257835, avg=10814.40, stdev=5343.46
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 35], 99.90th=[ 68], 99.95th=[ 82],
| 99.99th=[ 226]
bw ( KiB/s): min= 6888, max=15176, per=0.21%, avg=11846.42, stdev=1916.72, samples=118
iops : min= 1722, max= 3794, avg=2961.47, stdev=479.18, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=55.50%, 20=41.20%, 50=3.08%
lat (msec) : 100=0.16%, 250=0.02%, 500=0.01%
cpu : usr=0.49%, sys=0.30%, ctx=61818, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.7%, 16=56.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=175546,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12081: Fri Aug 13 21:22:57 2021
read: IOPS=2758, BW=10.8MiB/s (11.3MB/s)(647MiB/60045msec)
slat (nsec): min=110, max=875311, avg=330.08, stdev=2656.85
clat (usec): min=328, max=165654, avg=11412.18, stdev=5660.51
lat (usec): min=329, max=165654, avg=11412.51, stdev=5660.53
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 39], 99.90th=[ 78], 99.95th=[ 102],
| 99.99th=[ 155]
bw ( KiB/s): min= 4343, max=14700, per=0.20%, avg=11150.89, stdev=1970.90, samples=118
iops : min= 1085, max= 3675, avg=2787.58, stdev=492.74, samples=118
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 4=0.07%, 10=46.97%, 20=49.48%, 50=3.13%, 100=0.28%
lat (msec) : 250=0.06%
cpu : usr=0.47%, sys=0.35%, ctx=63219, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.1%, 16=55.9%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.5%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165628,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12082: Fri Aug 13 21:22:57 2021
read: IOPS=2706, BW=10.6MiB/s (11.1MB/s)(635MiB/60044msec)
slat (nsec): min=100, max=12303k, avg=519.52, stdev=36808.18
clat (usec): min=325, max=146189, avg=11578.84, stdev=6259.71
lat (usec): min=463, max=146189, avg=11579.36, stdev=6259.57
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 50], 99.90th=[ 93], 99.95th=[ 104],
| 99.99th=[ 136]
bw ( KiB/s): min= 4864, max=14600, per=0.19%, avg=11044.60, stdev=2130.97, samples=117
iops : min= 1216, max= 3650, avg=2761.04, stdev=532.73, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.13%, 10=48.97%, 20=46.12%, 50=4.30%
lat (msec) : 100=0.41%, 250=0.06%
cpu : usr=0.53%, sys=0.26%, ctx=62725, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.2%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.2%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162523,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12083: Fri Aug 13 21:22:57 2021
read: IOPS=2553, BW=9.97MiB/s (10.5MB/s)(599MiB/60013msec)
slat (nsec): min=110, max=8156.8k, avg=401.96, stdev=21575.07
clat (usec): min=332, max=120718, avg=12284.27, stdev=6673.29
lat (usec): min=660, max=120718, avg=12284.67, stdev=6673.66
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 18], 95.00th=[ 23],
| 99.00th=[ 42], 99.50th=[ 53], 99.90th=[ 78], 99.95th=[ 90],
| 99.99th=[ 112]
bw ( KiB/s): min= 4582, max=14848, per=0.18%, avg=10424.56, stdev=2172.19, samples=117
iops : min= 1145, max= 3712, avg=2605.99, stdev=543.05, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 4=0.11%, 10=42.20%, 20=50.68%, 50=6.42%, 100=0.57%
lat (msec) : 250=0.01%
cpu : usr=0.46%, sys=0.30%, ctx=61513, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.0%, 16=53.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=153222,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12084: Fri Aug 13 21:22:57 2021
read: IOPS=2726, BW=10.6MiB/s (11.2MB/s)(639MiB/60007msec)
slat (nsec): min=110, max=291031, avg=324.77, stdev=1113.60
clat (usec): min=1033, max=177362, avg=11510.51, stdev=5869.65
lat (usec): min=1033, max=177362, avg=11510.83, stdev=5869.67
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 77], 99.95th=[ 116],
| 99.99th=[ 167]
bw ( KiB/s): min= 5632, max=15112, per=0.19%, avg=11097.31, stdev=2090.62, samples=117
iops : min= 1408, max= 3778, avg=2774.28, stdev=522.66, samples=117
lat (msec) : 2=0.01%, 4=0.04%, 10=47.71%, 20=47.85%, 50=4.07%
lat (msec) : 100=0.28%, 250=0.06%
cpu : usr=0.51%, sys=0.31%, ctx=61708, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.3%, 16=0.9%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=163592,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12085: Fri Aug 13 21:22:57 2021
read: IOPS=2676, BW=10.5MiB/s (11.0MB/s)(628MiB/60043msec)
slat (nsec): min=90, max=4475.6k, avg=383.89, stdev=11415.09
clat (usec): min=1612, max=168802, avg=11695.35, stdev=5918.35
lat (usec): min=1612, max=168802, avg=11695.74, stdev=5918.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 74], 99.95th=[ 103],
| 99.99th=[ 163]
bw ( KiB/s): min= 2658, max=15104, per=0.19%, avg=10931.74, stdev=2051.34, samples=117
iops : min= 664, max= 3776, avg=2732.81, stdev=512.81, samples=117
lat (msec) : 2=0.01%, 4=0.04%, 10=45.64%, 20=49.13%, 50=4.89%
lat (msec) : 100=0.23%, 250=0.06%
cpu : usr=0.52%, sys=0.27%, ctx=65954, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=11.6%, 16=63.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.8%, 8=1.0%, 16=0.9%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=160679,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12086: Fri Aug 13 21:22:57 2021
read: IOPS=2762, BW=10.8MiB/s (11.3MB/s)(647MiB/60008msec)
slat (nsec): min=110, max=715307, avg=339.31, stdev=1917.43
clat (usec): min=1165, max=182000, avg=11338.30, stdev=5516.53
lat (usec): min=1165, max=182001, avg=11338.64, stdev=5516.56
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 82], 99.95th=[ 96],
| 99.99th=[ 157]
bw ( KiB/s): min= 3584, max=14698, per=0.20%, avg=11237.63, stdev=2053.27, samples=117
iops : min= 896, max= 3674, avg=2809.29, stdev=513.35, samples=117
lat (msec) : 2=0.01%, 4=0.09%, 10=47.50%, 20=48.92%, 50=3.24%
lat (msec) : 100=0.20%, 250=0.04%
cpu : usr=0.50%, sys=0.31%, ctx=63447, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=10.5%, 16=64.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=1.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=165757,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12087: Fri Aug 13 21:22:57 2021
read: IOPS=3111, BW=12.2MiB/s (12.7MB/s)(729MiB/60011msec)
slat (nsec): min=110, max=214088, avg=319.44, stdev=779.61
clat (usec): min=295, max=105537, avg=10248.55, stdev=4055.15
lat (usec): min=321, max=105538, avg=10248.87, stdev=4055.16
clat percentiles (usec):
| 1.00th=[ 2933], 5.00th=[ 6783], 10.00th=[ 7570], 20.00th=[ 8225],
| 30.00th=[ 8717], 40.00th=[ 9110], 50.00th=[ 9503], 60.00th=[10028],
| 70.00th=[10814], 80.00th=[11863], 90.00th=[13698], 95.00th=[15533],
| 99.00th=[23725], 99.50th=[28967], 99.90th=[57410], 99.95th=[72877],
| 99.99th=[88605]
bw ( KiB/s): min= 7409, max=24015, per=0.22%, avg=12460.63, stdev=2130.01, samples=119
iops : min= 1852, max= 6003, avg=3115.00, stdev=532.45, samples=119
lat (usec) : 500=0.01%
lat (msec) : 4=2.86%, 10=56.50%, 20=38.77%, 50=1.74%, 100=0.13%
lat (msec) : 250=0.01%
cpu : usr=0.54%, sys=0.22%, ctx=62364, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.0%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.5%, 16=1.0%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=186744,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12088: Fri Aug 13 21:22:57 2021
read: IOPS=2746, BW=10.7MiB/s (11.2MB/s)(644MiB/60016msec)
slat (nsec): min=110, max=94872k, avg=1211.41, stdev=239752.79
clat (usec): min=48, max=272875, avg=11412.34, stdev=5786.50
lat (usec): min=305, max=272875, avg=11413.56, stdev=5790.62
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 78], 99.95th=[ 108],
| 99.99th=[ 174]
bw ( KiB/s): min= 5512, max=14792, per=0.20%, avg=11185.22, stdev=1901.76, samples=117
iops : min= 1378, max= 3698, avg=2796.18, stdev=475.43, samples=117
lat (usec) : 50=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=46.79%, 20=49.36%, 50=3.50%
lat (msec) : 100=0.25%, 250=0.06%, 500=0.01%
cpu : usr=0.51%, sys=0.30%, ctx=63770, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.9%, 16=57.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.4%, 16=0.4%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=164837,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12089: Fri Aug 13 21:22:57 2021
read: IOPS=2855, BW=11.2MiB/s (11.7MB/s)(669MiB/60003msec)
slat (nsec): min=110, max=1099.7k, avg=338.12, stdev=2748.47
clat (usec): min=723, max=193272, avg=11080.71, stdev=5365.03
lat (usec): min=1141, max=193273, avg=11081.05, stdev=5365.04
clat percentiles (msec):
| 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 38], 99.90th=[ 67], 99.95th=[ 88],
| 99.99th=[ 138]
bw ( KiB/s): min= 6387, max=27081, per=0.20%, avg=11546.64, stdev=2387.96, samples=118
iops : min= 1596, max= 6770, avg=2886.54, stdev=596.99, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=2.02%, 10=47.91%, 20=46.31%, 50=3.56%
lat (msec) : 100=0.15%, 250=0.04%
cpu : usr=0.52%, sys=0.23%, ctx=68911, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.9%, 16=54.1%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=171323,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12090: Fri Aug 13 21:22:57 2021
read: IOPS=2817, BW=11.0MiB/s (11.5MB/s)(661MiB/60029msec)
slat (nsec): min=110, max=1264.0k, avg=352.43, stdev=3861.86
clat (usec): min=430, max=136136, avg=11111.52, stdev=4437.74
lat (usec): min=462, max=136137, avg=11111.88, stdev=4437.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 26], 99.50th=[ 30], 99.90th=[ 54], 99.95th=[ 75],
| 99.99th=[ 136]
bw ( KiB/s): min= 6150, max=14880, per=0.20%, avg=11509.62, stdev=1750.22, samples=117
iops : min= 1537, max= 3720, avg=2877.27, stdev=437.58, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.07%, 10=47.92%, 20=49.15%, 50=2.72%, 100=0.09%
lat (msec) : 250=0.04%
cpu : usr=0.51%, sys=0.30%, ctx=64982, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.3%, 16=60.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.3%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=169135,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12091: Fri Aug 13 21:22:57 2021
read: IOPS=2538, BW=9.92MiB/s (10.4MB/s)(595MiB/60020msec)
slat (nsec): min=109, max=1382.1k, avg=351.93, stdev=4482.75
clat (usec): min=236, max=252234, avg=12352.04, stdev=7528.24
lat (usec): min=242, max=252235, avg=12352.39, stdev=7528.27
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 41], 99.50th=[ 54], 99.90th=[ 83], 99.95th=[ 146],
| 99.99th=[ 251]
bw ( KiB/s): min= 5600, max=15624, per=0.18%, avg=10345.78, stdev=2048.79, samples=117
iops : min= 1400, max= 3906, avg=2586.32, stdev=512.20, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=38.86%, 20=54.85%, 50=5.70%
lat (msec) : 100=0.48%, 250=0.03%, 500=0.02%
cpu : usr=0.43%, sys=0.33%, ctx=63201, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=52.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=152353,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12092: Fri Aug 13 21:22:57 2021
read: IOPS=2812, BW=11.0MiB/s (11.5MB/s)(659MiB/60013msec)
slat (nsec): min=110, max=342656, avg=334.46, stdev=1068.24
clat (usec): min=846, max=221657, avg=11197.31, stdev=5778.49
lat (usec): min=846, max=221658, avg=11197.65, stdev=5778.51
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 38], 99.90th=[ 58], 99.95th=[ 118],
| 99.99th=[ 218]
bw ( KiB/s): min= 726, max=14848, per=0.20%, avg=11359.73, stdev=2210.94, samples=118
iops : min= 181, max= 3712, avg=2839.89, stdev=552.75, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.15%, 10=50.62%, 20=45.36%, 50=3.69%
lat (msec) : 100=0.11%, 250=0.07%
cpu : usr=0.48%, sys=0.33%, ctx=64753, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.7%, 16=62.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.9%, 8=1.1%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=168794,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12093: Fri Aug 13 21:22:57 2021
read: IOPS=2702, BW=10.6MiB/s (11.1MB/s)(633MiB/60010msec)
slat (nsec): min=110, max=2293.0k, avg=365.06, stdev=7470.59
clat (usec): min=158, max=165133, avg=11600.60, stdev=5963.21
lat (usec): min=165, max=165136, avg=11600.96, stdev=5963.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 43], 99.90th=[ 83], 99.95th=[ 103],
| 99.99th=[ 163]
bw ( KiB/s): min= 6064, max=15121, per=0.19%, avg=11000.44, stdev=2086.80, samples=117
iops : min= 1516, max= 3780, avg=2749.97, stdev=521.70, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=47.44%, 20=47.47%, 50=4.70%
lat (msec) : 100=0.24%, 250=0.05%
cpu : usr=0.46%, sys=0.33%, ctx=67067, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.4%, 16=58.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.5%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=162166,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12094: Fri Aug 13 21:22:57 2021
read: IOPS=2771, BW=10.8MiB/s (11.4MB/s)(650MiB/60012msec)
slat (nsec): min=110, max=2639.5k, avg=362.52, stdev=7413.66
clat (usec): min=26, max=75993, avg=11361.65, stdev=4393.44
lat (usec): min=539, max=75994, avg=11362.02, stdev=4393.42
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10290], 60.00th=[10945],
| 70.00th=[11863], 80.00th=[13042], 90.00th=[15270], 95.00th=[18220],
| 99.00th=[27657], 99.50th=[34866], 99.90th=[52691], 99.95th=[65274],
| 99.99th=[74974]
bw ( KiB/s): min= 3305, max=14323, per=0.20%, avg=11181.40, stdev=1694.28, samples=118
iops : min= 826, max= 3580, avg=2795.19, stdev=423.56, samples=118
lat (usec) : 50=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=45.46%, 20=50.83%, 50=3.49%
lat (msec) : 100=0.14%
cpu : usr=0.51%, sys=0.30%, ctx=67316, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.7%, 16=53.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166311,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12095: Fri Aug 13 21:22:57 2021
read: IOPS=2887, BW=11.3MiB/s (11.8MB/s)(677MiB/60006msec)
slat (nsec): min=120, max=3943.4k, avg=386.58, stdev=11130.75
clat (usec): min=88, max=154742, avg=10866.24, stdev=4525.60
lat (usec): min=704, max=154743, avg=10866.62, stdev=4525.61
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 28], 99.50th=[ 33], 99.90th=[ 52], 99.95th=[ 71],
| 99.99th=[ 155]
bw ( KiB/s): min= 5579, max=14592, per=0.21%, avg=11760.91, stdev=1797.19, samples=117
iops : min= 1394, max= 3648, avg=2940.08, stdev=449.35, samples=117
lat (usec) : 100=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.02%, 10=52.62%, 20=44.43%, 50=2.79%
lat (msec) : 100=0.11%, 250=0.02%
cpu : usr=0.52%, sys=0.29%, ctx=65449, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.5%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=173251,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12096: Fri Aug 13 21:22:57 2021
read: IOPS=2790, BW=10.9MiB/s (11.4MB/s)(654MiB/60002msec)
slat (nsec): min=110, max=3039.2k, avg=368.33, stdev=8698.89
clat (usec): min=593, max=199298, avg=11388.15, stdev=6061.72
lat (usec): min=593, max=199299, avg=11388.52, stdev=6061.73
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 43], 99.90th=[ 75], 99.95th=[ 93],
| 99.99th=[ 199]
bw ( KiB/s): min= 5980, max=32694, per=0.20%, avg=11269.92, stdev=2951.02, samples=118
iops : min= 1495, max= 8173, avg=2817.36, stdev=737.70, samples=118
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=2.41%, 10=45.76%, 20=47.20%, 50=4.33%
lat (msec) : 100=0.26%, 250=0.04%
cpu : usr=0.51%, sys=0.21%, ctx=62355, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.9%, 16=60.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.3%, 16=0.8%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=167427,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12097: Fri Aug 13 21:22:57 2021
read: IOPS=2803, BW=11.0MiB/s (11.5MB/s)(658MiB/60044msec)
slat (nsec): min=110, max=1000.6k, avg=329.45, stdev=2609.64
clat (usec): min=109, max=201609, avg=11200.50, stdev=5445.84
lat (usec): min=160, max=201610, avg=11200.83, stdev=5445.96
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 62], 99.95th=[ 104],
| 99.99th=[ 197]
bw ( KiB/s): min= 4728, max=15329, per=0.20%, avg=11446.77, stdev=1999.52, samples=117
iops : min= 1182, max= 3832, avg=2861.56, stdev=499.88, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.23%, 10=49.67%, 20=46.36%, 50=3.54%
lat (msec) : 100=0.16%, 250=0.06%
cpu : usr=0.47%, sys=0.35%, ctx=65216, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.1%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.7%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=168355,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12098: Fri Aug 13 21:22:57 2021
read: IOPS=2808, BW=11.0MiB/s (11.5MB/s)(658MiB/60013msec)
slat (nsec): min=110, max=1151.2k, avg=331.28, stdev=3092.82
clat (usec): min=224, max=106215, avg=11233.85, stdev=5063.44
lat (usec): min=285, max=106215, avg=11234.18, stdev=5063.46
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 39], 99.90th=[ 57], 99.95th=[ 87],
| 99.99th=[ 104]
bw ( KiB/s): min= 3816, max=18650, per=0.20%, avg=11356.41, stdev=2193.67, samples=118
iops : min= 954, max= 4662, avg=2838.97, stdev=548.38, samples=118
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.70%, 10=48.36%, 20=46.65%, 50=4.13%
lat (msec) : 100=0.12%, 250=0.04%
cpu : usr=0.45%, sys=0.34%, ctx=64357, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=9.1%, 16=66.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=95.7%, 8=0.8%, 16=2.0%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=168517,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12099: Fri Aug 13 21:22:57 2021
read: IOPS=2855, BW=11.2MiB/s (11.7MB/s)(669MiB/60015msec)
slat (nsec): min=100, max=1878.5k, avg=350.13, stdev=5710.59
clat (usec): min=883, max=149116, avg=10996.65, stdev=5194.84
lat (usec): min=883, max=149116, avg=10997.00, stdev=5194.92
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 37], 99.90th=[ 75], 99.95th=[ 101],
| 99.99th=[ 142]
bw ( KiB/s): min= 5325, max=14968, per=0.20%, avg=11631.44, stdev=1970.29, samples=117
iops : min= 1331, max= 3742, avg=2907.73, stdev=492.59, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=52.38%, 20=44.64%, 50=2.59%
lat (msec) : 100=0.26%, 250=0.05%
cpu : usr=0.51%, sys=0.29%, ctx=65760, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.6%, 16=53.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=171365,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12100: Fri Aug 13 21:22:57 2021
read: IOPS=2775, BW=10.8MiB/s (11.4MB/s)(651MiB/60008msec)
slat (nsec): min=110, max=58842k, avg=735.91, stdev=145962.11
clat (usec): min=446, max=124275, avg=11278.13, stdev=5417.89
lat (usec): min=468, max=124275, avg=11278.86, stdev=5419.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 43], 99.90th=[ 78], 99.95th=[ 90],
| 99.99th=[ 125]
bw ( KiB/s): min= 3824, max=15104, per=0.20%, avg=11312.94, stdev=1986.55, samples=117
iops : min= 956, max= 3776, avg=2828.09, stdev=496.66, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=49.22%, 20=47.07%, 50=3.28%
lat (msec) : 100=0.30%, 250=0.04%
cpu : usr=0.50%, sys=0.30%, ctx=61510, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.7%, 16=52.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=166573,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12101: Fri Aug 13 21:22:57 2021
read: IOPS=3070, BW=12.0MiB/s (12.6MB/s)(720MiB/60008msec)
slat (nsec): min=110, max=337255, avg=326.84, stdev=1038.58
clat (usec): min=1489, max=119943, avg=10380.63, stdev=3753.68
lat (usec): min=1490, max=119943, avg=10380.96, stdev=3753.70
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 14], 95.00th=[ 17],
| 99.00th=[ 25], 99.50th=[ 30], 99.90th=[ 41], 99.95th=[ 48],
| 99.99th=[ 120]
bw ( KiB/s): min= 6768, max=15073, per=0.22%, avg=12292.45, stdev=1549.69, samples=119
iops : min= 1692, max= 3768, avg=3072.96, stdev=387.39, samples=119
lat (msec) : 2=0.01%, 4=0.45%, 10=58.23%, 20=39.21%, 50=2.08%
lat (msec) : 100=0.02%, 250=0.02%
cpu : usr=0.59%, sys=0.18%, ctx=63978, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.3%, 16=59.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.0%, 16=1.0%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=184267,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12102: Fri Aug 13 21:22:57 2021
read: IOPS=2879, BW=11.2MiB/s (11.8MB/s)(675MiB/60015msec)
slat (nsec): min=119, max=125316, avg=324.20, stdev=701.66
clat (usec): min=132, max=124473, avg=10922.57, stdev=4466.16
lat (usec): min=161, max=124474, avg=10922.89, stdev=4466.18
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 55], 99.95th=[ 59],
| 99.99th=[ 123]
bw ( KiB/s): min= 5884, max=15360, per=0.21%, avg=11714.30, stdev=1954.67, samples=117
iops : min= 1471, max= 3840, avg=2928.51, stdev=488.70, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=52.39%, 20=44.47%, 50=2.94%
lat (msec) : 100=0.12%, 250=0.02%
cpu : usr=0.52%, sys=0.27%, ctx=62455, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=52.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=172838,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12103: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60007msec)
slat (nsec): min=100, max=214418, avg=334.53, stdev=908.75
clat (usec): min=344, max=118894, avg=11085.70, stdev=5021.78
lat (usec): min=356, max=118894, avg=11086.03, stdev=5021.80
clat percentiles (usec):
| 1.00th=[ 2966], 5.00th=[ 7111], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12780], 90.00th=[15270], 95.00th=[18482],
| 99.00th=[30016], 99.50th=[36963], 99.90th=[63177], 99.95th=[69731],
| 99.99th=[98042]
bw ( KiB/s): min= 6744, max=27881, per=0.20%, avg=11507.95, stdev=2400.28, samples=119
iops : min= 1686, max= 6970, avg=2876.87, stdev=600.05, samples=119
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=2.17%, 10=48.19%, 20=45.86%, 50=3.56%
lat (msec) : 100=0.22%, 250=0.01%
cpu : usr=0.56%, sys=0.18%, ctx=65716, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=172573,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12104: Fri Aug 13 21:22:57 2021
read: IOPS=2986, BW=11.7MiB/s (12.2MB/s)(700MiB/60004msec)
slat (nsec): min=100, max=361263, avg=318.63, stdev=1066.55
clat (usec): min=241, max=88068, avg=10676.34, stdev=4218.51
lat (usec): min=273, max=88068, avg=10676.65, stdev=4218.52
clat percentiles (usec):
| 1.00th=[ 2933], 5.00th=[ 7177], 10.00th=[ 7767], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12387], 90.00th=[14484], 95.00th=[17171],
| 99.00th=[25822], 99.50th=[30278], 99.90th=[48497], 99.95th=[70779],
| 99.99th=[87557]
bw ( KiB/s): min= 6056, max=28134, per=0.21%, avg=11955.68, stdev=2378.62, samples=119
iops : min= 1514, max= 7033, avg=2988.80, stdev=594.65, samples=119
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=2.15%, 10=52.12%, 20=42.85%, 50=2.78%
lat (msec) : 100=0.09%
cpu : usr=0.56%, sys=0.20%, ctx=66504, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=179201,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12105: Fri Aug 13 21:22:57 2021
read: IOPS=2864, BW=11.2MiB/s (11.7MB/s)(671MiB/60011msec)
slat (nsec): min=110, max=979650, avg=332.09, stdev=2921.47
clat (usec): min=875, max=330352, avg=10974.25, stdev=6014.30
lat (usec): min=876, max=330355, avg=10974.58, stdev=6014.30
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 78], 99.95th=[ 92],
| 99.99th=[ 317]
bw ( KiB/s): min= 255, max=15144, per=0.20%, avg=11596.87, stdev=2253.55, samples=118
iops : min= 63, max= 3786, avg=2899.08, stdev=563.44, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=54.44%, 20=41.96%, 50=3.40%
lat (msec) : 100=0.13%, 250=0.01%, 500=0.01%
cpu : usr=0.48%, sys=0.32%, ctx=61895, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.8%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=171897,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12106: Fri Aug 13 21:22:57 2021
read: IOPS=2715, BW=10.6MiB/s (11.1MB/s)(637MiB/60008msec)
slat (nsec): min=110, max=230488, avg=336.72, stdev=1109.13
clat (usec): min=260, max=255959, avg=11517.74, stdev=6672.30
lat (usec): min=464, max=255959, avg=11518.07, stdev=6672.31
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 74], 99.95th=[ 112],
| 99.99th=[ 249]
bw ( KiB/s): min= 5376, max=14818, per=0.19%, avg=11060.20, stdev=1990.83, samples=117
iops : min= 1344, max= 3704, avg=2764.91, stdev=497.71, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=47.81%, 20=47.86%, 50=4.01%
lat (msec) : 100=0.17%, 250=0.05%, 500=0.01%
cpu : usr=0.44%, sys=0.35%, ctx=61735, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.1%, 16=54.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.4%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162950,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12107: Fri Aug 13 21:22:57 2021
read: IOPS=2668, BW=10.4MiB/s (10.9MB/s)(625MiB/60004msec)
slat (nsec): min=110, max=1895.8k, avg=380.11, stdev=8729.77
clat (usec): min=276, max=226640, avg=11774.13, stdev=6738.80
lat (usec): min=450, max=226641, avg=11774.51, stdev=6738.81
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 72], 99.95th=[ 115],
| 99.99th=[ 222]
bw ( KiB/s): min= 3840, max=15360, per=0.19%, avg=10861.88, stdev=2041.60, samples=117
iops : min= 960, max= 3840, avg=2715.41, stdev=510.41, samples=117
lat (usec) : 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=43.87%, 20=51.26%, 50=4.42%
lat (msec) : 100=0.31%, 250=0.08%
cpu : usr=0.41%, sys=0.37%, ctx=66914, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.7%, 16=54.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=160109,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12108: Fri Aug 13 21:22:57 2021
read: IOPS=2849, BW=11.1MiB/s (11.7MB/s)(668MiB/60024msec)
slat (nsec): min=110, max=573164, avg=337.02, stdev=1945.64
clat (usec): min=533, max=102019, avg=11068.20, stdev=4928.77
lat (usec): min=539, max=102019, avg=11068.54, stdev=4928.80
clat percentiles (usec):
| 1.00th=[ 4555], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11469], 80.00th=[12780], 90.00th=[15139], 95.00th=[18482],
| 99.00th=[30016], 99.50th=[39060], 99.90th=[60031], 99.95th=[84411],
| 99.99th=[91751]
bw ( KiB/s): min= 6416, max=18594, per=0.20%, avg=11526.48, stdev=2096.24, samples=118
iops : min= 1604, max= 4648, avg=2881.54, stdev=524.06, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.62%, 10=52.39%, 20=43.15%, 50=3.65%
lat (msec) : 100=0.18%, 250=0.01%
cpu : usr=0.49%, sys=0.32%, ctx=67130, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=9.2%, 16=65.8%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.0%, 8=0.2%, 16=2.7%, 32=1.1%, 64=0.0%, >=64=0.0%
issued rwts: total=171021,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12109: Fri Aug 13 21:22:57 2021
read: IOPS=2900, BW=11.3MiB/s (11.9MB/s)(680MiB/60014msec)
slat (nsec): min=110, max=471365, avg=322.88, stdev=1280.39
clat (usec): min=730, max=142276, avg=10839.58, stdev=4408.65
lat (usec): min=730, max=142280, avg=10839.90, stdev=4408.66
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 31], 99.90th=[ 60], 99.95th=[ 80],
| 99.99th=[ 104]
bw ( KiB/s): min= 766, max=14856, per=0.21%, avg=11727.35, stdev=2003.44, samples=118
iops : min= 191, max= 3714, avg=2931.72, stdev=500.90, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=52.94%, 20=44.26%, 50=2.52%
lat (msec) : 100=0.14%, 250=0.02%
cpu : usr=0.52%, sys=0.30%, ctx=65289, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.1%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.3%, 16=0.9%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=174046,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12110: Fri Aug 13 21:22:57 2021
read: IOPS=2693, BW=10.5MiB/s (11.0MB/s)(631MiB/60020msec)
slat (nsec): min=110, max=6125.9k, avg=373.13, stdev=15562.67
clat (usec): min=165, max=102581, avg=11677.37, stdev=5310.29
lat (usec): min=199, max=102582, avg=11677.74, stdev=5310.25
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 39], 99.90th=[ 75], 99.95th=[ 91],
| 99.99th=[ 103]
bw ( KiB/s): min= 5000, max=15456, per=0.19%, avg=10990.41, stdev=1893.36, samples=117
iops : min= 1250, max= 3864, avg=2747.47, stdev=473.34, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=44.16%, 20=51.31%, 50=4.20%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.44%, sys=0.34%, ctx=62562, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.0%, 16=59.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.5%, 16=1.1%, 32=1.8%, 64=0.0%, >=64=0.0%
issued rwts: total=161661,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12111: Fri Aug 13 21:22:57 2021
read: IOPS=2705, BW=10.6MiB/s (11.1MB/s)(635MiB/60039msec)
slat (nsec): min=110, max=402241, avg=322.28, stdev=1153.17
clat (msec): min=2, max=168, avg=11.63, stdev= 5.35
lat (msec): min=2, max=168, avg=11.63, stdev= 5.35
clat percentiles (usec):
| 1.00th=[ 5538], 5.00th=[ 7570], 10.00th=[ 8029], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10290], 60.00th=[11076],
| 70.00th=[11994], 80.00th=[13435], 90.00th=[16057], 95.00th=[19792],
| 99.00th=[32113], 99.50th=[41157], 99.90th=[69731], 99.95th=[73925],
| 99.99th=[86508]
bw ( KiB/s): min= 5620, max=17365, per=0.19%, avg=10926.49, stdev=2009.52, samples=118
iops : min= 1405, max= 4341, avg=2731.52, stdev=502.38, samples=118
lat (msec) : 4=0.17%, 10=44.31%, 20=50.65%, 50=4.59%, 100=0.28%
lat (msec) : 250=0.01%
cpu : usr=0.43%, sys=0.37%, ctx=63604, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.1%, 16=51.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=162450,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12112: Fri Aug 13 21:22:57 2021
read: IOPS=2805, BW=11.0MiB/s (11.5MB/s)(658MiB/60008msec)
slat (nsec): min=110, max=3018.8k, avg=340.36, stdev=8478.85
clat (usec): min=503, max=478164, avg=11168.57, stdev=8157.11
lat (usec): min=508, max=478168, avg=11168.91, stdev=8157.14
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 31], 99.50th=[ 41], 99.90th=[ 81], 99.95th=[ 132],
| 99.99th=[ 481]
bw ( KiB/s): min= 2560, max=15872, per=0.20%, avg=11419.07, stdev=2076.34, samples=117
iops : min= 640, max= 3968, avg=2854.62, stdev=519.11, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.18%, 10=50.24%, 20=46.35%, 50=2.97%
lat (msec) : 100=0.21%, 250=0.04%, 500=0.02%
cpu : usr=0.51%, sys=0.29%, ctx=61531, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.8%, 16=56.3%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.2%, 16=0.6%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=168355,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12113: Fri Aug 13 21:22:57 2021
read: IOPS=2870, BW=11.2MiB/s (11.8MB/s)(673MiB/60051msec)
slat (nsec): min=110, max=92680, avg=328.38, stdev=676.05
clat (usec): min=172, max=138549, avg=11069.96, stdev=4920.15
lat (usec): min=186, max=138550, avg=11070.28, stdev=4920.17
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 35], 99.90th=[ 67], 99.95th=[ 79],
| 99.99th=[ 128]
bw ( KiB/s): min= 2027, max=15112, per=0.20%, avg=11525.01, stdev=2122.98, samples=119
iops : min= 506, max= 3778, avg=2881.15, stdev=530.75, samples=119
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=52.89%, 20=43.22%, 50=3.59%
lat (msec) : 100=0.18%, 250=0.02%
cpu : usr=0.52%, sys=0.22%, ctx=63481, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.1%, 16=57.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=172380,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12114: Fri Aug 13 21:22:57 2021
read: IOPS=2850, BW=11.1MiB/s (11.7MB/s)(668MiB/60003msec)
slat (nsec): min=110, max=1617.8k, avg=347.60, stdev=4234.77
clat (usec): min=1622, max=212537, avg=11034.60, stdev=4872.31
lat (usec): min=1622, max=212538, avg=11034.95, stdev=4872.32
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 33], 99.90th=[ 58], 99.95th=[ 64],
| 99.99th=[ 207]
bw ( KiB/s): min= 247, max=14592, per=0.20%, avg=11491.45, stdev=1991.77, samples=118
iops : min= 61, max= 3648, avg=2872.71, stdev=497.98, samples=118
lat (msec) : 2=0.01%, 4=0.19%, 10=51.48%, 20=45.05%, 50=3.16%
lat (msec) : 100=0.10%, 250=0.02%
cpu : usr=0.48%, sys=0.34%, ctx=62810, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.5%, 16=56.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.1%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=171012,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12115: Fri Aug 13 21:22:57 2021
read: IOPS=2699, BW=10.5MiB/s (11.1MB/s)(633MiB/60043msec)
slat (nsec): min=119, max=1114.2k, avg=344.64, stdev=3126.66
clat (msec): min=2, max=118, avg=11.67, stdev= 6.13
lat (msec): min=2, max=118, avg=11.67, stdev= 6.13
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 47], 99.90th=[ 77], 99.95th=[ 91],
| 99.99th=[ 120]
bw ( KiB/s): min= 2554, max=16862, per=0.19%, avg=10920.28, stdev=2417.05, samples=118
iops : min= 638, max= 4215, avg=2729.93, stdev=604.30, samples=118
lat (msec) : 4=0.10%, 10=48.93%, 20=45.50%, 50=5.05%, 100=0.38%
lat (msec) : 250=0.04%
cpu : usr=0.49%, sys=0.31%, ctx=66109, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162101,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12116: Fri Aug 13 21:22:57 2021
read: IOPS=2787, BW=10.9MiB/s (11.4MB/s)(654MiB/60029msec)
slat (nsec): min=110, max=1152.6k, avg=338.40, stdev=3149.31
clat (usec): min=497, max=173266, avg=11258.59, stdev=5199.78
lat (usec): min=536, max=173269, avg=11258.93, stdev=5199.82
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 35], 99.90th=[ 66], 99.95th=[ 77],
| 99.99th=[ 174]
bw ( KiB/s): min= 4894, max=15184, per=0.20%, avg=11353.39, stdev=1925.62, samples=117
iops : min= 1223, max= 3796, avg=2838.24, stdev=481.42, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=48.59%, 20=47.61%, 50=3.49%
lat (msec) : 100=0.19%, 250=0.04%
cpu : usr=0.49%, sys=0.31%, ctx=66267, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.5%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.7%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=167309,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12117: Fri Aug 13 21:22:57 2021
read: IOPS=2775, BW=10.8MiB/s (11.4MB/s)(650MiB/60005msec)
slat (nsec): min=100, max=9653.4k, avg=395.68, stdev=23821.77
clat (usec): min=88, max=90950, avg=11306.64, stdev=4766.57
lat (usec): min=117, max=90952, avg=11307.03, stdev=4766.68
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11600], 80.00th=[12911], 90.00th=[15401], 95.00th=[19268],
| 99.00th=[30540], 99.50th=[36963], 99.90th=[54264], 99.95th=[73925],
| 99.99th=[90702]
bw ( KiB/s): min= 5120, max=14848, per=0.20%, avg=11295.38, stdev=1922.81, samples=117
iops : min= 1280, max= 3712, avg=2823.79, stdev=480.70, samples=117
lat (usec) : 100=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=48.98%, 20=46.50%, 50=4.33%
lat (msec) : 100=0.13%
cpu : usr=0.51%, sys=0.29%, ctx=64305, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.0%, 16=60.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.4%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=166517,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12118: Fri Aug 13 21:22:57 2021
read: IOPS=2864, BW=11.2MiB/s (11.7MB/s)(672MiB/60024msec)
slat (nsec): min=110, max=440484, avg=320.16, stdev=1405.28
clat (usec): min=264, max=145243, avg=10960.34, stdev=4408.14
lat (usec): min=269, max=145244, avg=10960.66, stdev=4408.18
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 32], 99.90th=[ 57], 99.95th=[ 63],
| 99.99th=[ 146]
bw ( KiB/s): min= 7152, max=15872, per=0.20%, avg=11665.08, stdev=1753.21, samples=117
iops : min= 1788, max= 3968, avg=2916.12, stdev=438.30, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.07%, 10=51.04%, 20=46.38%, 50=2.37%, 100=0.13%
lat (msec) : 250=0.02%
cpu : usr=0.48%, sys=0.31%, ctx=61802, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.3%, 16=53.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.2%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=171951,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12119: Fri Aug 13 21:22:57 2021
read: IOPS=2692, BW=10.5MiB/s (11.0MB/s)(632MiB/60046msec)
slat (nsec): min=110, max=5501.2k, avg=366.09, stdev=13857.88
clat (usec): min=1334, max=107147, avg=11679.82, stdev=4953.96
lat (usec): min=1334, max=107147, avg=11680.19, stdev=4954.46
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 36], 99.90th=[ 70], 99.95th=[ 82],
| 99.99th=[ 101]
bw ( KiB/s): min= 6682, max=14536, per=0.19%, avg=10989.74, stdev=1815.48, samples=117
iops : min= 1670, max= 3634, avg=2747.30, stdev=453.86, samples=117
lat (msec) : 2=0.01%, 4=0.04%, 10=43.28%, 20=52.02%, 50=4.54%
lat (msec) : 100=0.10%, 250=0.02%
cpu : usr=0.46%, sys=0.33%, ctx=58941, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.2%, 16=55.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=161685,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12120: Fri Aug 13 21:22:57 2021
read: IOPS=2675, BW=10.5MiB/s (11.0MB/s)(628MiB/60047msec)
slat (nsec): min=110, max=123207, avg=322.55, stdev=724.26
clat (usec): min=294, max=198496, avg=11749.38, stdev=5986.85
lat (usec): min=349, max=198497, avg=11749.70, stdev=5986.87
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 71], 99.95th=[ 96],
| 99.99th=[ 199]
bw ( KiB/s): min= 6328, max=14856, per=0.19%, avg=10907.92, stdev=2073.11, samples=117
iops : min= 1582, max= 3714, avg=2726.87, stdev=518.26, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=44.77%, 20=49.92%, 50=4.93%
lat (msec) : 100=0.23%, 250=0.04%
cpu : usr=0.50%, sys=0.31%, ctx=63936, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.3%, 16=57.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.1%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=160683,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12121: Fri Aug 13 21:22:57 2021
read: IOPS=2703, BW=10.6MiB/s (11.1MB/s)(634MiB/60038msec)
slat (nsec): min=110, max=38901k, avg=617.31, stdev=97381.57
clat (usec): min=309, max=183515, avg=11642.17, stdev=6097.78
lat (usec): min=1095, max=183515, avg=11642.78, stdev=6101.90
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 83], 99.95th=[ 99],
| 99.99th=[ 178]
bw ( KiB/s): min= 502, max=14816, per=0.19%, avg=10943.31, stdev=2111.26, samples=118
iops : min= 125, max= 3704, avg=2735.68, stdev=527.82, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=46.53%, 20=48.64%, 50=4.42%
lat (msec) : 100=0.28%, 250=0.05%
cpu : usr=0.47%, sys=0.34%, ctx=62247, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.8%, 16=58.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162319,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12122: Fri Aug 13 21:22:57 2021
read: IOPS=2668, BW=10.4MiB/s (10.9MB/s)(626MiB/60014msec)
slat (nsec): min=110, max=38015k, avg=567.84, stdev=95007.39
clat (usec): min=1731, max=152022, avg=11819.45, stdev=6686.59
lat (usec): min=1731, max=152023, avg=11820.02, stdev=6689.57
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 100], 99.95th=[ 111],
| 99.99th=[ 153]
bw ( KiB/s): min= 4608, max=15392, per=0.19%, avg=10819.69, stdev=2191.95, samples=118
iops : min= 1152, max= 3848, avg=2704.86, stdev=547.96, samples=118
lat (msec) : 2=0.01%, 4=0.01%, 10=45.58%, 20=48.77%, 50=5.24%
lat (msec) : 100=0.32%, 250=0.08%
cpu : usr=0.48%, sys=0.35%, ctx=65558, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.6%, 16=55.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160128,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12123: Fri Aug 13 21:22:57 2021
read: IOPS=2663, BW=10.4MiB/s (10.9MB/s)(624MiB/60004msec)
slat (nsec): min=100, max=1154.5k, avg=372.72, stdev=5178.07
clat (usec): min=381, max=133325, avg=11756.69, stdev=5840.56
lat (usec): min=404, max=133325, avg=11757.06, stdev=5840.60
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 42], 99.90th=[ 88], 99.95th=[ 106],
| 99.99th=[ 124]
bw ( KiB/s): min= 4814, max=15360, per=0.19%, avg=10838.53, stdev=1907.77, samples=117
iops : min= 1203, max= 3840, avg=2709.49, stdev=477.01, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 4=0.10%, 10=43.83%, 20=51.46%, 50=4.25%, 100=0.28%
lat (msec) : 250=0.07%
cpu : usr=0.43%, sys=0.37%, ctx=64712, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.4%, 16=59.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=159825,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12124: Fri Aug 13 21:22:57 2021
read: IOPS=2932, BW=11.5MiB/s (12.0MB/s)(688MiB/60021msec)
slat (nsec): min=100, max=2009.3k, avg=322.75, stdev=4849.62
clat (usec): min=374, max=103257, avg=10681.27, stdev=4116.49
lat (usec): min=414, max=103258, avg=10681.59, stdev=4116.49
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 32], 99.90th=[ 56], 99.95th=[ 61],
| 99.99th=[ 103]
bw ( KiB/s): min= 6656, max=15824, per=0.21%, avg=11953.91, stdev=1969.68, samples=117
iops : min= 1664, max= 3956, avg=2988.39, stdev=492.42, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=56.18%, 20=41.09%, 50=2.51%
lat (msec) : 100=0.14%, 250=0.01%
cpu : usr=0.45%, sys=0.33%, ctx=63301, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.9%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.3%, 16=1.1%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=176020,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12125: Fri Aug 13 21:22:57 2021
read: IOPS=2696, BW=10.5MiB/s (11.0MB/s)(632MiB/60015msec)
slat (nsec): min=119, max=5888.4k, avg=395.32, stdev=15534.52
clat (usec): min=287, max=143994, avg=11607.21, stdev=5852.68
lat (usec): min=505, max=143994, avg=11607.60, stdev=5852.69
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 82], 99.95th=[ 114],
| 99.99th=[ 142]
bw ( KiB/s): min= 4598, max=14848, per=0.19%, avg=10996.63, stdev=2026.37, samples=117
iops : min= 1149, max= 3712, avg=2749.01, stdev=506.61, samples=117
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=46.40%, 20=49.26%, 50=3.95%
lat (msec) : 100=0.25%, 250=0.07%
cpu : usr=0.50%, sys=0.29%, ctx=62715, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.1%, 16=1.0%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=161825,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12126: Fri Aug 13 21:22:57 2021
read: IOPS=2649, BW=10.3MiB/s (10.9MB/s)(621MiB/60005msec)
slat (nsec): min=119, max=2080.5k, avg=342.01, stdev=5965.94
clat (usec): min=446, max=152682, avg=11816.79, stdev=6136.73
lat (usec): min=494, max=152683, avg=11817.13, stdev=6136.84
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 49], 99.90th=[ 72], 99.95th=[ 85],
| 99.99th=[ 153]
bw ( KiB/s): min= 2043, max=14592, per=0.19%, avg=10776.32, stdev=2282.21, samples=117
iops : min= 510, max= 3648, avg=2693.95, stdev=570.58, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.15%, 10=44.53%, 20=50.19%, 50=4.70%, 100=0.40%
lat (msec) : 250=0.02%
cpu : usr=0.48%, sys=0.29%, ctx=62050, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.8%, 16=52.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158982,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12127: Fri Aug 13 21:22:57 2021
read: IOPS=2742, BW=10.7MiB/s (11.2MB/s)(643MiB/60006msec)
slat (nsec): min=100, max=2634.2k, avg=393.95, stdev=10726.03
clat (usec): min=262, max=122897, avg=11486.34, stdev=5103.04
lat (usec): min=289, max=122897, avg=11486.74, stdev=5102.99
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 31], 99.50th=[ 39], 99.90th=[ 73], 99.95th=[ 86],
| 99.99th=[ 120]
bw ( KiB/s): min= 4343, max=15104, per=0.19%, avg=11084.74, stdev=2056.74, samples=118
iops : min= 1085, max= 3776, avg=2771.06, stdev=514.19, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.02%, 4=0.11%, 10=46.23%, 20=49.46%, 50=3.97%
lat (msec) : 100=0.18%, 250=0.02%
cpu : usr=0.49%, sys=0.31%, ctx=63915, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.7%, 16=60.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164593,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12128: Fri Aug 13 21:22:57 2021
read: IOPS=2606, BW=10.2MiB/s (10.7MB/s)(611MiB/60014msec)
slat (nsec): min=100, max=482597, avg=317.47, stdev=1459.54
clat (usec): min=152, max=158205, avg=12008.22, stdev=7212.54
lat (usec): min=184, max=158206, avg=12008.54, stdev=7212.54
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 40], 99.50th=[ 55], 99.90th=[ 99], 99.95th=[ 122],
| 99.99th=[ 153]
bw ( KiB/s): min= 6400, max=14800, per=0.19%, avg=10594.82, stdev=1946.97, samples=117
iops : min= 1600, max= 3700, avg=2648.57, stdev=486.77, samples=117
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 4=0.04%, 10=45.11%, 20=49.31%, 50=4.93%, 100=0.51%
lat (msec) : 250=0.10%
cpu : usr=0.55%, sys=0.22%, ctx=67639, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.2%, 16=51.8%, 32=25.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.0%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=156449,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12129: Fri Aug 13 21:22:57 2021
read: IOPS=2643, BW=10.3MiB/s (10.8MB/s)(620MiB/60023msec)
slat (nsec): min=110, max=545857, avg=328.54, stdev=1535.33
clat (usec): min=302, max=127290, avg=11894.51, stdev=6484.09
lat (usec): min=322, max=127290, avg=11894.84, stdev=6484.10
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 39], 99.50th=[ 56], 99.90th=[ 88], 99.95th=[ 93],
| 99.99th=[ 121]
bw ( KiB/s): min= 3952, max=14592, per=0.19%, avg=10770.31, stdev=2089.16, samples=117
iops : min= 988, max= 3648, avg=2692.46, stdev=522.27, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.12%, 10=44.08%, 20=50.60%, 50=4.61%, 100=0.55%
lat (msec) : 250=0.03%
cpu : usr=0.47%, sys=0.32%, ctx=62109, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.6%, 16=58.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.2%, 16=1.2%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=158670,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12130: Fri Aug 13 21:22:57 2021
read: IOPS=2751, BW=10.7MiB/s (11.3MB/s)(645MiB/60016msec)
slat (nsec): min=110, max=7436.0k, avg=515.21, stdev=32120.08
clat (usec): min=215, max=119865, avg=11368.36, stdev=5456.18
lat (usec): min=496, max=119866, avg=11368.87, stdev=5456.08
clat percentiles (usec):
| 1.00th=[ 6587], 5.00th=[ 7570], 10.00th=[ 7963], 20.00th=[ 8586],
| 30.00th=[ 8979], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10683],
| 70.00th=[11469], 80.00th=[12911], 90.00th=[15533], 95.00th=[18744],
| 99.00th=[34341], 99.50th=[45351], 99.90th=[70779], 99.95th=[86508],
| 99.99th=[96994]
bw ( KiB/s): min= 3864, max=14848, per=0.20%, avg=11208.84, stdev=2047.29, samples=117
iops : min= 966, max= 3712, avg=2802.09, stdev=511.82, samples=117
lat (usec) : 250=0.01%, 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=49.74%, 20=45.96%, 50=3.85%
lat (msec) : 100=0.35%, 250=0.01%
cpu : usr=0.53%, sys=0.26%, ctx=61703, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.2%, 16=53.9%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165118,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12131: Fri Aug 13 21:22:57 2021
read: IOPS=2863, BW=11.2MiB/s (11.7MB/s)(672MiB/60039msec)
slat (nsec): min=100, max=54554, avg=318.74, stdev=546.32
clat (usec): min=1835, max=121248, avg=11092.88, stdev=5157.18
lat (usec): min=1836, max=121249, avg=11093.20, stdev=5157.20
clat percentiles (usec):
| 1.00th=[ 6259], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12387], 90.00th=[14877], 95.00th=[17957],
| 99.00th=[31327], 99.50th=[40633], 99.90th=[68682], 99.95th=[83362],
| 99.99th=[96994]
bw ( KiB/s): min= 998, max=15329, per=0.20%, avg=11502.99, stdev=2222.02, samples=119
iops : min= 249, max= 3832, avg=2875.62, stdev=555.51, samples=119
lat (msec) : 2=0.01%, 4=0.09%, 10=53.34%, 20=42.67%, 50=3.62%
lat (msec) : 100=0.27%, 250=0.01%
cpu : usr=0.55%, sys=0.18%, ctx=62729, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.3%, 16=57.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=0.8%, 32=2.1%, 64=0.0%, >=64=0.0%
issued rwts: total=171917,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12132: Fri Aug 13 21:22:57 2021
read: IOPS=2776, BW=10.8MiB/s (11.4MB/s)(651MiB/60016msec)
slat (nsec): min=100, max=903972, avg=332.84, stdev=2322.10
clat (usec): min=374, max=131092, avg=11276.60, stdev=5560.88
lat (usec): min=380, max=131093, avg=11276.94, stdev=5560.90
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 71], 99.95th=[ 94],
| 99.99th=[ 115]
bw ( KiB/s): min= 5568, max=15337, per=0.20%, avg=11301.37, stdev=2216.16, samples=117
iops : min= 1392, max= 3834, avg=2825.30, stdev=554.04, samples=117
lat (usec) : 500=0.01%
lat (msec) : 4=0.08%, 10=51.39%, 20=44.28%, 50=3.94%, 100=0.26%
lat (msec) : 250=0.04%
cpu : usr=0.48%, sys=0.30%, ctx=63299, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.6%, 16=61.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.2%, 16=1.6%, 32=1.6%, 64=0.0%, >=64=0.0%
issued rwts: total=166637,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12133: Fri Aug 13 21:22:57 2021
read: IOPS=2639, BW=10.3MiB/s (10.8MB/s)(619MiB/60007msec)
slat (nsec): min=110, max=1323.4k, avg=337.46, stdev=3745.11
clat (usec): min=1610, max=176518, avg=11872.56, stdev=6222.03
lat (usec): min=1610, max=176519, avg=11872.90, stdev=6222.09
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 37], 99.50th=[ 48], 99.90th=[ 90], 99.95th=[ 99],
| 99.99th=[ 129]
bw ( KiB/s): min= 3576, max=14600, per=0.19%, avg=10756.97, stdev=2022.60, samples=117
iops : min= 894, max= 3650, avg=2689.10, stdev=505.65, samples=117
lat (msec) : 2=0.01%, 4=0.11%, 10=44.69%, 20=50.17%, 50=4.60%
lat (msec) : 100=0.39%, 250=0.04%
cpu : usr=0.47%, sys=0.33%, ctx=62489, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.7%, 16=58.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.3%, 16=1.2%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=158407,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12134: Fri Aug 13 21:22:57 2021
read: IOPS=2888, BW=11.3MiB/s (11.8MB/s)(677MiB/60038msec)
slat (nsec): min=119, max=102493k, avg=910.57, stdev=246123.88
clat (usec): min=28, max=142900, avg=10842.93, stdev=4488.67
lat (usec): min=796, max=142900, avg=10843.84, stdev=4495.46
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 29], 99.50th=[ 36], 99.90th=[ 51], 99.95th=[ 55],
| 99.99th=[ 110]
bw ( KiB/s): min= 5069, max=15160, per=0.21%, avg=11793.76, stdev=1961.96, samples=117
iops : min= 1267, max= 3790, avg=2948.30, stdev=490.48, samples=117
lat (usec) : 50=0.01%
lat (msec) : 4=0.12%, 10=55.80%, 20=40.67%, 50=3.29%, 100=0.10%
lat (msec) : 250=0.02%
cpu : usr=0.56%, sys=0.23%, ctx=61937, majf=0, minf=29
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.6%, 16=0.8%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=173424,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12135: Fri Aug 13 21:22:57 2021
read: IOPS=2827, BW=11.0MiB/s (11.6MB/s)(663MiB/60009msec)
slat (nsec): min=110, max=6827.5k, avg=362.58, stdev=16676.06
clat (usec): min=105, max=209082, avg=11043.29, stdev=4950.12
lat (usec): min=253, max=209082, avg=11043.65, stdev=4950.07
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 27], 99.50th=[ 31], 99.90th=[ 57], 99.95th=[ 94],
| 99.99th=[ 146]
bw ( KiB/s): min= 5056, max=15360, per=0.20%, avg=11520.76, stdev=1892.27, samples=117
iops : min= 1264, max= 3840, avg=2880.05, stdev=473.06, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=50.80%, 20=46.15%, 50=2.83%
lat (msec) : 100=0.09%, 250=0.04%
cpu : usr=0.52%, sys=0.26%, ctx=64009, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.1%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=1.4%, 16=0.6%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=169649,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12136: Fri Aug 13 21:22:57 2021
read: IOPS=2901, BW=11.3MiB/s (11.9MB/s)(680MiB/60012msec)
slat (nsec): min=110, max=84571, avg=309.08, stdev=585.40
clat (usec): min=666, max=162350, avg=10964.02, stdev=5094.92
lat (usec): min=666, max=162350, avg=10964.33, stdev=5094.95
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 40], 99.90th=[ 63], 99.95th=[ 69],
| 99.99th=[ 155]
bw ( KiB/s): min= 968, max=15104, per=0.20%, avg=11650.59, stdev=2273.47, samples=119
iops : min= 242, max= 3776, avg=2912.59, stdev=568.40, samples=119
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.09%, 10=55.16%, 20=40.81%, 50=3.70%
lat (msec) : 100=0.21%, 250=0.02%
cpu : usr=0.52%, sys=0.22%, ctx=65738, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.9%, 16=58.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.1%, 16=1.5%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=174097,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12137: Fri Aug 13 21:22:57 2021
read: IOPS=2861, BW=11.2MiB/s (11.7MB/s)(671MiB/60013msec)
slat (nsec): min=109, max=114708, avg=316.43, stdev=632.04
clat (usec): min=1117, max=132383, avg=11138.26, stdev=6128.66
lat (usec): min=1117, max=132384, avg=11138.58, stdev=6128.68
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 45], 99.90th=[ 81], 99.95th=[ 99],
| 99.99th=[ 132]
bw ( KiB/s): min= 5365, max=29655, per=0.20%, avg=11458.31, stdev=3016.00, samples=119
iops : min= 1341, max= 7413, avg=2864.45, stdev=753.98, samples=119
lat (msec) : 2=0.01%, 4=3.17%, 10=50.18%, 20=41.56%, 50=4.70%
lat (msec) : 100=0.34%, 250=0.03%
cpu : usr=0.50%, sys=0.23%, ctx=64772, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.5%, 16=57.6%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.5%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=171747,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12138: Fri Aug 13 21:22:57 2021
read: IOPS=2604, BW=10.2MiB/s (10.7MB/s)(611MiB/60010msec)
slat (nsec): min=110, max=2179.3k, avg=332.73, stdev=5557.65
clat (usec): min=541, max=254850, avg=12003.74, stdev=6661.41
lat (usec): min=542, max=254850, avg=12004.07, stdev=6661.44
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 22],
| 99.00th=[ 40], 99.50th=[ 52], 99.90th=[ 74], 99.95th=[ 92],
| 99.99th=[ 146]
bw ( KiB/s): min= 4816, max=15104, per=0.19%, avg=10605.15, stdev=2174.62, samples=117
iops : min= 1204, max= 3776, avg=2651.15, stdev=543.63, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.12%, 10=44.91%, 20=48.76%, 50=5.68%
lat (msec) : 100=0.49%, 250=0.04%, 500=0.01%
cpu : usr=0.46%, sys=0.32%, ctx=63209, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.7%, 16=57.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.5%, 16=0.7%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=156290,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12139: Fri Aug 13 21:22:57 2021
read: IOPS=2706, BW=10.6MiB/s (11.1MB/s)(634MiB/60006msec)
slat (nsec): min=110, max=780991, avg=329.03, stdev=2797.84
clat (usec): min=332, max=245670, avg=11616.64, stdev=5940.17
lat (usec): min=362, max=245670, avg=11616.97, stdev=5940.22
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 62], 99.95th=[ 96],
| 99.99th=[ 243]
bw ( KiB/s): min= 5604, max=14848, per=0.19%, avg=11016.62, stdev=1794.88, samples=117
iops : min= 1401, max= 3712, avg=2754.04, stdev=448.69, samples=117
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=44.48%, 20=51.21%, 50=4.04%
lat (msec) : 100=0.19%, 250=0.04%
cpu : usr=0.52%, sys=0.28%, ctx=68236, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.0%, 16=55.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.9%, 16=0.1%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=162403,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12140: Fri Aug 13 21:22:57 2021
read: IOPS=2911, BW=11.4MiB/s (11.9MB/s)(683MiB/60012msec)
slat (nsec): min=119, max=238877, avg=310.06, stdev=830.85
clat (usec): min=149, max=121453, avg=10788.19, stdev=4663.76
lat (usec): min=221, max=121454, avg=10788.50, stdev=4663.79
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 60], 99.95th=[ 93],
| 99.99th=[ 120]
bw ( KiB/s): min= 6232, max=15025, per=0.21%, avg=11871.63, stdev=1858.56, samples=117
iops : min= 1558, max= 3756, avg=2967.79, stdev=464.65, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.17%, 10=54.93%, 20=41.94%, 50=2.80%, 100=0.14%
lat (msec) : 250=0.02%
cpu : usr=0.49%, sys=0.32%, ctx=63259, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.3%, 16=56.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.9%, 8=0.4%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=174742,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12141: Fri Aug 13 21:22:57 2021
read: IOPS=2502, BW=9.78MiB/s (10.2MB/s)(587MiB/60007msec)
slat (nsec): min=110, max=702559, avg=346.68, stdev=2628.19
clat (usec): min=226, max=114966, avg=12587.46, stdev=7162.70
lat (usec): min=314, max=114966, avg=12587.80, stdev=7162.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 15], 90.00th=[ 19], 95.00th=[ 24],
| 99.00th=[ 44], 99.50th=[ 56], 99.90th=[ 87], 99.95th=[ 97],
| 99.99th=[ 103]
bw ( KiB/s): min= 2554, max=15104, per=0.18%, avg=10095.54, stdev=2406.29, samples=118
iops : min= 638, max= 3776, avg=2523.81, stdev=601.60, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 4=0.08%, 10=40.37%, 20=51.66%, 50=7.11%, 100=0.75%
lat (msec) : 250=0.03%
cpu : usr=0.46%, sys=0.31%, ctx=62841, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.0%, 16=54.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.9%, 16=0.3%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=150172,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12142: Fri Aug 13 21:22:57 2021
read: IOPS=2713, BW=10.6MiB/s (11.1MB/s)(636MiB/60023msec)
slat (nsec): min=110, max=2192.5k, avg=376.24, stdev=8956.35
clat (usec): min=64, max=106840, avg=11536.79, stdev=5505.60
lat (usec): min=206, max=106840, avg=11537.17, stdev=5505.56
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 33], 99.50th=[ 41], 99.90th=[ 71], 99.95th=[ 87],
| 99.99th=[ 105]
bw ( KiB/s): min= 2834, max=15400, per=0.19%, avg=11057.95, stdev=2338.28, samples=117
iops : min= 708, max= 3850, avg=2764.36, stdev=584.56, samples=117
lat (usec) : 100=0.01%, 250=0.01%
lat (msec) : 2=0.01%, 4=0.16%, 10=48.42%, 20=46.00%, 50=5.15%
lat (msec) : 100=0.24%, 250=0.02%
cpu : usr=0.49%, sys=0.29%, ctx=62948, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.8%, 16=52.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.5%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=162846,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12143: Fri Aug 13 21:22:57 2021
read: IOPS=2813, BW=11.0MiB/s (11.5MB/s)(660MiB/60039msec)
slat (nsec): min=110, max=1214.7k, avg=331.35, stdev=3044.13
clat (usec): min=1870, max=147187, avg=11125.75, stdev=4871.93
lat (usec): min=1871, max=147189, avg=11126.08, stdev=4871.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 31], 99.50th=[ 38], 99.90th=[ 62], 99.95th=[ 70],
| 99.99th=[ 107]
bw ( KiB/s): min= 4152, max=15305, per=0.20%, avg=11469.30, stdev=1998.83, samples=117
iops : min= 1038, max= 3826, avg=2867.20, stdev=499.72, samples=117
lat (msec) : 2=0.01%, 4=0.07%, 10=52.03%, 20=43.95%, 50=3.77%
lat (msec) : 100=0.16%, 250=0.02%
cpu : usr=0.51%, sys=0.29%, ctx=59157, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.2%, 16=57.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.1%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=168929,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12144: Fri Aug 13 21:22:57 2021
read: IOPS=2765, BW=10.8MiB/s (11.3MB/s)(648MiB/60019msec)
slat (nsec): min=110, max=544805, avg=321.01, stdev=1729.07
clat (usec): min=541, max=139288, avg=11352.47, stdev=5084.40
lat (usec): min=564, max=139288, avg=11352.79, stdev=5084.42
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 38], 99.90th=[ 73], 99.95th=[ 88],
| 99.99th=[ 115]
bw ( KiB/s): min= 4598, max=14530, per=0.20%, avg=11264.58, stdev=1950.78, samples=117
iops : min= 1149, max= 3632, avg=2815.98, stdev=487.68, samples=117
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=48.91%, 20=46.96%, 50=3.83%
lat (msec) : 100=0.22%, 250=0.02%
cpu : usr=0.46%, sys=0.33%, ctx=59963, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.7%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165997,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12145: Fri Aug 13 21:22:57 2021
read: IOPS=2736, BW=10.7MiB/s (11.2MB/s)(641MiB/60014msec)
slat (nsec): min=119, max=619543, avg=334.80, stdev=2013.79
clat (usec): min=1704, max=127924, avg=11512.83, stdev=5432.61
lat (usec): min=1705, max=127925, avg=11513.16, stdev=5432.65
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 42], 99.90th=[ 79], 99.95th=[ 94],
| 99.99th=[ 108]
bw ( KiB/s): min= 6594, max=15360, per=0.19%, avg=11069.42, stdev=1891.97, samples=118
iops : min= 1648, max= 3840, avg=2767.28, stdev=472.98, samples=118
lat (msec) : 2=0.01%, 4=0.11%, 10=45.78%, 20=49.69%, 50=4.17%
lat (msec) : 100=0.20%, 250=0.05%
cpu : usr=0.48%, sys=0.31%, ctx=65048, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.1%, 16=61.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.2%, 8=0.5%, 16=1.8%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164218,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12146: Fri Aug 13 21:22:57 2021
read: IOPS=2690, BW=10.5MiB/s (11.0MB/s)(631MiB/60009msec)
slat (nsec): min=110, max=839924, avg=340.41, stdev=3063.46
clat (usec): min=777, max=140399, avg=11640.42, stdev=5690.48
lat (usec): min=777, max=140399, avg=11640.76, stdev=5690.50
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 20],
| 99.00th=[ 33], 99.50th=[ 43], 99.90th=[ 73], 99.95th=[ 84],
| 99.99th=[ 140]
bw ( KiB/s): min= 2299, max=15241, per=0.19%, avg=10968.12, stdev=2185.90, samples=117
iops : min= 574, max= 3810, avg=2741.90, stdev=546.50, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.03%, 10=47.20%, 20=47.86%, 50=4.54%
lat (msec) : 100=0.33%, 250=0.02%
cpu : usr=0.47%, sys=0.30%, ctx=58533, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.4%, 16=54.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=161436,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12147: Fri Aug 13 21:22:57 2021
read: IOPS=2823, BW=11.0MiB/s (11.6MB/s)(662MiB/60013msec)
slat (nsec): min=110, max=17153k, avg=494.96, stdev=42450.31
clat (usec): min=7, max=183611, avg=11170.69, stdev=5234.48
lat (usec): min=396, max=183611, avg=11171.18, stdev=5234.39
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 34], 99.90th=[ 64], 99.95th=[ 94],
| 99.99th=[ 159]
bw ( KiB/s): min= 6810, max=18650, per=0.20%, avg=11409.85, stdev=1854.79, samples=118
iops : min= 1702, max= 4662, avg=2852.33, stdev=463.68, samples=118
lat (usec) : 10=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.94%, 10=48.93%, 20=46.63%, 50=3.35%
lat (msec) : 100=0.11%, 250=0.04%
cpu : usr=0.51%, sys=0.29%, ctx=62021, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.4%, 16=53.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.3%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=169423,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12148: Fri Aug 13 21:22:57 2021
read: IOPS=2769, BW=10.8MiB/s (11.3MB/s)(650MiB/60058msec)
slat (nsec): min=119, max=30149k, avg=515.20, stdev=73977.47
clat (usec): min=1303, max=188406, avg=11418.09, stdev=6226.86
lat (usec): min=1304, max=188406, avg=11418.60, stdev=6231.38
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 81], 99.95th=[ 117],
| 99.99th=[ 188]
bw ( KiB/s): min= 2560, max=17117, per=0.20%, avg=11203.77, stdev=2244.66, samples=118
iops : min= 640, max= 4279, avg=2800.80, stdev=561.17, samples=118
lat (msec) : 2=0.01%, 4=0.27%, 10=47.63%, 20=47.75%, 50=4.01%
lat (msec) : 100=0.27%, 250=0.06%
cpu : usr=0.53%, sys=0.21%, ctx=66159, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.8%, 16=53.3%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.3%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=166353,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12149: Fri Aug 13 21:22:57 2021
read: IOPS=2905, BW=11.3MiB/s (11.9MB/s)(681MiB/60011msec)
slat (nsec): min=110, max=173162, avg=318.68, stdev=724.28
clat (usec): min=158, max=59590, avg=10838.50, stdev=3651.12
lat (usec): min=162, max=59590, avg=10838.82, stdev=3651.13
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7504], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8979], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10552],
| 70.00th=[11338], 80.00th=[12518], 90.00th=[14615], 95.00th=[17171],
| 99.00th=[25560], 99.50th=[29492], 99.90th=[40109], 99.95th=[42206],
| 99.99th=[56361]
bw ( KiB/s): min= 1988, max=15160, per=0.21%, avg=11745.22, stdev=1862.38, samples=118
iops : min= 497, max= 3790, avg=2936.17, stdev=465.62, samples=118
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=52.12%, 20=45.16%, 50=2.65%
lat (msec) : 100=0.03%
cpu : usr=0.53%, sys=0.29%, ctx=64709, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.2%, 16=52.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.3%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=174336,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12150: Fri Aug 13 21:22:57 2021
read: IOPS=2891, BW=11.3MiB/s (11.8MB/s)(678MiB/60024msec)
slat (nsec): min=110, max=1021.3k, avg=315.36, stdev=2540.37
clat (usec): min=181, max=391166, avg=11000.96, stdev=6850.94
lat (usec): min=186, max=391166, avg=11001.27, stdev=6850.97
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 19],
| 99.00th=[ 30], 99.50th=[ 36], 99.90th=[ 54], 99.95th=[ 77],
| 99.99th=[ 388]
bw ( KiB/s): min= 4608, max=16095, per=0.21%, avg=11678.75, stdev=1962.50, samples=118
iops : min= 1152, max= 4023, avg=2919.63, stdev=490.59, samples=118
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.14%, 10=54.35%, 20=41.95%, 50=3.42%
lat (msec) : 100=0.10%, 250=0.02%, 500=0.02%
cpu : usr=0.52%, sys=0.20%, ctx=60807, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.1%, 16=57.0%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=173535,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12151: Fri Aug 13 21:22:57 2021
read: IOPS=2667, BW=10.4MiB/s (10.9MB/s)(625MiB/60019msec)
slat (nsec): min=110, max=2017.1k, avg=341.14, stdev=6374.50
clat (usec): min=851, max=119809, avg=11799.96, stdev=5617.89
lat (usec): min=884, max=119810, avg=11800.30, stdev=5617.86
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 75], 99.95th=[ 92],
| 99.99th=[ 115]
bw ( KiB/s): min= 1788, max=16606, per=0.19%, avg=10793.14, stdev=2002.77, samples=118
iops : min= 447, max= 4151, avg=2698.18, stdev=500.67, samples=118
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.04%, 10=43.26%, 20=51.68%, 50=4.64%
lat (msec) : 100=0.33%, 250=0.04%
cpu : usr=0.52%, sys=0.27%, ctx=63125, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=21.0%, 16=54.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160099,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12152: Fri Aug 13 21:22:57 2021
read: IOPS=2667, BW=10.4MiB/s (10.9MB/s)(626MiB/60026msec)
slat (nsec): min=110, max=2223.1k, avg=341.27, stdev=6654.18
clat (usec): min=17, max=243665, avg=11745.14, stdev=6697.90
lat (usec): min=468, max=243666, avg=11745.48, stdev=6697.88
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 85], 99.95th=[ 102],
| 99.99th=[ 243]
bw ( KiB/s): min= 5632, max=15360, per=0.19%, avg=10855.22, stdev=2131.01, samples=117
iops : min= 1408, max= 3840, avg=2713.68, stdev=532.75, samples=117
lat (usec) : 20=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.05%, 10=47.21%, 20=47.22%, 50=5.17%
lat (msec) : 100=0.29%, 250=0.06%
cpu : usr=0.50%, sys=0.28%, ctx=65127, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.7%, 16=55.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.4%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=160134,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12153: Fri Aug 13 21:22:57 2021
read: IOPS=2778, BW=10.9MiB/s (11.4MB/s)(651MiB/60009msec)
slat (nsec): min=110, max=2360.1k, avg=341.08, stdev=6007.52
clat (usec): min=232, max=211291, avg=11328.84, stdev=5242.38
lat (usec): min=245, max=211291, avg=11329.18, stdev=5242.37
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 19],
| 99.00th=[ 29], 99.50th=[ 38], 99.90th=[ 55], 99.95th=[ 72],
| 99.99th=[ 178]
bw ( KiB/s): min= 2810, max=15536, per=0.20%, avg=11215.74, stdev=2067.77, samples=118
iops : min= 702, max= 3884, avg=2803.76, stdev=516.97, samples=118
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=48.45%, 20=47.49%, 50=3.77%
lat (msec) : 100=0.16%, 250=0.03%
cpu : usr=0.47%, sys=0.34%, ctx=64371, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=15.0%, 16=60.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.2%, 16=1.7%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=166719,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12154: Fri Aug 13 21:22:57 2021
read: IOPS=2635, BW=10.3MiB/s (10.8MB/s)(618MiB/60006msec)
slat (nsec): min=110, max=3856.8k, avg=381.88, stdev=12085.54
clat (usec): min=23, max=98976, avg=11927.21, stdev=5962.32
lat (usec): min=566, max=98977, avg=11927.60, stdev=5962.60
clat percentiles (usec):
| 1.00th=[ 6652], 5.00th=[ 7635], 10.00th=[ 8094], 20.00th=[ 8717],
| 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10421], 60.00th=[11076],
| 70.00th=[12125], 80.00th=[13698], 90.00th=[16712], 95.00th=[21103],
| 99.00th=[37487], 99.50th=[47973], 99.90th=[76022], 99.95th=[79168],
| 99.99th=[94897]
bw ( KiB/s): min= 4136, max=15207, per=0.19%, avg=10719.14, stdev=2023.62, samples=117
iops : min= 1034, max= 3801, avg=2679.66, stdev=505.89, samples=117
lat (usec) : 50=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=43.55%, 20=50.61%, 50=5.31%
lat (msec) : 100=0.43%
cpu : usr=0.48%, sys=0.30%, ctx=68643, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.1%, 16=52.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.2%, 8=0.1%, 16=0.3%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=158153,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12155: Fri Aug 13 21:22:57 2021
read: IOPS=2927, BW=11.4MiB/s (12.0MB/s)(686MiB/60036msec)
slat (nsec): min=110, max=1987.9k, avg=350.20, stdev=7061.65
clat (usec): min=1109, max=116633, avg=10711.28, stdev=4081.94
lat (usec): min=1110, max=116635, avg=10711.64, stdev=4081.94
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 25], 99.50th=[ 31], 99.90th=[ 53], 99.95th=[ 63],
| 99.99th=[ 117]
bw ( KiB/s): min= 6400, max=15616, per=0.21%, avg=11925.74, stdev=1808.01, samples=117
iops : min= 1600, max= 3904, avg=2981.32, stdev=452.02, samples=117
lat (msec) : 2=0.01%, 4=0.17%, 10=54.34%, 20=42.90%, 50=2.48%
lat (msec) : 100=0.09%, 250=0.02%
cpu : usr=0.51%, sys=0.29%, ctx=62252, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.3%, 16=51.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=175738,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12156: Fri Aug 13 21:22:57 2021
read: IOPS=2860, BW=11.2MiB/s (11.7MB/s)(671MiB/60010msec)
slat (nsec): min=110, max=1369.1k, avg=331.24, stdev=4318.21
clat (usec): min=251, max=92589, avg=11003.50, stdev=4700.75
lat (usec): min=275, max=92589, avg=11003.83, stdev=4700.88
clat percentiles (usec):
| 1.00th=[ 6521], 5.00th=[ 7373], 10.00th=[ 7832], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12649], 90.00th=[14877], 95.00th=[18220],
| 99.00th=[31065], 99.50th=[37487], 99.90th=[54789], 99.95th=[76022],
| 99.99th=[89654]
bw ( KiB/s): min= 766, max=15104, per=0.20%, avg=11543.43, stdev=2150.29, samples=118
iops : min= 191, max= 3776, avg=2885.73, stdev=537.62, samples=118
lat (usec) : 500=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=53.65%, 20=42.50%, 50=3.63%
lat (msec) : 100=0.15%
cpu : usr=0.49%, sys=0.33%, ctx=63288, majf=0, minf=28
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.2%, 16=51.8%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=171684,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12157: Fri Aug 13 21:22:57 2021
read: IOPS=2687, BW=10.5MiB/s (11.0MB/s)(630MiB/60011msec)
slat (nsec): min=110, max=1648.6k, avg=335.98, stdev=4533.65
clat (usec): min=245, max=123961, avg=11682.89, stdev=5806.16
lat (usec): min=337, max=123961, avg=11683.22, stdev=5806.20
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 46], 99.90th=[ 73], 99.95th=[ 82],
| 99.99th=[ 104]
bw ( KiB/s): min= 5848, max=15360, per=0.19%, avg=10936.82, stdev=2312.96, samples=117
iops : min= 1462, max= 3840, avg=2734.16, stdev=578.24, samples=117
lat (usec) : 250=0.01%
lat (msec) : 4=0.02%, 10=47.28%, 20=47.26%, 50=5.10%, 100=0.32%
lat (msec) : 250=0.02%
cpu : usr=0.52%, sys=0.29%, ctx=66014, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=23.0%, 16=52.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.3%, 8=0.1%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=161307,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12158: Fri Aug 13 21:22:57 2021
read: IOPS=2916, BW=11.4MiB/s (11.9MB/s)(684MiB/60027msec)
slat (nsec): min=110, max=3401.8k, avg=331.55, stdev=8201.97
clat (usec): min=127, max=150499, avg=10759.65, stdev=4211.56
lat (usec): min=361, max=150499, avg=10759.98, stdev=4211.70
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 17],
| 99.00th=[ 26], 99.50th=[ 32], 99.90th=[ 57], 99.95th=[ 64],
| 99.99th=[ 142]
bw ( KiB/s): min= 6224, max=15480, per=0.21%, avg=11893.40, stdev=1793.15, samples=117
iops : min= 1556, max= 3870, avg=2973.23, stdev=448.27, samples=117
lat (usec) : 250=0.01%
lat (msec) : 2=0.01%, 4=0.10%, 10=53.71%, 20=43.68%, 50=2.40%
lat (msec) : 100=0.09%, 250=0.02%
cpu : usr=0.46%, sys=0.35%, ctx=63769, majf=0, minf=27
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.2%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.2%, 16=1.0%, 32=2.0%, 64=0.0%, >=64=0.0%
issued rwts: total=175074,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12159: Fri Aug 13 21:22:57 2021
read: IOPS=2925, BW=11.4MiB/s (12.0MB/s)(686MiB/60023msec)
slat (nsec): min=110, max=3427.5k, avg=335.75, stdev=8277.74
clat (usec): min=975, max=65071, avg=10701.05, stdev=3720.23
lat (usec): min=976, max=65071, avg=10701.38, stdev=3720.31
clat percentiles (usec):
| 1.00th=[ 6128], 5.00th=[ 7439], 10.00th=[ 7898], 20.00th=[ 8455],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9765], 60.00th=[10421],
| 70.00th=[11207], 80.00th=[12256], 90.00th=[14091], 95.00th=[17171],
| 99.00th=[25822], 99.50th=[30016], 99.90th=[44827], 99.95th=[51119],
| 99.99th=[54264]
bw ( KiB/s): min= 6131, max=14792, per=0.21%, avg=11934.89, stdev=1804.91, samples=117
iops : min= 1532, max= 3698, avg=2983.60, stdev=451.27, samples=117
lat (usec) : 1000=0.01%
lat (msec) : 2=0.01%, 4=0.21%, 10=54.32%, 20=42.66%, 50=2.74%
lat (msec) : 100=0.07%
cpu : usr=0.48%, sys=0.33%, ctx=63184, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.0%, 16=55.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.1%, 8=0.2%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=175585,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12160: Fri Aug 13 21:22:57 2021
read: IOPS=2745, BW=10.7MiB/s (11.2MB/s)(644MiB/60011msec)
slat (nsec): min=110, max=5719.0k, avg=360.96, stdev=15576.69
clat (usec): min=165, max=164643, avg=11503.95, stdev=5698.05
lat (usec): min=208, max=164644, avg=11504.31, stdev=5698.46
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 43], 99.90th=[ 79], 99.95th=[ 104],
| 99.99th=[ 153]
bw ( KiB/s): min= 5109, max=15065, per=0.20%, avg=11112.15, stdev=1997.14, samples=118
iops : min= 1277, max= 3766, avg=2777.92, stdev=499.28, samples=118
lat (usec) : 250=0.01%, 750=0.01%
lat (msec) : 2=0.01%, 4=0.07%, 10=47.18%, 20=48.42%, 50=3.99%
lat (msec) : 100=0.28%, 250=0.06%
cpu : usr=0.45%, sys=0.33%, ctx=65304, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=13.2%, 16=61.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.4%, 8=0.1%, 16=2.0%, 32=1.5%, 64=0.0%, >=64=0.0%
issued rwts: total=164749,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12161: Fri Aug 13 21:22:57 2021
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(674MiB/60046msec)
slat (nsec): min=110, max=3324.8k, avg=347.69, stdev=8024.14
clat (usec): min=320, max=125604, avg=10924.23, stdev=4446.02
lat (usec): min=383, max=125605, avg=10924.58, stdev=4446.35
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 28], 99.50th=[ 34], 99.90th=[ 55], 99.95th=[ 65],
| 99.99th=[ 123]
bw ( KiB/s): min= 5880, max=15696, per=0.21%, avg=11740.31, stdev=1804.15, samples=117
iops : min= 1470, max= 3924, avg=2934.96, stdev=451.05, samples=117
lat (usec) : 500=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.06%, 10=52.33%, 20=44.51%, 50=2.94%
lat (msec) : 100=0.14%, 250=0.02%
cpu : usr=0.48%, sys=0.33%, ctx=60076, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.7%, 8=0.1%, 16=1.5%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=172654,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12162: Fri Aug 13 21:22:57 2021
read: IOPS=2674, BW=10.4MiB/s (11.0MB/s)(627MiB/60012msec)
slat (nsec): min=110, max=430247, avg=327.78, stdev=1454.78
clat (usec): min=573, max=128351, avg=11804.05, stdev=6169.31
lat (usec): min=737, max=128352, avg=11804.38, stdev=6169.34
clat percentiles (msec):
| 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 13], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 48], 99.90th=[ 78], 99.95th=[ 92],
| 99.99th=[ 129]
bw ( KiB/s): min= 5445, max=16902, per=0.19%, avg=10792.09, stdev=2047.28, samples=118
iops : min= 1361, max= 4225, avg=2697.91, stdev=511.78, samples=118
lat (usec) : 750=0.01%
lat (msec) : 4=1.00%, 10=45.17%, 20=48.38%, 50=5.02%, 100=0.39%
lat (msec) : 250=0.04%
cpu : usr=0.50%, sys=0.29%, ctx=63970, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.7%, 16=60.4%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=0.2%, 16=1.6%, 32=1.7%, 64=0.0%, >=64=0.0%
issued rwts: total=160480,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12163: Fri Aug 13 21:22:57 2021
read: IOPS=2761, BW=10.8MiB/s (11.3MB/s)(647MiB/60005msec)
slat (nsec): min=110, max=1111.6k, avg=325.24, stdev=2821.83
clat (usec): min=184, max=133761, avg=11377.48, stdev=4997.70
lat (usec): min=209, max=133762, avg=11377.81, stdev=4997.86
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 30], 99.50th=[ 34], 99.90th=[ 58], 99.95th=[ 80],
| 99.99th=[ 134]
bw ( KiB/s): min= 5376, max=15168, per=0.20%, avg=11264.66, stdev=2034.32, samples=117
iops : min= 1344, max= 3792, avg=2816.03, stdev=508.61, samples=117
lat (usec) : 250=0.01%, 500=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=48.38%, 20=47.11%, 50=4.31%
lat (msec) : 100=0.09%, 250=0.04%
cpu : usr=0.47%, sys=0.33%, ctx=61294, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=24.0%, 16=51.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=165685,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12164: Fri Aug 13 21:22:57 2021
read: IOPS=2840, BW=11.1MiB/s (11.6MB/s)(666MiB/60040msec)
slat (nsec): min=109, max=814151, avg=318.09, stdev=2110.00
clat (usec): min=662, max=164546, avg=11098.52, stdev=5311.15
lat (usec): min=663, max=164546, avg=11098.84, stdev=5311.17
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 35], 99.90th=[ 64], 99.95th=[ 123],
| 99.99th=[ 163]
bw ( KiB/s): min= 1485, max=15400, per=0.20%, avg=11482.20, stdev=2088.03, samples=118
iops : min= 371, max= 3850, avg=2870.48, stdev=522.01, samples=118
lat (usec) : 750=0.01%
lat (msec) : 4=0.11%, 10=51.46%, 20=45.18%, 50=3.07%, 100=0.13%
lat (msec) : 250=0.06%
cpu : usr=0.54%, sys=0.26%, ctx=63744, majf=0, minf=23
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.9%, 16=52.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=170563,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12165: Fri Aug 13 21:22:57 2021
read: IOPS=3002, BW=11.7MiB/s (12.3MB/s)(704MiB/60010msec)
slat (nsec): min=110, max=223927, avg=315.53, stdev=762.22
clat (usec): min=642, max=110145, avg=10614.21, stdev=4215.90
lat (usec): min=657, max=110146, avg=10614.53, stdev=4215.92
clat percentiles (msec):
| 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 26], 99.50th=[ 31], 99.90th=[ 44], 99.95th=[ 48],
| 99.99th=[ 111]
bw ( KiB/s): min= 7872, max=27089, per=0.21%, avg=12041.38, stdev=2355.69, samples=119
iops : min= 1968, max= 6772, avg=3010.21, stdev=588.90, samples=119
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=2.81%, 10=52.25%, 20=42.10%, 50=2.79%
lat (msec) : 100=0.02%, 250=0.02%
cpu : usr=0.51%, sys=0.24%, ctx=62606, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=19.9%, 16=55.2%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.3%, 16=0.4%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=180159,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12166: Fri Aug 13 21:22:57 2021
read: IOPS=2689, BW=10.5MiB/s (11.0MB/s)(630MiB/60007msec)
slat (nsec): min=110, max=123847, avg=323.19, stdev=860.89
clat (usec): min=624, max=125583, avg=11728.33, stdev=5623.95
lat (usec): min=630, max=125583, avg=11728.66, stdev=5623.97
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 12],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 34], 99.50th=[ 43], 99.90th=[ 81], 99.95th=[ 88],
| 99.99th=[ 107]
bw ( KiB/s): min= 4087, max=15329, per=0.19%, avg=10848.94, stdev=1995.06, samples=118
iops : min= 1021, max= 3832, avg=2712.10, stdev=498.76, samples=118
lat (usec) : 750=0.01%
lat (msec) : 2=0.01%, 4=0.08%, 10=45.00%, 20=49.64%, 50=5.00%
lat (msec) : 100=0.24%, 250=0.04%
cpu : usr=0.50%, sys=0.31%, ctx=62322, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.0%, 16=58.0%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.9%, 16=0.7%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=161373,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12167: Fri Aug 13 21:22:57 2021
read: IOPS=2925, BW=11.4MiB/s (12.0MB/s)(686MiB/60031msec)
slat (nsec): min=100, max=787619, avg=316.34, stdev=1958.15
clat (usec): min=695, max=146219, avg=10850.34, stdev=5399.65
lat (usec): min=696, max=146220, avg=10850.66, stdev=5399.66
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 15], 95.00th=[ 18],
| 99.00th=[ 30], 99.50th=[ 41], 99.90th=[ 73], 99.95th=[ 91],
| 99.99th=[ 146]
bw ( KiB/s): min= 1024, max=16351, per=0.21%, avg=11721.32, stdev=2335.69, samples=119
iops : min= 256, max= 4087, avg=2930.25, stdev=583.93, samples=119
lat (usec) : 750=0.01%
lat (msec) : 4=0.24%, 10=55.78%, 20=40.78%, 50=2.91%, 100=0.26%
lat (msec) : 250=0.04%
cpu : usr=0.51%, sys=0.23%, ctx=64204, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=12.9%, 16=62.1%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.3%, 8=0.1%, 16=1.5%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=175615,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12168: Fri Aug 13 21:22:57 2021
read: IOPS=2712, BW=10.6MiB/s (11.1MB/s)(636MiB/60016msec)
slat (nsec): min=100, max=4702.5k, avg=423.59, stdev=19670.25
clat (usec): min=1425, max=407365, avg=11505.07, stdev=7719.65
lat (usec): min=1425, max=407366, avg=11505.49, stdev=7719.74
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 16], 95.00th=[ 20],
| 99.00th=[ 32], 99.50th=[ 40], 99.90th=[ 78], 99.95th=[ 88],
| 99.99th=[ 405]
bw ( KiB/s): min= 5620, max=14336, per=0.20%, avg=11133.16, stdev=1799.66, samples=116
iops : min= 1405, max= 3584, avg=2783.17, stdev=449.89, samples=116
lat (msec) : 2=0.01%, 4=0.12%, 10=48.14%, 20=47.34%, 50=4.15%
lat (msec) : 100=0.19%, 250=0.03%, 500=0.02%
cpu : usr=0.48%, sys=0.31%, ctx=62734, majf=0, minf=26
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=20.3%, 16=54.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.8%, 8=0.7%, 16=0.2%, 32=2.3%, 64=0.0%, >=64=0.0%
issued rwts: total=162809,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12169: Fri Aug 13 21:22:57 2021
read: IOPS=2941, BW=11.5MiB/s (12.0MB/s)(690MiB/60014msec)
slat (nsec): min=110, max=100389, avg=313.41, stdev=619.45
clat (usec): min=1572, max=110632, avg=10821.75, stdev=4866.39
lat (usec): min=1573, max=110633, avg=10822.07, stdev=4866.40
clat percentiles (usec):
| 1.00th=[ 3195], 5.00th=[ 7046], 10.00th=[ 7701], 20.00th=[ 8291],
| 30.00th=[ 8717], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11076], 80.00th=[12518], 90.00th=[14877], 95.00th=[17957],
| 99.00th=[30540], 99.50th=[38011], 99.90th=[57410], 99.95th=[71828],
| 99.99th=[92799]
bw ( KiB/s): min= 4904, max=20277, per=0.21%, avg=11778.26, stdev=2210.30, samples=119
iops : min= 1226, max= 5069, avg=2944.44, stdev=552.57, samples=119
lat (msec) : 2=0.01%, 4=1.60%, 10=54.47%, 20=40.30%, 50=3.45%
lat (msec) : 100=0.17%, 250=0.01%
cpu : usr=0.44%, sys=0.37%, ctx=63279, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=22.4%, 16=52.7%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.4%, 8=0.1%, 16=0.1%, 32=2.5%, 64=0.0%, >=64=0.0%
issued rwts: total=176524,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12170: Fri Aug 13 21:22:57 2021
read: IOPS=2893, BW=11.3MiB/s (11.9MB/s)(678MiB/60014msec)
slat (nsec): min=110, max=89311, avg=324.61, stdev=607.04
clat (msec): min=2, max=100, avg=11.02, stdev= 5.19
lat (msec): min=2, max=100, avg=11.02, stdev= 5.19
clat percentiles (usec):
| 1.00th=[ 3720], 5.00th=[ 6980], 10.00th=[ 7701], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9372], 50.00th=[ 9896], 60.00th=[10421],
| 70.00th=[11338], 80.00th=[12780], 90.00th=[15139], 95.00th=[18744],
| 99.00th=[30540], 99.50th=[39060], 99.90th=[66323], 99.95th=[73925],
| 99.99th=[90702]
bw ( KiB/s): min= 5888, max=31832, per=0.20%, avg=11595.85, stdev=2829.48, samples=119
iops : min= 1472, max= 7958, avg=2898.80, stdev=707.40, samples=119
lat (msec) : 4=1.70%, 10=51.31%, 20=42.85%, 50=3.83%, 100=0.30%
lat (msec) : 250=0.01%
cpu : usr=0.47%, sys=0.35%, ctx=65853, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=14.3%, 16=60.8%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.1%, 8=0.6%, 16=1.4%, 32=1.9%, 64=0.0%, >=64=0.0%
issued rwts: total=173641,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12171: Fri Aug 13 21:22:57 2021
read: IOPS=2673, BW=10.4MiB/s (10.9MB/s)(627MiB/60035msec)
slat (nsec): min=110, max=267483, avg=334.14, stdev=1118.61
clat (usec): min=598, max=132172, avg=11722.42, stdev=6047.58
lat (usec): min=598, max=132172, avg=11722.75, stdev=6047.61
clat percentiles (msec):
| 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9],
| 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 14], 90.00th=[ 17], 95.00th=[ 21],
| 99.00th=[ 36], 99.50th=[ 48], 99.90th=[ 74], 99.95th=[ 91],
| 99.99th=[ 128]
bw ( KiB/s): min= 3832, max=15568, per=0.19%, avg=10915.12, stdev=2276.93, samples=117
iops : min= 958, max= 3892, avg=2728.71, stdev=569.24, samples=117
lat (usec) : 750=0.01%
lat (msec) : 4=0.03%, 10=45.90%, 20=48.71%, 50=4.93%, 100=0.39%
lat (msec) : 250=0.04%
cpu : usr=0.49%, sys=0.30%, ctx=66635, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=16.1%, 16=58.9%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.5%, 8=1.0%, 16=0.1%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=160507,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12172: Fri Aug 13 21:22:57 2021
read: IOPS=2945, BW=11.5MiB/s (12.1MB/s)(690MiB/60002msec)
slat (nsec): min=110, max=1014.1k, avg=319.71, stdev=2499.13
clat (usec): min=1324, max=87695, avg=10808.03, stdev=4626.80
lat (usec): min=1325, max=87695, avg=10808.35, stdev=4626.83
clat percentiles (usec):
| 1.00th=[ 3326], 5.00th=[ 7177], 10.00th=[ 7767], 20.00th=[ 8356],
| 30.00th=[ 8848], 40.00th=[ 9241], 50.00th=[ 9634], 60.00th=[10290],
| 70.00th=[11207], 80.00th=[12518], 90.00th=[14746], 95.00th=[17695],
| 99.00th=[28181], 99.50th=[35390], 99.90th=[60556], 99.95th=[74974],
| 99.99th=[83362]
bw ( KiB/s): min= 6400, max=19269, per=0.21%, avg=11783.71, stdev=2127.03, samples=119
iops : min= 1600, max= 4817, avg=2945.80, stdev=531.76, samples=119
lat (msec) : 2=0.01%, 4=1.52%, 10=54.35%, 20=40.85%, 50=3.11%
lat (msec) : 100=0.17%
cpu : usr=0.55%, sys=0.28%, ctx=63698, majf=0, minf=24
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=18.6%, 16=56.5%, 32=24.9%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=97.0%, 8=0.2%, 16=0.6%, 32=2.2%, 64=0.0%, >=64=0.0%
issued rwts: total=176757,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
random-read: (groupid=0, jobs=1): err= 0: pid=12173: Fri Aug 13 21:22:57 2021
read: IOPS=2772, BW=10.8MiB/s (11.4MB/s)(650MiB/60044msec)
slat (nsec): min=110, max=3801.3k, avg=349.77, stdev=9632.53
clat (usec): min=151, max=122304, avg=11396.34, stdev=6053.08
lat (usec): min=154, max=122304, avg=11396.69, stdev=6053.29
clat percentiles (msec):
| 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9],
| 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 11],
| 70.00th=[ 12], 80.00th=[ 13], 90.00th=[ 16], 95.00th=[ 21],
| 99.00th=[ 35], 99.50th=[ 47], 99.90th=[ 89], 99.95th=[ 96],
| 99.99th=[ 120]
bw ( KiB/s): min= 5472, max=15073, per=0.20%, avg=11214.88, stdev=2219.86, samples=118
iops : min= 1368, max= 3768, avg=2803.57, stdev=554.95, samples=118
lat (usec) : 250=0.01%, 1000=0.01%
lat (msec) : 4=0.17%, 10=51.91%, 20=42.82%, 50=4.69%, 100=0.37%
lat (msec) : 250=0.03%
cpu : usr=0.46%, sys=0.33%, ctx=59665, majf=0, minf=25
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=17.4%, 16=57.6%, 32=24.8%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=96.6%, 8=0.7%, 16=0.2%, 32=2.4%, 64=0.0%, >=64=0.0%
issued rwts: total=166494,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=5558MiB/s (5828MB/s), 9821KiB/s-12.2MiB/s (10.1MB/s-12.8MB/s), io=326GiB (350GB), run=60002-60058msec
Disk stats (read/write):
nvme0n1: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment