Skip to content

Instantly share code, notes, and snippets.

@networkextension
Created July 3, 2022 03:14
Show Gist options
  • Select an option

  • Save networkextension/375456478dadd708ccf4e1433721e0ea to your computer and use it in GitHub Desktop.

Select an option

Save networkextension/375456478dadd708ccf4e1433721e0ea to your computer and use it in GitHub Desktop.
linux_ssd_ben
fio --loops=5 --size=1000m --filename=/mnt/fs/fiotest.tmp --stonewall --ioengine=libaio --direct=1 --name=Seqread --bs=1m --rw=read --name=Seqwrite --bs=1m --rw=write --name=512Kread --bs=512k --rw=randread --name=512Kwrite --bs=512k --rw=randwrite --name=4kQD32read --bs=4k --iodepth=32 --rw=randread --name=4kQD32write --bs=4k --iodepth=32 --rw=randwrite^C
dev@w510:~$ fio --loops=5 --size=1000m --filename=fiotest.tmp --stonewall --ioengine=libaio --direct=1 \
> --name=Seqread --bs=1m --rw=read \
> --name=Seqwrite --bs=1m --rw=write \
> --name=512Kread --bs=512k --rw=randread \
> --name=512Kwrite --bs=512k --rw=randwrite \
> --name=4kQD32read --bs=4k --iodepth=32 --rw=randread \
> --name=4kQD32write --bs=4k --iodepth=32 --rw=randwrite
Seqread: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1
Seqwrite: (g=1): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1
512Kread: (g=2): rw=randread, bs=(R) 512KiB-512KiB, (W) 512KiB-512KiB, (T) 512KiB-512KiB, ioengine=libaio, iodepth=1
512Kwrite: (g=3): rw=randwrite, bs=(R) 512KiB-512KiB, (W) 512KiB-512KiB, (T) 512KiB-512KiB, ioengine=libaio, iodepth=1
4kQD32read: (g=4): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
4kQD32write: (g=5): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
fio-3.16
Starting 6 processes
Seqread: Laying out IO file (1 file / 1000MiB)
Jobs: 1 (f=1): [_(5),w(1)][100.0%][w=621MiB/s][w=159k IOPS][eta 00m:00s]
Seqread: (groupid=0, jobs=1): err= 0: pid=70231: Sun Jul 3 03:13:25 2022
read: IOPS=2157, BW=2157MiB/s (2262MB/s)(5000MiB/2318msec)
slat (usec): min=55, max=565, avg=123.86, stdev=17.59
clat (usec): min=302, max=3900, avg=337.90, stdev=88.88
lat (usec): min=360, max=3981, avg=462.03, stdev=93.76
clat percentiles (usec):
| 1.00th=[ 310], 5.00th=[ 314], 10.00th=[ 314], 20.00th=[ 314],
| 30.00th=[ 314], 40.00th=[ 314], 50.00th=[ 318], 60.00th=[ 322],
| 70.00th=[ 330], 80.00th=[ 351], 90.00th=[ 355], 95.00th=[ 416],
| 99.00th=[ 717], 99.50th=[ 791], 99.90th=[ 963], 99.95th=[ 971],
| 99.99th=[ 3916]
bw ( MiB/s): min= 1594, max= 2139, per=80.34%, avg=1732.96, stdev=270.88, samples=4
iops : min= 1594, max= 2139, avg=1732.75, stdev=270.84, samples=4
lat (usec) : 500=98.06%, 750=0.94%, 1000=0.96%
lat (msec) : 4=0.04%
cpu : usr=0.73%, sys=27.92%, ctx=5322, majf=0, minf=266
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=5000,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Seqwrite: (groupid=1, jobs=1): err= 0: pid=70236: Sun Jul 3 03:13:25 2022
write: IOPS=1973, BW=1973MiB/s (2069MB/s)(5000MiB/2534msec); 0 zone resets
slat (usec): min=80, max=553, avg=139.87, stdev=15.17
clat (usec): min=320, max=3646, avg=364.30, stdev=49.30
lat (usec): min=436, max=3781, avg=504.54, stdev=51.76
clat percentiles (usec):
| 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 363],
| 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363],
| 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 375],
| 99.00th=[ 416], 99.50th=[ 420], 99.90th=[ 660], 99.95th=[ 693],
| 99.99th=[ 3654]
bw ( MiB/s): min= 1742, max= 1964, per=91.19%, avg=1799.30, stdev=110.33, samples=4
iops : min= 1742, max= 1964, avg=1798.50, stdev=110.34, samples=4
lat (usec) : 500=99.86%, 750=0.10%
lat (msec) : 2=0.02%, 4=0.02%
cpu : usr=6.44%, sys=23.49%, ctx=5342, majf=0, minf=10
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,5000,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
512Kread: (groupid=2, jobs=1): err= 0: pid=70238: Sun Jul 3 03:13:25 2022
read: IOPS=2869, BW=1435MiB/s (1504MB/s)(5000MiB/3485msec)
slat (usec): min=45, max=1441, avg=75.98, stdev=15.00
clat (usec): min=254, max=564, avg=270.31, stdev=10.98
lat (usec): min=301, max=1818, avg=346.59, stdev=19.93
clat percentiles (usec):
| 1.00th=[ 260], 5.00th=[ 265], 10.00th=[ 265], 20.00th=[ 265],
| 30.00th=[ 265], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 269],
| 70.00th=[ 269], 80.00th=[ 273], 90.00th=[ 281], 95.00th=[ 285],
| 99.00th=[ 322], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 359],
| 99.99th=[ 465]
bw ( MiB/s): min= 1385, max= 1431, per=97.44%, avg=1397.95, stdev=17.16, samples=6
iops : min= 2771, max= 2862, avg=2795.67, stdev=34.12, samples=6
lat (usec) : 500=99.99%, 750=0.01%
cpu : usr=1.18%, sys=23.79%, ctx=10493, majf=0, minf=135
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=10000,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
512Kwrite: (groupid=3, jobs=1): err= 0: pid=70239: Sun Jul 3 03:13:25 2022
write: IOPS=3752, BW=1876MiB/s (1967MB/s)(5000MiB/2665msec); 0 zone resets
slat (usec): min=30, max=342, avg=68.02, stdev=14.92
clat (usec): min=156, max=1189, avg=196.12, stdev=14.38
lat (usec): min=214, max=1262, avg=264.44, stdev=22.73
clat percentiles (usec):
| 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 194],
| 30.00th=[ 196], 40.00th=[ 196], 50.00th=[ 196], 60.00th=[ 196],
| 70.00th=[ 196], 80.00th=[ 198], 90.00th=[ 200], 95.00th=[ 202],
| 99.00th=[ 245], 99.50th=[ 251], 99.90th=[ 297], 99.95th=[ 474],
| 99.99th=[ 545]
bw ( MiB/s): min= 1303, max= 1837, per=77.58%, avg=1455.56, stdev=255.43, samples=4
iops : min= 2607, max= 3675, avg=2910.75, stdev=510.72, samples=4
lat (usec) : 250=99.44%, 500=0.52%, 750=0.03%
lat (msec) : 2=0.01%
cpu : usr=4.39%, sys=25.08%, ctx=10326, majf=0, minf=8
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10000,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
4kQD32read: (groupid=4, jobs=1): err= 0: pid=70240: Sun Jul 3 03:13:25 2022
read: IOPS=177k, BW=692MiB/s (726MB/s)(5000MiB/7221msec)
slat (usec): min=2, max=195, avg= 4.12, stdev= 1.49
clat (usec): min=65, max=6320, avg=175.48, stdev=42.32
lat (usec): min=70, max=6352, avg=179.73, stdev=42.47
clat percentiles (usec):
| 1.00th=[ 118], 5.00th=[ 133], 10.00th=[ 139], 20.00th=[ 149],
| 30.00th=[ 155], 40.00th=[ 161], 50.00th=[ 169], 60.00th=[ 178],
| 70.00th=[ 186], 80.00th=[ 200], 90.00th=[ 221], 95.00th=[ 243],
| 99.00th=[ 297], 99.50th=[ 318], 99.90th=[ 379], 99.95th=[ 412],
| 99.99th=[ 947]
bw ( KiB/s): min=500418, max=698495, per=72.85%, avg=516550.29, stdev=52387.21, samples=14
iops : min=125104, max=174623, avg=129137.14, stdev=13096.71, samples=14
lat (usec) : 100=0.11%, 250=95.82%, 500=4.05%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
cpu : usr=27.35%, sys=72.55%, ctx=515, majf=0, minf=39
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=1280000,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
4kQD32write: (groupid=5, jobs=1): err= 0: pid=70243: Sun Jul 3 03:13:25 2022
write: IOPS=158k, BW=619MiB/s (649MB/s)(5000MiB/8080msec); 0 zone resets
slat (nsec): min=3200, max=224080, avg=4585.00, stdev=962.92
clat (usec): min=11, max=1289, avg=196.33, stdev=12.81
lat (usec): min=15, max=1338, avg=201.09, stdev=13.10
clat percentiles (usec):
| 1.00th=[ 192], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194],
| 30.00th=[ 196], 40.00th=[ 196], 50.00th=[ 196], 60.00th=[ 196],
| 70.00th=[ 198], 80.00th=[ 198], 90.00th=[ 198], 95.00th=[ 200],
| 99.00th=[ 212], 99.50th=[ 217], 99.90th=[ 223], 99.95th=[ 227],
| 99.99th=[ 1139]
bw ( KiB/s): min=623408, max=636208, per=100.00%, avg=633787.00, stdev=2894.20, samples=16
iops : min=155852, max=159052, avg=158446.75, stdev=723.55, samples=16
lat (usec) : 20=0.01%, 50=0.01%, 100=0.01%, 250=99.97%, 500=0.01%
lat (usec) : 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%
cpu : usr=29.63%, sys=70.31%, ctx=483, majf=0, minf=8
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued rwts: total=0,1280000,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=2157MiB/s (2262MB/s), 2157MiB/s-2157MiB/s (2262MB/s-2262MB/s), io=5000MiB (5243MB), run=2318-2318msec
Run status group 1 (all jobs):
WRITE: bw=1973MiB/s (2069MB/s), 1973MiB/s-1973MiB/s (2069MB/s-2069MB/s), io=5000MiB (5243MB), run=2534-2534msec
Run status group 2 (all jobs):
READ: bw=1435MiB/s (1504MB/s), 1435MiB/s-1435MiB/s (1504MB/s-1504MB/s), io=5000MiB (5243MB), run=3485-3485msec
Run status group 3 (all jobs):
WRITE: bw=1876MiB/s (1967MB/s), 1876MiB/s-1876MiB/s (1967MB/s-1967MB/s), io=5000MiB (5243MB), run=2665-2665msec
Run status group 4 (all jobs):
READ: bw=692MiB/s (726MB/s), 692MiB/s-692MiB/s (726MB/s-726MB/s), io=5000MiB (5243MB), run=7221-7221msec
Run status group 5 (all jobs):
WRITE: bw=619MiB/s (649MB/s), 619MiB/s-619MiB/s (649MB/s-649MB/s), io=5000MiB (5243MB), run=8080-8080msec
Disk stats (read/write):
dm-0: ios=1295003/1274862, merge=0/0, ticks=116608/14856, in_queue=131464, util=94.47%, aggrios=1310003/1310012, aggrmerge=0/4, aggrticks=120085/18465, aggrin_queue=32, aggrutil=94.24%
nvme0n1: ios=1310003/1310012, merge=0/4, ticks=120085/18465, in_queue=32, util=94.24%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment