Skip to content

Instantly share code, notes, and snippets.

@superboum
Last active November 2, 2024 14:58
Show Gist options
  • Save superboum/aaa45d305700a7873a8ebbab1abddf2b to your computer and use it in GitHub Desktop.
Save superboum/aaa45d305700a7873a8ebbab1abddf2b to your computer and use it in GitHub Desktop.
Benchmark your disk with FIO

Install FIO on Ubuntu/Debian:

sudo apt update
sudo apt install -y fio lshw

Install FIO on Fedora:

sudo dnf install -y fio lshw

Now first get a summary of your system:

sudo lshw -short

Then run the benchmark in a folder where your target drive is mounted:

cd /opt
sudo fio --profile=tiobench

And finally post your results with some information about your system as a comment of this gist

#!/bin/bash
# Credit: https://cloud.google.com/compute/docs/disks/benchmarking-pd-performance
TEST_DIR=$1
mkdir -p $TEST_DIR
# Test write throughput by performing sequential writes with multiple parallel streams (8+), using an I/O block size of 1 MB and an I/O depth of at least 64:
fio \
--name=write_throughput \
--directory=$TEST_DIR \
--numjobs=4 \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=1M \
--iodepth=64 \
--rw=write \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test write IOPS by performing random writes, using an I/O block size of 4 KB and an I/O depth of at least 64:
fio \
--name=write_iops \
--directory=$TEST_DIR \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=4K \
--iodepth=64 \
--rw=randwrite \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test read throughput by performing sequential reads with multiple parallel streams (8+), using an I/O block size of 1 MB and an I/O depth of at least 64:
fio \
--name=read_throughput \
--directory=$TEST_DIR \
--numjobs=4 \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=1M \
--iodepth=64 \
--rw=read \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test read IOPS by performing random reads, using an I/O block size of 4 KB and an I/O depth of at least 64:
fio \
--name=read_iops \
--directory=$TEST_DIR \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=4K \
--iodepth=64 \
--rw=randread \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
@superboum
Copy link
Author

superboum commented Aug 6, 2021

HP Laptop 14-bs0xx

Hardware Info
Chemin matériel  Périphérique  Classe         Description
============================================================
                                  system         HP Laptop 14-bs0xx (2GS74EA#ABF
/0                                bus            8320
/0/0                              memory         64KiB BIOS
/0/4                              processor      Intel(R) Celeron(R) CPU  N3060 
/0/4/6                            memory         32KiB L1 cache
/0/4/7                            memory         1MiB L2 cache
/0/5                              memory         24KiB L1 cache
/0/20                             memory         4GiB Mémoire Système
/0/20/0                           memory         4GiB Project-Id-Version: @(#) $
/0/100                            bridge         Atom/Celeron/Pentium Processor 
/0/100/2                          display        Atom/Celeron/Pentium Processor 
/0/100/b                          generic        Atom/Celeron/Pentium Processor 
/0/100/14                         bus            Atom/Celeron/Pentium Processor 
/0/100/14/0       usb1            bus            xHCI Host Controller
/0/100/14/0/4                     bus            USB2.0 Hub
/0/100/14/0/4/1                   communication  Interface sans fil Bluetooth
/0/100/14/0/4/2                   multimedia     HP TrueVision HD Camera
/0/100/14/1       usb2            bus            xHCI Host Controller
/0/100/1a                         generic        Atom/Celeron/Pentium Processor 
/0/100/1b                         multimedia     Atom/Celeron/Pentium Processor 
/0/100/1c                         bridge         Atom/Celeron/Pentium Processor 
/0/100/1c/0       eno1            network        RTL8111/8168/8411 PCI Express G
/0/100/1c.3                       bridge         Atom/Celeron/Pentium Processor 
/0/100/1c.3/0     wlo1            network        Dual Band Wireless-AC 3168NGW [
/0/100/1f                         bridge         Atom/Celeron/Pentium Processor 
/0/100/1f.3                       bus            Atom/Celeron/Pentium Processor 
/0/1                              system         PnP device PNP0c02
/0/2                              generic        PnP device HPQ8001
/0/3                              generic        PnP device ETD0725
/0/6                              system         PnP device PNP0c02
/0/7                              system         PnP device PNP0c02
/0/8                              system         PnP device PNP0b00
/1                                power          JC04041
/2                                power          OEM Define 5
tiobench profile
seqwrite: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randwrite: (g=1): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
seqread: (g=2): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randread: (g=3): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
Starting 4 threads
seqwrite: Laying out IO files (4 files / total 15MiB)
Jobs: 1 (f=4): [_(3),r(1)][71.4%][r=11.0MiB/s][r=2827 IOPS][eta 00m:02s]                      
seqwrite: (groupid=0, jobs=1): err= 0: pid=18551: Fri Aug  6 18:00:25 2021
  write: IOPS=3962, BW=15.5MiB/s (16.2MB/s)(15.0MiB/969msec); 0 zone resets
    clat (usec): min=161, max=14828, avg=247.42, stdev=378.96
     lat (usec): min=161, max=14829, avg=248.00, stdev=378.97
    clat percentiles (usec):
     |  1.00th=[  167],  5.00th=[  176], 10.00th=[  182], 20.00th=[  188],
     | 30.00th=[  194], 40.00th=[  198], 50.00th=[  204], 60.00th=[  212],
     | 70.00th=[  225], 80.00th=[  243], 90.00th=[  269], 95.00th=[  359],
     | 99.00th=[ 1205], 99.50th=[ 1418], 99.90th=[ 4555], 99.95th=[13304],
     | 99.99th=[14877]
   bw (  KiB/s): min=15961, max=15961, per=100.00%, avg=15961.00, stdev= 0.00, samples=1
   iops        : min= 3990, max= 3990, avg=3990.00, stdev= 0.00, samples=1
  lat (usec)   : 250=83.44%, 500=14.40%, 750=0.55%, 1000=0.16%
  lat (msec)   : 2=1.12%, 4=0.21%, 10=0.08%, 20=0.05%
  cpu          : usr=3.41%, sys=8.88%, ctx=3865, majf=0, minf=0
  IO depths    : 1=100.1%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3840,0,4 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randwrite: (groupid=1, jobs=1): err= 0: pid=18552: Fri Aug  6 18:00:25 2021
  write: IOPS=3695, BW=14.4MiB/s (15.1MB/s)(15.0MiB/1039msec); 0 zone resets
    clat (usec): min=157, max=27422, avg=262.33, stdev=534.54
     lat (usec): min=158, max=27427, avg=262.95, stdev=534.61
    clat percentiles (usec):
     |  1.00th=[  165],  5.00th=[  174], 10.00th=[  180], 20.00th=[  190],
     | 30.00th=[  196], 40.00th=[  202], 50.00th=[  208], 60.00th=[  217],
     | 70.00th=[  229], 80.00th=[  247], 90.00th=[  293], 95.00th=[  330],
     | 99.00th=[ 1663], 99.50th=[ 2343], 99.90th=[ 5145], 99.95th=[ 7439],
     | 99.99th=[27395]
   bw (  KiB/s): min=14328, max=14328, per=96.92%, avg=14328.00, stdev= 0.00, samples=1
   iops        : min= 3582, max= 3582, avg=3582.00, stdev= 0.00, samples=1
  lat (usec)   : 250=80.91%, 500=16.90%, 750=0.34%, 1000=0.18%
  lat (msec)   : 2=0.91%, 4=0.62%, 10=0.10%, 50=0.03%
  cpu          : usr=3.85%, sys=8.19%, ctx=3855, majf=0, minf=0
  IO depths    : 1=100.1%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3840,0,4 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
seqread: (groupid=2, jobs=1): err= 0: pid=18553: Fri Aug  6 18:00:25 2021
  read: IOPS=4151, BW=16.2MiB/s (17.0MB/s)(15.0MiB/925msec)
    clat (usec): min=204, max=22773, avg=237.90, stdev=378.10
     lat (usec): min=205, max=22774, avg=238.17, stdev=378.12
    clat percentiles (usec):
     |  1.00th=[  208],  5.00th=[  208], 10.00th=[  210], 20.00th=[  215],
     | 30.00th=[  221], 40.00th=[  223], 50.00th=[  225], 60.00th=[  227],
     | 70.00th=[  227], 80.00th=[  229], 90.00th=[  233], 95.00th=[  247],
     | 99.00th=[  416], 99.50th=[  490], 99.90th=[ 2245], 99.95th=[ 4752],
     | 99.99th=[22676]
   bw (  KiB/s): min=16061, max=16061, per=96.72%, avg=16061.00, stdev= 0.00, samples=1
   iops        : min= 4015, max= 4015, avg=4015.00, stdev= 0.00, samples=1
  lat (usec)   : 250=95.13%, 500=4.40%, 750=0.16%, 1000=0.10%
  lat (msec)   : 2=0.08%, 4=0.08%, 10=0.03%, 50=0.03%
  cpu          : usr=2.81%, sys=7.14%, ctx=3845, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randread: (groupid=3, jobs=1): err= 0: pid=18554: Fri Aug  6 18:00:25 2021
  read: IOPS=3456, BW=13.5MiB/s (14.2MB/s)(15.0MiB/1111msec)
    clat (usec): min=205, max=23569, avg=281.79, stdev=387.56
     lat (usec): min=205, max=23571, avg=282.14, stdev=387.59
    clat percentiles (usec):
     |  1.00th=[  208],  5.00th=[  210], 10.00th=[  212], 20.00th=[  223],
     | 30.00th=[  229], 40.00th=[  233], 50.00th=[  297], 60.00th=[  302],
     | 70.00th=[  314], 80.00th=[  318], 90.00th=[  322], 95.00th=[  334],
     | 99.00th=[  449], 99.50th=[  515], 99.90th=[ 2376], 99.95th=[ 3097],
     | 99.99th=[23462]
   bw (  KiB/s): min=13688, max=13816, per=99.47%, avg=13752.00, stdev=90.51, samples=2
   iops        : min= 3422, max= 3454, avg=3438.00, stdev=22.63, samples=2
  lat (usec)   : 250=46.95%, 500=52.40%, 750=0.39%, 1000=0.13%
  lat (msec)   : 2=0.03%, 4=0.08%, 50=0.03%
  cpu          : usr=2.79%, sys=6.67%, ctx=3857, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=15.5MiB/s (16.2MB/s), 15.5MiB/s-15.5MiB/s (16.2MB/s-16.2MB/s), io=15.0MiB (15.7MB), run=969-969msec

Run status group 1 (all jobs):
  WRITE: bw=14.4MiB/s (15.1MB/s), 14.4MiB/s-14.4MiB/s (15.1MB/s-15.1MB/s), io=15.0MiB (15.7MB), run=1039-1039msec

Run status group 2 (all jobs):
   READ: bw=16.2MiB/s (17.0MB/s), 16.2MiB/s-16.2MiB/s (17.0MB/s-17.0MB/s), io=15.0MiB (15.7MB), run=925-925msec

Run status group 3 (all jobs):
   READ: bw=13.5MiB/s (14.2MB/s), 13.5MiB/s-13.5MiB/s (14.2MB/s-14.2MB/s), io=15.0MiB (15.7MB), run=1111-1111msec

Disk stats (read/write):
  mmcblk0: ios=7553/7690, merge=13/8, ticks=1885/1695, in_queue=132, util=82.54%
size=20 Mo, runtime=10sec, jobs=4
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [_(3),W(1)][100.0%][w=63.0MiB/s][w=63 IOPS][eta 00m:00s]     
write_throughput: (groupid=0, jobs=4): err= 0: pid=18881: Fri Aug  6 18:14:02 2021
  write: IOPS=61, BW=77.9MiB/s (81.7MB/s)(936MiB/12014msec); 0 zone resets
    slat (usec): min=168, max=1419.8k, avg=54511.13, stdev=118687.63
    clat (msec): min=260, max=5532, avg=3227.22, stdev=1015.16
     lat (msec): min=384, max=5860, avg=3279.16, stdev=1023.28
    clat percentiles (msec):
     |  1.00th=[  542],  5.00th=[ 1452], 10.00th=[ 2022], 20.00th=[ 2400],
     | 30.00th=[ 2668], 40.00th=[ 2970], 50.00th=[ 3239], 60.00th=[ 3507],
     | 70.00th=[ 3842], 80.00th=[ 4144], 90.00th=[ 4463], 95.00th=[ 4799],
     | 99.00th=[ 5269], 99.50th=[ 5537], 99.90th=[ 5537], 99.95th=[ 5537],
     | 99.99th=[ 5537]
   bw (  KiB/s): min= 9868, max=161710, per=98.33%, avg=78447.21, stdev=10540.58, samples=71
   iops        : min=    8, max=  157, avg=75.90, stdev=10.34, samples=71
  lat (msec)   : 500=1.21%, 750=0.54%, 1000=1.21%, 2000=9.01%, >=2000=113.71%
  cpu          : usr=0.32%, sys=0.61%, ctx=844, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.4%, 32=7.8%, >=64=91.8%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.6%, >=64=0.0%
     issued rwts: total=0,744,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=77.9MiB/s (81.7MB/s), 77.9MiB/s-77.9MiB/s (81.7MB/s-81.7MB/s), io=936MiB (981MB), run=12014-12014msec

Disk stats (read/write):
  mmcblk0: ios=558/2547, merge=263/6287, ticks=32119/1588451, in_queue=1614452, util=98.13%
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
write_iops: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [w(1)][100.0%][w=21.8MiB/s][w=5580 IOPS][eta 00m:00s]
write_iops: (groupid=0, jobs=1): err= 0: pid=18899: Fri Aug  6 18:14:16 2021
  write: IOPS=5173, BW=20.2MiB/s (21.2MB/s)(203MiB/10011msec); 0 zone resets
    slat (usec): min=13, max=28369, avg=40.73, stdev=183.83
    clat (usec): min=268, max=134343, avg=12319.53, stdev=8780.98
     lat (usec): min=449, max=134375, avg=12361.29, stdev=8781.30
    clat percentiles (usec):
     |  1.00th=[   816],  5.00th=[  1729], 10.00th=[  2835], 20.00th=[  4948],
     | 30.00th=[  7111], 40.00th=[  9241], 50.00th=[ 11338], 60.00th=[ 13566],
     | 70.00th=[ 15795], 80.00th=[ 18220], 90.00th=[ 21365], 95.00th=[ 24511],
     | 99.00th=[ 42730], 99.50th=[ 55837], 99.90th=[ 81265], 99.95th=[ 93848],
     | 99.99th=[115868]
   bw (  KiB/s): min=19176, max=22520, per=99.97%, avg=20710.30, stdev=1109.33, samples=20
   iops        : min= 4794, max= 5630, avg=5177.50, stdev=277.36, samples=20
  lat (usec)   : 500=0.03%, 750=0.72%, 1000=1.02%
  lat (msec)   : 2=4.42%, 4=9.23%, 10=28.23%, 20=42.64%, 50=13.13%
  lat (msec)   : 100=0.66%, 250=0.03%
  cpu          : usr=8.01%, sys=19.65%, ctx=46752, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,51787,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=20.2MiB/s (21.2MB/s), 20.2MiB/s-20.2MiB/s (21.2MB/s-21.2MB/s), io=203MiB (212MB), run=10011-10011msec

Disk stats (read/write):
  mmcblk0: ios=0/56250, merge=0/4648, ticks=0/703815, in_queue=592588, util=99.16%
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
Jobs: 4 (f=4): [R(4)][100.0%][r=150MiB/s][r=150 IOPS][eta 00m:00s]             
read_throughput: (groupid=0, jobs=4): err= 0: pid=18913: Fri Aug  6 18:14:31 2021
  read: IOPS=153, BW=178MiB/s (187MB/s)(1835MiB/10302msec)
    slat (usec): min=73, max=161074, avg=25450.76, stdev=36232.58
    clat (msec): min=179, max=2516, avg=1524.80, stdev=364.68
     lat (msec): min=248, max=2531, avg=1550.24, stdev=367.11
    clat percentiles (msec):
     |  1.00th=[  355],  5.00th=[  860], 10.00th=[ 1116], 20.00th=[ 1250],
     | 30.00th=[ 1385], 40.00th=[ 1469], 50.00th=[ 1536], 60.00th=[ 1620],
     | 70.00th=[ 1703], 80.00th=[ 1838], 90.00th=[ 1972], 95.00th=[ 2056],
     | 99.00th=[ 2232], 99.50th=[ 2299], 99.90th=[ 2467], 99.95th=[ 2534],
     | 99.99th=[ 2534]
   bw (  KiB/s): min=137146, max=180224, per=88.63%, avg=161649.25, stdev=3766.84, samples=80
   iops        : min=  133, max=  176, avg=157.45, stdev= 3.66, samples=80
  lat (msec)   : 250=0.38%, 500=1.84%, 750=2.41%, 1000=2.98%, 2000=98.67%
  lat (msec)   : >=2000=9.69%
  cpu          : usr=0.11%, sys=1.11%, ctx=1258, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.3%, >=64=0.0%
     issued rwts: total=1579,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=178MiB/s (187MB/s), 178MiB/s-178MiB/s (187MB/s-187MB/s), io=1835MiB (1924MB), run=10302-10302msec

Disk stats (read/write):
  mmcblk0: ios=5124/1, merge=78/4, ticks=1500820/94, in_queue=1490632, util=99.25%
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
read_iops: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [r(1)][100.0%][r=21.4MiB/s][r=5489 IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=18924: Fri Aug  6 18:14:45 2021
  read: IOPS=5406, BW=21.1MiB/s (22.2MB/s)(212MiB/10013msec)
    slat (usec): min=11, max=5186, avg=33.24, stdev=86.55
    clat (usec): min=270, max=109448, avg=11791.97, stdev=8112.79
     lat (usec): min=500, max=109482, avg=11826.26, stdev=8113.15
    clat percentiles (usec):
     |  1.00th=[   889],  5.00th=[  1811], 10.00th=[  2868], 20.00th=[  4948],
     | 30.00th=[  6980], 40.00th=[  8979], 50.00th=[ 10945], 60.00th=[ 13173],
     | 70.00th=[ 15270], 80.00th=[ 17433], 90.00th=[ 20055], 95.00th=[ 22152],
     | 99.00th=[ 41681], 99.50th=[ 53216], 99.90th=[ 77071], 99.95th=[ 84411],
     | 99.99th=[101188]
   bw (  KiB/s): min=20439, max=22544, per=100.00%, avg=21653.55, stdev=619.27, samples=20
   iops        : min= 5109, max= 5636, avg=5413.35, stdev=154.89, samples=20
  lat (usec)   : 500=0.01%, 750=0.56%, 1000=1.00%
  lat (msec)   : 2=4.31%, 4=9.58%, 10=29.49%, 20=45.00%, 50=9.54%
  lat (msec)   : 100=0.62%, 250=0.01%
  cpu          : usr=9.19%, sys=18.32%, ctx=42186, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=54140,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=21.1MiB/s (22.2MB/s), 21.1MiB/s-21.1MiB/s (22.2MB/s-22.2MB/s), io=212MiB (222MB), run=10013-10013msec

Disk stats (read/write):
  mmcblk0: ios=59986/28, merge=4939/23, ticks=711745/345, in_queue=591628, util=99.22%
size=100 Mo, runtime=60sec, jobs=4
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 2 (f=2): [W(1),_(2),W(1)][100.0%][w=166MiB/s][w=166 IOPS][eta 00m:00s]
write_throughput: (groupid=0, jobs=4): err= 0: pid=19023: Fri Aug  6 18:18:36 2021
  write: IOPS=54, BW=58.2MiB/s (60.0MB/s)(3536MiB/60802msec); 0 zone resets
    slat (usec): min=140, max=2140.7k, avg=72147.98, stdev=178167.58
    clat (msec): min=171, max=12484, avg=4378.15, stdev=2388.05
     lat (msec): min=301, max=12623, avg=4448.41, stdev=2408.96
    clat percentiles (msec):
     |  1.00th=[  835],  5.00th=[ 1989], 10.00th=[ 2433], 20.00th=[ 2735],
     | 30.00th=[ 2937], 40.00th=[ 3104], 50.00th=[ 3339], 60.00th=[ 3809],
     | 70.00th=[ 4799], 80.00th=[ 6409], 90.00th=[ 8221], 95.00th=[ 9597],
     | 99.00th=[11879], 99.50th=[12281], 99.90th=[12416], 99.95th=[12416],
     | 99.99th=[12550]
   bw (  KiB/s): min=12278, max=137216, per=100.00%, avg=68214.69, stdev=7623.93, samples=394
   iops        : min=   10, max=  134, avg=65.71, stdev= 7.47, samples=394
  lat (msec)   : 250=0.03%, 500=0.21%, 750=0.66%, 1000=0.75%, 2000=3.90%
  lat (msec)   : >=2000=100.45%
  cpu          : usr=0.22%, sys=0.41%, ctx=3392, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=1.6%, >=64=98.4%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,3335,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=58.2MiB/s (60.0MB/s), 58.2MiB/s-58.2MiB/s (60.0MB/s-60.0MB/s), io=3536MiB (3708MB), run=60802-60802msec

Disk stats (read/write):
  mmcblk0: ios=41/9396, merge=0/2479, ticks=3991/7744749, in_queue=7729884, util=99.35%
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
write_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [w(1)][100.0%][w=15.9MiB/s][w=4080 IOPS][eta 00m:00s]
write_iops: (groupid=0, jobs=1): err= 0: pid=19053: Fri Aug  6 18:19:40 2021
  write: IOPS=3172, BW=12.4MiB/s (12.0MB/s)(744MiB/60020msec); 0 zone resets
    slat (usec): min=13, max=109794, avg=47.40, stdev=302.48
    clat (usec): min=379, max=473596, avg=20115.54, stdev=20813.60
     lat (usec): min=476, max=473642, avg=20164.04, stdev=20821.14
    clat percentiles (usec):
     |  1.00th=[   963],  5.00th=[  2311], 10.00th=[  3884], 20.00th=[  6980],
     | 30.00th=[ 10028], 40.00th=[ 13042], 50.00th=[ 16057], 60.00th=[ 19006],
     | 70.00th=[ 22414], 80.00th=[ 26084], 90.00th=[ 34866], 95.00th=[ 58459],
     | 99.00th=[107480], 99.50th=[126354], 99.90th=[193987], 99.95th=[233833],
     | 99.99th=[354419]
   bw (  KiB/s): min= 2920, max=19280, per=99.98%, avg=12690.41, stdev=5229.37, samples=120
   iops        : min=  730, max= 4820, avg=3172.53, stdev=1307.38, samples=120
  lat (usec)   : 500=0.01%, 750=0.43%, 1000=0.66%
  lat (msec)   : 2=2.96%, 4=6.30%, 10=19.73%, 20=32.92%, 50=30.80%
  lat (msec)   : 100=4.91%, 250=1.28%, 500=0.04%
  cpu          : usr=5.36%, sys=12.60%, ctx=181457, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,190408,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=12.4MiB/s (12.0MB/s), 12.4MiB/s-12.4MiB/s (12.0MB/s-12.0MB/s), io=744MiB (780MB), run=60020-60020msec

Disk stats (read/write):
  mmcblk0: ios=45/191323, merge=0/5603, ticks=736/3818125, in_queue=3438384, util=99.84%
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 4 (f=4): [R(4)][100.0%][r=154MiB/s][r=154 IOPS][eta 00m:00s]  
read_throughput: (groupid=0, jobs=4): err= 0: pid=19176: Fri Aug  6 18:21:07 2021
  read: IOPS=156, BW=161MiB/s (168MB/s)(9682MiB/60309msec)
    slat (usec): min=77, max=533055, avg=25473.90, stdev=41138.31
    clat (msec): min=215, max=2878, avg=1591.23, stdev=394.34
     lat (msec): min=286, max=2946, avg=1616.70, stdev=396.85
    clat percentiles (msec):
     |  1.00th=[  776],  5.00th=[ 1099], 10.00th=[ 1200], 20.00th=[ 1318],
     | 30.00th=[ 1401], 40.00th=[ 1469], 50.00th=[ 1519], 60.00th=[ 1586],
     | 70.00th=[ 1670], 80.00th=[ 1787], 90.00th=[ 2265], 95.00th=[ 2500],
     | 99.00th=[ 2702], 99.50th=[ 2735], 99.90th=[ 2836], 99.95th=[ 2836],
     | 99.99th=[ 2869]
   bw (  KiB/s): min=79813, max=263950, per=97.83%, avg=160820.68, stdev=11036.60, samples=480
   iops        : min=   76, max=  256, avg=156.56, stdev=10.76, samples=480
  lat (msec)   : 250=0.02%, 500=0.38%, 750=0.51%, 1000=1.93%, 2000=87.13%
  lat (msec)   : >=2000=12.70%
  cpu          : usr=0.10%, sys=1.01%, ctx=8224, majf=0, minf=64
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=9426,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=161MiB/s (168MB/s), 161MiB/s-161MiB/s (168MB/s-168MB/s), io=9682MiB (10.2GB), run=60309-60309msec

Disk stats (read/write):
  mmcblk0: ios=28001/41, merge=983/17, ticks=7672123/3929, in_queue=7619976, util=99.96%
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
read_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [r(1)][100.0%][r=17.0MiB/s][r=4355 IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=19202: Fri Aug  6 18:22:12 2021
  read: IOPS=4499, BW=17.6MiB/s (18.4MB/s)(1055MiB/60015msec)
    slat (usec): min=11, max=14031, avg=32.01, stdev=105.65
    clat (usec): min=158, max=145097, avg=14182.98, stdev=9582.97
     lat (usec): min=505, max=145122, avg=14215.94, stdev=9582.80
    clat percentiles (usec):
     |  1.00th=[   996],  5.00th=[  2040], 10.00th=[  3326], 20.00th=[  5866],
     | 30.00th=[  8455], 40.00th=[ 10945], 50.00th=[ 13435], 60.00th=[ 16057],
     | 70.00th=[ 18482], 80.00th=[ 21365], 90.00th=[ 24249], 95.00th=[ 26608],
     | 99.00th=[ 45351], 99.50th=[ 61604], 99.90th=[ 91751], 99.95th=[104334],
     | 99.99th=[123208]
   bw (  KiB/s): min=16480, max=20712, per=99.98%, avg=17998.13, stdev=797.79, samples=120
   iops        : min= 4120, max= 5178, avg=4499.49, stdev=199.49, samples=120
  lat (usec)   : 250=0.01%, 500=0.01%, 750=0.13%, 1000=0.91%
  lat (msec)   : 2=3.79%, 4=7.86%, 10=23.55%, 20=39.10%, 50=23.85%
  lat (msec)   : 100=0.76%, 250=0.06%
  cpu          : usr=7.39%, sys=15.57%, ctx=257306, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=270031,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=17.6MiB/s (18.4MB/s), 17.6MiB/s-17.6MiB/s (18.4MB/s-18.4MB/s), io=1055MiB (1106MB), run=60015-60015msec

Disk stats (read/write):
  mmcblk0: ios=272753/46, merge=7775/46, ticks=3866656/24504, in_queue=3346848, util=99.91%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment