Skip to content

Instantly share code, notes, and snippets.

@superboum

superboum/benchmark-base.md

Last active November 2, 2024 14:58
Show Gist options
  • Save superboum/aaa45d305700a7873a8ebbab1abddf2b to your computer and use it in GitHub Desktop.
Save superboum/aaa45d305700a7873a8ebbab1abddf2b to your computer and use it in GitHub Desktop.
Download ZIP
Benchmark your disk with FIO
Raw
benchmark-base.md

Install FIO on Ubuntu/Debian:

sudo apt update
sudo apt install -y fio lshw

Install FIO on Fedora:

sudo dnf install -y fio lshw

Now first get a summary of your system:

sudo lshw -short

Then run the benchmark in a folder where your target drive is mounted:

cd /opt
sudo fio --profile=tiobench

And finally post your results with some information about your system as a comment of this gist

Raw
benchmark-custom.sh
#!/bin/bash
# Credit: https://cloud.google.com/compute/docs/disks/benchmarking-pd-performance
TEST_DIR=$1
mkdir -p $TEST_DIR
# Test write throughput by performing sequential writes with multiple parallel streams (8+), using an I/O block size of 1 MB and an I/O depth of at least 64:
fio \
--name=write_throughput \
--directory=$TEST_DIR \
--numjobs=4 \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=1M \
--iodepth=64 \
--rw=write \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test write IOPS by performing random writes, using an I/O block size of 4 KB and an I/O depth of at least 64:
fio \
--name=write_iops \
--directory=$TEST_DIR \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=4K \
--iodepth=64 \
--rw=randwrite \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test read throughput by performing sequential reads with multiple parallel streams (8+), using an I/O block size of 1 MB and an I/O depth of at least 64:
fio \
--name=read_throughput \
--directory=$TEST_DIR \
--numjobs=4 \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=1M \
--iodepth=64 \
--rw=read \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
# Test read IOPS by performing random reads, using an I/O block size of 4 KB and an I/O depth of at least 64:
fio \
--name=read_iops \
--directory=$TEST_DIR \
--size=100M \
--time_based \
--runtime=60s \
--ramp_time=2s \
--ioengine=libaio \
--direct=1 \
--verify=0 \
--bs=4K \
--iodepth=64 \
--rw=randread \
--group_reporting=1
# Clean up
rm -f $TEST_DIR/write* $TEST_DIR/read*
@superboum
Copy link
Author

superboum commented Aug 6, 2021 •
edited
Loading

Dell Inspiron 27 7775 (07E4)

Hardware Info 
H/W path                Device          Class       Description
===============================================================
                                        system      Inspiron 27 7775 (07E4)
/0                                      bus         0KFKMF
/0/0                                    memory      128KiB BIOS
/0/4                                    processor   AMD Ryzen 5 1400 Quad-Core Processor
/0/4/5                                  memory      384KiB L1 cache
/0/4/6                                  memory      2MiB L2 cache
/0/4/7                                  memory      8MiB L3 cache
/0/22                                   memory      16GiB System Memory
/0/22/0                                 memory      8GiB SODIMM DDR4 Synchronous Unbuffered (Unregistered) 2400 MHz (0,4 ns)
/0/22/1                                 memory      8GiB SODIMM DDR4 Synchronous Unbuffered (Unregistered) 2400 MHz (0,4 ns)
/0/100                                  bridge      Family 17h (Models 00h-0fh) Root Complex
/0/100/0.2                              generic     Family 17h (Models 00h-0fh) I/O Memory Management Unit
/0/100/1.3                              bridge      Family 17h (Models 00h-0fh) PCIe GPP Bridge
/0/100/1.3/0                            bus         300 Series Chipset USB 3.1 xHCI Controller
/0/100/1.3/0/0          usb1            bus         xHCI Host Controller
/0/100/1.3/0/0/5        mmc0            bus         USB2.0-CRW
/0/100/1.3/0/0/7                        input       Dell Universal Receiver
/0/100/1.3/0/0/a                        multimedia  Microsoft
/0/100/1.3/0/1          usb2            bus         xHCI Host Controller
/0/100/1.3/0.1          scsi0           storage     300 Series Chipset SATA Controller
/0/100/1.3/0.1/0.0.0    /dev/sda        disk        240GB KINGSTON SA400S3
/0/100/1.3/0.1/0.0.0/1  /dev/sda1       volume      499MiB Windows NTFS volume
/0/100/1.3/0.1/0.0.0/2  /dev/sda2       volume      185GiB Windows NTFS volume
/0/100/1.3/0.1/0.0.0/3  /dev/sda3       volume      99MiB Windows FAT volume
/0/100/1.3/0.2                          bridge      Advanced Micro Devices, Inc. [AMD]
/0/100/1.3/0.2/0                        bridge      300 Series Chipset PCIe Port
/0/100/1.3/0.2/0/0      wlp3s0          network     QCA6174 802.11ac Wireless Network Adapter
/0/100/1.3/0.2/1                        bridge      300 Series Chipset PCIe Port
/0/100/1.3/0.2/1/0      enp4s0          network     RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
/0/100/1.3/0.2/4                        bridge      300 Series Chipset PCIe Port
/0/100/1.3/0.2/4/0      /dev/nvme0      storage     CT500P1SSD8
/0/100/1.3/0.2/4/0/1    /dev/nvme0n1    disk        500GB NVMe disk
/0/100/1.3/0.2/4/0/1/1                  volume      599MiB Windows FAT volume
/0/100/1.3/0.2/4/0/1/2  /dev/nvme0n1p2  volume      1GiB EXT4 volume
/0/100/1.3/0.2/4/0/1/3  /dev/nvme0n1p3  volume      8047MiB Linux swap volume
/0/100/1.3/0.2/4/0/1/4  /dev/nvme0n1p4  volume      456GiB EFI partition
/0/100/3.1                              bridge      Family 17h (Models 00h-0fh) PCIe GPP Bridge
/0/100/3.1/0                            display     Ellesmere [Radeon RX 470/480/570/570X/580/580X/590]
/0/100/3.1/0.1                          multimedia  Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]
/0/100/7.1                              bridge      Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
/0/100/7.1/0                            generic     Zeppelin/Raven/Raven2 PCIe Dummy Function
/0/100/7.1/0.2                          generic     Family 17h (Models 00h-0fh) Platform Security Processor
/0/100/7.1/0.3                          bus         Family 17h (Models 00h-0fh) USB 3.0 Host Controller
/0/100/7.1/0.3/0        usb3            bus         xHCI Host Controller
/0/100/7.1/0.3/1        usb4            bus         xHCI Host Controller
/0/100/8.1                              bridge      Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
/0/100/8.1/0                            generic     Zeppelin/Renoir PCIe Dummy Function
/0/100/8.1/0.2                          storage     FCH SATA Controller [AHCI mode]
/0/100/8.1/0.3                          multimedia  Family 17h (Models 00h-0fh) HD Audio Controller
/0/100/14                               bus         FCH SMBus Controller
/0/100/14.3                             bridge      FCH LPC Bridge
/0/101                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/102                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/103                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/104                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/105                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/106                                  bridge      Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
/0/107                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
/0/108                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
/0/109                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
/0/10a                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
/0/10b                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
/0/10c                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
/0/10d                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6
/0/10e                                  bridge      Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
/0/1                                    system      PnP device PNP0c02
/0/2                                    system      PnP device PNP0b00
/0/3                                    system      PnP device PNP0c02
/0/5                                    system      PnP device PNP0c01
tiobench profile 
seqwrite: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randwrite: (g=1): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
seqread: (g=2): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randread: (g=3): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
Starting 4 threads
seqwrite: Laying out IO files (4 files / total 62MiB)
Jobs: 1 (f=4): [_(3),r(1)][100.0%][r=53.4MiB/s][r=13.7k IOPS][eta 00m:00s]                     
seqwrite: (groupid=0, jobs=1): err= 0: pid=328262: Fri Aug  6 17:49:10 2021
  write: IOPS=11.4k, BW=44.6MiB/s (46.7MB/s)(62.3MiB/1398msec); 0 zone resets
    clat (usec): min=28, max=87004, avg=86.49, stdev=2018.54
     lat (usec): min=28, max=87004, avg=86.66, stdev=2018.54
    clat percentiles (usec):
     |  1.00th=[   30],  5.00th=[   31], 10.00th=[   32], 20.00th=[   33],
     | 30.00th=[   34], 40.00th=[   35], 50.00th=[   37], 60.00th=[   39],
     | 70.00th=[   40], 80.00th=[   41], 90.00th=[   44], 95.00th=[   49],
     | 99.00th=[   64], 99.50th=[   73], 99.90th=[  227], 99.95th=[83362],
     | 99.99th=[86508]
   bw (  KiB/s): min=45424, max=45996, per=100.00%, avg=45710.00, stdev=404.47, samples=2
   iops        : min=11356, max=11499, avg=11427.50, stdev=101.12, samples=2
  lat (usec)   : 50=95.72%, 100=4.06%, 250=0.13%, 500=0.02%, 1000=0.01%
  lat (msec)   : 20=0.01%, 100=0.06%
  cpu          : usr=1.65%, sys=10.16%, ctx=15966, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,15956,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randwrite: (groupid=1, jobs=1): err= 0: pid=328263: Fri Aug  6 17:49:10 2021
  write: IOPS=10.3k, BW=40.3MiB/s (42.3MB/s)(62.3MiB/1545msec); 0 zone resets
    clat (usec): min=31, max=90772, avg=95.46, stdev=2091.52
     lat (usec): min=32, max=90773, avg=95.81, stdev=2091.52
    clat percentiles (usec):
     |  1.00th=[   35],  5.00th=[   36], 10.00th=[   37], 20.00th=[   39],
     | 30.00th=[   41], 40.00th=[   42], 50.00th=[   44], 60.00th=[   45],
     | 70.00th=[   47], 80.00th=[   50], 90.00th=[   53], 95.00th=[   57],
     | 99.00th=[   77], 99.50th=[   92], 99.90th=[  273], 99.95th=[86508],
     | 99.99th=[90702]
   bw (  KiB/s): min=41296, max=43586, per=100.00%, avg=42441.00, stdev=1619.27, samples=2
   iops        : min=10324, max=10896, avg=10610.00, stdev=404.47, samples=2
  lat (usec)   : 50=81.89%, 100=17.69%, 250=0.31%, 500=0.03%
  lat (msec)   : 2=0.01%, 4=0.01%, 20=0.01%, 100=0.06%
  cpu          : usr=1.30%, sys=10.36%, ctx=15963, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,15956,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
seqread: (groupid=2, jobs=1): err= 0: pid=328264: Fri Aug  6 17:49:10 2021
  read: IOPS=13.1k, BW=51.3MiB/s (53.8MB/s)(62.3MiB/1215msec)
    clat (usec): min=63, max=19292, avg=75.37, stdev=152.33
     lat (usec): min=63, max=19292, avg=75.46, stdev=152.33
    clat percentiles (usec):
     |  1.00th=[   65],  5.00th=[   66], 10.00th=[   67], 20.00th=[   71],
     | 30.00th=[   73], 40.00th=[   75], 50.00th=[   75], 60.00th=[   76],
     | 70.00th=[   76], 80.00th=[   77], 90.00th=[   79], 95.00th=[   84],
     | 99.00th=[   94], 99.50th=[  103], 99.90th=[  196], 99.95th=[  208],
     | 99.99th=[  293]
   bw (  KiB/s): min=49955, max=53752, per=98.71%, avg=51853.50, stdev=2684.88, samples=2
   iops        : min=12488, max=13438, avg=12963.00, stdev=671.75, samples=2
  lat (usec)   : 100=99.40%, 250=0.56%, 500=0.03%
  lat (msec)   : 20=0.01%
  cpu          : usr=1.89%, sys=7.66%, ctx=15968, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=15956,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randread: (groupid=3, jobs=1): err= 0: pid=328267: Fri Aug  6 17:49:10 2021
  read: IOPS=13.7k, BW=53.5MiB/s (56.1MB/s)(62.3MiB/1165msec)
    clat (usec): min=63, max=25241, avg=71.79, stdev=199.39
     lat (usec): min=63, max=25242, avg=71.89, stdev=199.39
    clat percentiles (usec):
     |  1.00th=[   64],  5.00th=[   65], 10.00th=[   65], 20.00th=[   66],
     | 30.00th=[   67], 40.00th=[   68], 50.00th=[   69], 60.00th=[   71],
     | 70.00th=[   73], 80.00th=[   75], 90.00th=[   78], 95.00th=[   84],
     | 99.00th=[   90], 99.50th=[   94], 99.90th=[  111], 99.95th=[  133],
     | 99.99th=[  314]
   bw (  KiB/s): min=53536, max=55952, per=99.93%, avg=54744.00, stdev=1708.37, samples=2
   iops        : min=13384, max=13988, avg=13686.00, stdev=427.09, samples=2
  lat (usec)   : 100=99.78%, 250=0.19%, 500=0.02%
  lat (msec)   : 50=0.01%
  cpu          : usr=2.23%, sys=10.31%, ctx=15956, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=15956,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=44.6MiB/s (46.7MB/s), 44.6MiB/s-44.6MiB/s (46.7MB/s-46.7MB/s), io=62.3MiB (65.4MB), run=1398-1398msec

Run status group 1 (all jobs):
  WRITE: bw=40.3MiB/s (42.3MB/s), 40.3MiB/s-40.3MiB/s (42.3MB/s-42.3MB/s), io=62.3MiB (65.4MB), run=1545-1545msec

Run status group 2 (all jobs):
   READ: bw=51.3MiB/s (53.8MB/s), 51.3MiB/s-51.3MiB/s (53.8MB/s-53.8MB/s), io=62.3MiB (65.4MB), run=1215-1215msec

Run status group 3 (all jobs):
   READ: bw=53.5MiB/s (56.1MB/s), 53.5MiB/s-53.5MiB/s (56.1MB/s-56.1MB/s), io=62.3MiB (65.4MB), run=1165-1165msec

Disk stats (read/write):
    dm-0: ios=29609/31943, merge=0/0, ticks=1943/2555, in_queue=4498, util=86.00%, aggrios=31912/31934, aggrmerge=0/9, aggrticks=1793/2081, aggrin_queue=3875, aggrutil=86.18%
  nvme0n1: ios=31912/31934, merge=0/9, ticks=1793/2081, in_queue=3875, util=86.18%
size=100Mo, runtime=60sec, jobs=4 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.26
Starting 4 processes
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 2 (f=2): [_(2),W(2)][100.0%][eta 00m:00s]                              
write_throughput: (groupid=0, jobs=4): err= 0: pid=332872: Fri Aug  6 18:39:18 2021
  write: IOPS=152, BW=156MiB/s (164MB/s)(11.5GiB/75613msec); 0 zone resets
    slat (usec): min=26, max=8991.0k, avg=5259.82, stdev=145178.23
    clat (msec): min=9, max=21432, avg=1655.33, stdev=3253.71
     lat (msec): min=18, max=21433, avg=1660.48, stdev=3258.53
    clat percentiles (msec):
     |  1.00th=[   55],  5.00th=[  136], 10.00th=[  182], 20.00th=[  220],
     | 30.00th=[  262], 40.00th=[  334], 50.00th=[  426], 60.00th=[  567],
     | 70.00th=[  684], 80.00th=[ 1586], 90.00th=[ 4732], 95.00th=[ 8557],
     | 99.00th=[16308], 99.50th=[16308], 99.90th=[17113], 99.95th=[17113],
     | 99.99th=[17113]
   bw (  KiB/s): min= 8192, max=1161909, per=100.00%, avg=361082.12, stdev=88278.25, samples=263
   iops        : min=    8, max= 1134, avg=352.31, stdev=86.14, samples=263
  lat (msec)   : 10=0.01%, 20=0.09%, 50=0.75%, 100=2.10%, 250=24.87%
  lat (msec)   : 500=29.42%, 750=16.70%, 1000=6.14%, 2000=2.77%, >=2000=19.35%
  cpu          : usr=0.20%, sys=0.22%, ctx=9049, majf=0, minf=233
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,11548,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=156MiB/s (164MB/s), 156MiB/s-156MiB/s (164MB/s-164MB/s), io=11.5GiB (12.4GB), run=75613-75613msec

Disk stats (read/write):
    dm-0: ios=413/12936, merge=0/0, ticks=68413/17247735, in_queue=17316148, util=98.33%, aggrios=442/95633, aggrmerge=4/605, aggrticks=71047/31853255, aggrin_queue=31926811, aggrutil=99.65%
  nvme0n1: ios=442/95633, merge=4/605, ticks=71047/31853255, in_queue=31926811, util=99.65%
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.26
Starting 1 process
write_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [w(1)][100.0%][w=133MiB/s][w=34.1k IOPS][eta 00m:00s]
write_iops: (groupid=0, jobs=1): err= 0: pid=333173: Fri Aug  6 18:40:21 2021
  write: IOPS=53.1k, BW=208MiB/s (218MB/s)(12.2GiB/60001msec); 0 zone resets
    slat (nsec): min=1512, max=1316.7k, avg=5578.37, stdev=3244.12
    clat (usec): min=35, max=232719, avg=1197.60, stdev=5609.30
     lat (usec): min=40, max=232727, avg=1203.37, stdev=5609.34
    clat percentiles (usec):
     |  1.00th=[   627],  5.00th=[   709], 10.00th=[   750], 20.00th=[   791],
     | 30.00th=[   799], 40.00th=[   807], 50.00th=[   832], 60.00th=[   889],
     | 70.00th=[  1020], 80.00th=[  1074], 90.00th=[  1106], 95.00th=[  1188],
     | 99.00th=[  1827], 99.50th=[  2540], 99.90th=[112722], 99.95th=[125305],
     | 99.99th=[162530]
   bw (  KiB/s): min=24240, max=282741, per=99.89%, avg=212332.87, stdev=98693.46, samples=119
   iops        : min= 6060, max=70685, avg=53083.10, stdev=24673.34, samples=119
  lat (usec)   : 50=0.01%, 100=0.01%, 250=0.05%, 500=0.27%, 750=9.67%
  lat (usec)   : 1000=58.23%
  lat (msec)   : 2=31.17%, 4=0.18%, 10=0.03%, 20=0.09%, 50=0.07%
  lat (msec)   : 100=0.02%, 250=0.20%
  cpu          : usr=10.87%, sys=31.32%, ctx=542712, majf=0, minf=58
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,3188634,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=208MiB/s (218MB/s), 208MiB/s-208MiB/s (218MB/s-218MB/s), io=12.2GiB (13.1GB), run=60001-60001msec

Disk stats (read/write):
    dm-0: ios=2428/3298771, merge=0/0, ticks=4833/3817700, in_queue=3822533, util=99.91%, aggrios=2368/3306336, aggrmerge=60/7747, aggrticks=4473/3660986, aggrin_queue=3665486, aggrutil=99.86%
  nvme0n1: ios=2368/3306336, merge=60/7747, ticks=4473/3660986, in_queue=3665486, util=99.86%
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.26
Starting 4 processes
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 4 (f=4): [R(4)][100.0%][r=642MiB/s][r=641 IOPS][eta 00m:00s] 
read_throughput: (groupid=0, jobs=4): err= 0: pid=333432: Fri Aug  6 18:41:24 2021
  read: IOPS=654, BW=659MiB/s (691MB/s)(38.8GiB/60276msec)
    slat (usec): min=42, max=95979, avg=5823.53, stdev=10974.81
    clat (msec): min=31, max=1185, avg=384.37, stdev=165.34
     lat (msec): min=32, max=1198, avg=390.21, stdev=167.65
    clat percentiles (msec):
     |  1.00th=[   77],  5.00th=[  140], 10.00th=[  186], 20.00th=[  247],
     | 30.00th=[  292], 40.00th=[  326], 50.00th=[  368], 60.00th=[  409],
     | 70.00th=[  451], 80.00th=[  514], 90.00th=[  609], 95.00th=[  684],
     | 99.00th=[  860], 99.50th=[  919], 99.90th=[ 1011], 99.95th=[ 1036],
     | 99.99th=[ 1167]
   bw (  KiB/s): min=192610, max=1417926, per=99.86%, avg=673434.22, stdev=61272.47, samples=480
   iops        : min=  188, max= 1384, avg=657.37, stdev=59.81, samples=480
  lat (msec)   : 50=0.09%, 100=2.15%, 250=18.79%, 500=57.50%, 750=19.45%
  lat (msec)   : 1000=2.55%, 2000=0.11%
  cpu          : usr=0.11%, sys=1.89%, ctx=22807, majf=0, minf=234
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=39439,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=659MiB/s (691MB/s), 659MiB/s-659MiB/s (691MB/s-691MB/s), io=38.8GiB (41.6GB), run=60276-60276msec

Disk stats (read/write):
    dm-0: ios=40975/772, merge=0/0, ticks=8427154/543670, in_queue=8970824, util=95.06%, aggrios=327476/455, aggrmerge=16/364, aggrticks=64334875/40915, aggrin_queue=64378762, aggrutil=99.89%
  nvme0n1: ios=327476/455, merge=16/364, ticks=64334875/40915, in_queue=64378762, util=99.89%
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.26
Starting 1 process
read_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [r(1)][100.0%][r=87.5MiB/s][r=22.4k IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=333525: Fri Aug  6 18:42:27 2021
  read: IOPS=44.8k, BW=175MiB/s (184MB/s)(10.3GiB/60003msec)
    slat (usec): min=2, max=1036, avg= 7.38, stdev= 5.98
    clat (usec): min=93, max=22977, avg=1419.26, stdev=960.10
     lat (usec): min=97, max=22980, avg=1426.86, stdev=960.88
    clat percentiles (usec):
     |  1.00th=[  192],  5.00th=[  297], 10.00th=[  408], 20.00th=[  603],
     | 30.00th=[  750], 40.00th=[  914], 50.00th=[ 1106], 60.00th=[ 1385],
     | 70.00th=[ 1860], 80.00th=[ 2278], 90.00th=[ 2999], 95.00th=[ 3294],
     | 99.00th=[ 3752], 99.50th=[ 4015], 99.90th=[ 4752], 99.95th=[ 5014],
     | 99.99th=[ 6259]
   bw (  KiB/s): min=86749, max=282888, per=100.00%, avg=179387.79, stdev=90151.74, samples=120
   iops        : min=21687, max=70722, avg=44846.83, stdev=22537.96, samples=120
  lat (usec)   : 100=0.01%, 250=3.07%, 500=11.29%, 750=15.78%, 1000=14.92%
  lat (msec)   : 2=28.38%, 4=26.07%, 10=0.50%, 20=0.01%, 50=0.01%
  cpu          : usr=9.29%, sys=28.91%, ctx=372953, majf=0, minf=58
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=2688970,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=175MiB/s (184MB/s), 175MiB/s-175MiB/s (184MB/s-184MB/s), io=10.3GiB (11.0GB), run=60003-60003msec

Disk stats (read/write):
    dm-0: ios=2828653/634, merge=0/0, ticks=3640065/810, in_queue=3640875, util=99.92%, aggrios=2828685/484, aggrmerge=0/158, aggrticks=3583571/415, aggrin_queue=3584062, aggrutil=99.89%
  nvme0n1: ios=2828685/484, merge=0/158, ticks=3583571/415, in_queue=3584062, util=99.89%

@superboum
Copy link
Author

superboum commented Aug 6, 2021 •
edited
Loading

HP Laptop 14-bs0xx

Hardware Info 
Chemin matériel  Périphérique  Classe         Description
============================================================
                                  system         HP Laptop 14-bs0xx (2GS74EA#ABF
/0                                bus            8320
/0/0                              memory         64KiB BIOS
/0/4                              processor      Intel(R) Celeron(R) CPU  N3060 
/0/4/6                            memory         32KiB L1 cache
/0/4/7                            memory         1MiB L2 cache
/0/5                              memory         24KiB L1 cache
/0/20                             memory         4GiB Mémoire Système
/0/20/0                           memory         4GiB Project-Id-Version: @(#) $
/0/100                            bridge         Atom/Celeron/Pentium Processor 
/0/100/2                          display        Atom/Celeron/Pentium Processor 
/0/100/b                          generic        Atom/Celeron/Pentium Processor 
/0/100/14                         bus            Atom/Celeron/Pentium Processor 
/0/100/14/0       usb1            bus            xHCI Host Controller
/0/100/14/0/4                     bus            USB2.0 Hub
/0/100/14/0/4/1                   communication  Interface sans fil Bluetooth
/0/100/14/0/4/2                   multimedia     HP TrueVision HD Camera
/0/100/14/1       usb2            bus            xHCI Host Controller
/0/100/1a                         generic        Atom/Celeron/Pentium Processor 
/0/100/1b                         multimedia     Atom/Celeron/Pentium Processor 
/0/100/1c                         bridge         Atom/Celeron/Pentium Processor 
/0/100/1c/0       eno1            network        RTL8111/8168/8411 PCI Express G
/0/100/1c.3                       bridge         Atom/Celeron/Pentium Processor 
/0/100/1c.3/0     wlo1            network        Dual Band Wireless-AC 3168NGW [
/0/100/1f                         bridge         Atom/Celeron/Pentium Processor 
/0/100/1f.3                       bus            Atom/Celeron/Pentium Processor 
/0/1                              system         PnP device PNP0c02
/0/2                              generic        PnP device HPQ8001
/0/3                              generic        PnP device ETD0725
/0/6                              system         PnP device PNP0c02
/0/7                              system         PnP device PNP0c02
/0/8                              system         PnP device PNP0b00
/1                                power          JC04041
/2                                power          OEM Define 5
tiobench profile 
seqwrite: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randwrite: (g=1): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
seqread: (g=2): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
randread: (g=3): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=sync, iodepth=1
Starting 4 threads
seqwrite: Laying out IO files (4 files / total 15MiB)
Jobs: 1 (f=4): [_(3),r(1)][71.4%][r=11.0MiB/s][r=2827 IOPS][eta 00m:02s]                      
seqwrite: (groupid=0, jobs=1): err= 0: pid=18551: Fri Aug  6 18:00:25 2021
  write: IOPS=3962, BW=15.5MiB/s (16.2MB/s)(15.0MiB/969msec); 0 zone resets
    clat (usec): min=161, max=14828, avg=247.42, stdev=378.96
     lat (usec): min=161, max=14829, avg=248.00, stdev=378.97
    clat percentiles (usec):
     |  1.00th=[  167],  5.00th=[  176], 10.00th=[  182], 20.00th=[  188],
     | 30.00th=[  194], 40.00th=[  198], 50.00th=[  204], 60.00th=[  212],
     | 70.00th=[  225], 80.00th=[  243], 90.00th=[  269], 95.00th=[  359],
     | 99.00th=[ 1205], 99.50th=[ 1418], 99.90th=[ 4555], 99.95th=[13304],
     | 99.99th=[14877]
   bw (  KiB/s): min=15961, max=15961, per=100.00%, avg=15961.00, stdev= 0.00, samples=1
   iops        : min= 3990, max= 3990, avg=3990.00, stdev= 0.00, samples=1
  lat (usec)   : 250=83.44%, 500=14.40%, 750=0.55%, 1000=0.16%
  lat (msec)   : 2=1.12%, 4=0.21%, 10=0.08%, 20=0.05%
  cpu          : usr=3.41%, sys=8.88%, ctx=3865, majf=0, minf=0
  IO depths    : 1=100.1%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3840,0,4 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randwrite: (groupid=1, jobs=1): err= 0: pid=18552: Fri Aug  6 18:00:25 2021
  write: IOPS=3695, BW=14.4MiB/s (15.1MB/s)(15.0MiB/1039msec); 0 zone resets
    clat (usec): min=157, max=27422, avg=262.33, stdev=534.54
     lat (usec): min=158, max=27427, avg=262.95, stdev=534.61
    clat percentiles (usec):
     |  1.00th=[  165],  5.00th=[  174], 10.00th=[  180], 20.00th=[  190],
     | 30.00th=[  196], 40.00th=[  202], 50.00th=[  208], 60.00th=[  217],
     | 70.00th=[  229], 80.00th=[  247], 90.00th=[  293], 95.00th=[  330],
     | 99.00th=[ 1663], 99.50th=[ 2343], 99.90th=[ 5145], 99.95th=[ 7439],
     | 99.99th=[27395]
   bw (  KiB/s): min=14328, max=14328, per=96.92%, avg=14328.00, stdev= 0.00, samples=1
   iops        : min= 3582, max= 3582, avg=3582.00, stdev= 0.00, samples=1
  lat (usec)   : 250=80.91%, 500=16.90%, 750=0.34%, 1000=0.18%
  lat (msec)   : 2=0.91%, 4=0.62%, 10=0.10%, 50=0.03%
  cpu          : usr=3.85%, sys=8.19%, ctx=3855, majf=0, minf=0
  IO depths    : 1=100.1%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3840,0,4 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
seqread: (groupid=2, jobs=1): err= 0: pid=18553: Fri Aug  6 18:00:25 2021
  read: IOPS=4151, BW=16.2MiB/s (17.0MB/s)(15.0MiB/925msec)
    clat (usec): min=204, max=22773, avg=237.90, stdev=378.10
     lat (usec): min=205, max=22774, avg=238.17, stdev=378.12
    clat percentiles (usec):
     |  1.00th=[  208],  5.00th=[  208], 10.00th=[  210], 20.00th=[  215],
     | 30.00th=[  221], 40.00th=[  223], 50.00th=[  225], 60.00th=[  227],
     | 70.00th=[  227], 80.00th=[  229], 90.00th=[  233], 95.00th=[  247],
     | 99.00th=[  416], 99.50th=[  490], 99.90th=[ 2245], 99.95th=[ 4752],
     | 99.99th=[22676]
   bw (  KiB/s): min=16061, max=16061, per=96.72%, avg=16061.00, stdev= 0.00, samples=1
   iops        : min= 4015, max= 4015, avg=4015.00, stdev= 0.00, samples=1
  lat (usec)   : 250=95.13%, 500=4.40%, 750=0.16%, 1000=0.10%
  lat (msec)   : 2=0.08%, 4=0.08%, 10=0.03%, 50=0.03%
  cpu          : usr=2.81%, sys=7.14%, ctx=3845, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
randread: (groupid=3, jobs=1): err= 0: pid=18554: Fri Aug  6 18:00:25 2021
  read: IOPS=3456, BW=13.5MiB/s (14.2MB/s)(15.0MiB/1111msec)
    clat (usec): min=205, max=23569, avg=281.79, stdev=387.56
     lat (usec): min=205, max=23571, avg=282.14, stdev=387.59
    clat percentiles (usec):
     |  1.00th=[  208],  5.00th=[  210], 10.00th=[  212], 20.00th=[  223],
     | 30.00th=[  229], 40.00th=[  233], 50.00th=[  297], 60.00th=[  302],
     | 70.00th=[  314], 80.00th=[  318], 90.00th=[  322], 95.00th=[  334],
     | 99.00th=[  449], 99.50th=[  515], 99.90th=[ 2376], 99.95th=[ 3097],
     | 99.99th=[23462]
   bw (  KiB/s): min=13688, max=13816, per=99.47%, avg=13752.00, stdev=90.51, samples=2
   iops        : min= 3422, max= 3454, avg=3438.00, stdev=22.63, samples=2
  lat (usec)   : 250=46.95%, 500=52.40%, 750=0.39%, 1000=0.13%
  lat (msec)   : 2=0.03%, 4=0.08%, 50=0.03%
  cpu          : usr=2.79%, sys=6.67%, ctx=3857, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3840,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=15.5MiB/s (16.2MB/s), 15.5MiB/s-15.5MiB/s (16.2MB/s-16.2MB/s), io=15.0MiB (15.7MB), run=969-969msec

Run status group 1 (all jobs):
  WRITE: bw=14.4MiB/s (15.1MB/s), 14.4MiB/s-14.4MiB/s (15.1MB/s-15.1MB/s), io=15.0MiB (15.7MB), run=1039-1039msec

Run status group 2 (all jobs):
   READ: bw=16.2MiB/s (17.0MB/s), 16.2MiB/s-16.2MiB/s (17.0MB/s-17.0MB/s), io=15.0MiB (15.7MB), run=925-925msec

Run status group 3 (all jobs):
   READ: bw=13.5MiB/s (14.2MB/s), 13.5MiB/s-13.5MiB/s (14.2MB/s-14.2MB/s), io=15.0MiB (15.7MB), run=1111-1111msec

Disk stats (read/write):
  mmcblk0: ios=7553/7690, merge=13/8, ticks=1885/1695, in_queue=132, util=82.54%
size=20 Mo, runtime=10sec, jobs=4 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
write_throughput: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [_(3),W(1)][100.0%][w=63.0MiB/s][w=63 IOPS][eta 00m:00s]     
write_throughput: (groupid=0, jobs=4): err= 0: pid=18881: Fri Aug  6 18:14:02 2021
  write: IOPS=61, BW=77.9MiB/s (81.7MB/s)(936MiB/12014msec); 0 zone resets
    slat (usec): min=168, max=1419.8k, avg=54511.13, stdev=118687.63
    clat (msec): min=260, max=5532, avg=3227.22, stdev=1015.16
     lat (msec): min=384, max=5860, avg=3279.16, stdev=1023.28
    clat percentiles (msec):
     |  1.00th=[  542],  5.00th=[ 1452], 10.00th=[ 2022], 20.00th=[ 2400],
     | 30.00th=[ 2668], 40.00th=[ 2970], 50.00th=[ 3239], 60.00th=[ 3507],
     | 70.00th=[ 3842], 80.00th=[ 4144], 90.00th=[ 4463], 95.00th=[ 4799],
     | 99.00th=[ 5269], 99.50th=[ 5537], 99.90th=[ 5537], 99.95th=[ 5537],
     | 99.99th=[ 5537]
   bw (  KiB/s): min= 9868, max=161710, per=98.33%, avg=78447.21, stdev=10540.58, samples=71
   iops        : min=    8, max=  157, avg=75.90, stdev=10.34, samples=71
  lat (msec)   : 500=1.21%, 750=0.54%, 1000=1.21%, 2000=9.01%, >=2000=113.71%
  cpu          : usr=0.32%, sys=0.61%, ctx=844, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.4%, 32=7.8%, >=64=91.8%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.6%, >=64=0.0%
     issued rwts: total=0,744,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=77.9MiB/s (81.7MB/s), 77.9MiB/s-77.9MiB/s (81.7MB/s-81.7MB/s), io=936MiB (981MB), run=12014-12014msec

Disk stats (read/write):
  mmcblk0: ios=558/2547, merge=263/6287, ticks=32119/1588451, in_queue=1614452, util=98.13%
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
write_iops: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [w(1)][100.0%][w=21.8MiB/s][w=5580 IOPS][eta 00m:00s]
write_iops: (groupid=0, jobs=1): err= 0: pid=18899: Fri Aug  6 18:14:16 2021
  write: IOPS=5173, BW=20.2MiB/s (21.2MB/s)(203MiB/10011msec); 0 zone resets
    slat (usec): min=13, max=28369, avg=40.73, stdev=183.83
    clat (usec): min=268, max=134343, avg=12319.53, stdev=8780.98
     lat (usec): min=449, max=134375, avg=12361.29, stdev=8781.30
    clat percentiles (usec):
     |  1.00th=[   816],  5.00th=[  1729], 10.00th=[  2835], 20.00th=[  4948],
     | 30.00th=[  7111], 40.00th=[  9241], 50.00th=[ 11338], 60.00th=[ 13566],
     | 70.00th=[ 15795], 80.00th=[ 18220], 90.00th=[ 21365], 95.00th=[ 24511],
     | 99.00th=[ 42730], 99.50th=[ 55837], 99.90th=[ 81265], 99.95th=[ 93848],
     | 99.99th=[115868]
   bw (  KiB/s): min=19176, max=22520, per=99.97%, avg=20710.30, stdev=1109.33, samples=20
   iops        : min= 4794, max= 5630, avg=5177.50, stdev=277.36, samples=20
  lat (usec)   : 500=0.03%, 750=0.72%, 1000=1.02%
  lat (msec)   : 2=4.42%, 4=9.23%, 10=28.23%, 20=42.64%, 50=13.13%
  lat (msec)   : 100=0.66%, 250=0.03%
  cpu          : usr=8.01%, sys=19.65%, ctx=46752, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,51787,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=20.2MiB/s (21.2MB/s), 20.2MiB/s-20.2MiB/s (21.2MB/s-21.2MB/s), io=203MiB (212MB), run=10011-10011msec

Disk stats (read/write):
  mmcblk0: ios=0/56250, merge=0/4648, ticks=0/703815, in_queue=592588, util=99.16%
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
read_throughput: Laying out IO file (1 file / 20MiB)
Jobs: 4 (f=4): [R(4)][100.0%][r=150MiB/s][r=150 IOPS][eta 00m:00s]             
read_throughput: (groupid=0, jobs=4): err= 0: pid=18913: Fri Aug  6 18:14:31 2021
  read: IOPS=153, BW=178MiB/s (187MB/s)(1835MiB/10302msec)
    slat (usec): min=73, max=161074, avg=25450.76, stdev=36232.58
    clat (msec): min=179, max=2516, avg=1524.80, stdev=364.68
     lat (msec): min=248, max=2531, avg=1550.24, stdev=367.11
    clat percentiles (msec):
     |  1.00th=[  355],  5.00th=[  860], 10.00th=[ 1116], 20.00th=[ 1250],
     | 30.00th=[ 1385], 40.00th=[ 1469], 50.00th=[ 1536], 60.00th=[ 1620],
     | 70.00th=[ 1703], 80.00th=[ 1838], 90.00th=[ 1972], 95.00th=[ 2056],
     | 99.00th=[ 2232], 99.50th=[ 2299], 99.90th=[ 2467], 99.95th=[ 2534],
     | 99.99th=[ 2534]
   bw (  KiB/s): min=137146, max=180224, per=88.63%, avg=161649.25, stdev=3766.84, samples=80
   iops        : min=  133, max=  176, avg=157.45, stdev= 3.66, samples=80
  lat (msec)   : 250=0.38%, 500=1.84%, 750=2.41%, 1000=2.98%, 2000=98.67%
  lat (msec)   : >=2000=9.69%
  cpu          : usr=0.11%, sys=1.11%, ctx=1258, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.3%, >=64=0.0%
     issued rwts: total=1579,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=178MiB/s (187MB/s), 178MiB/s-178MiB/s (187MB/s-187MB/s), io=1835MiB (1924MB), run=10302-10302msec

Disk stats (read/write):
  mmcblk0: ios=5124/1, merge=78/4, ticks=1500820/94, in_queue=1490632, util=99.25%
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
read_iops: Laying out IO file (1 file / 20MiB)
Jobs: 1 (f=1): [r(1)][100.0%][r=21.4MiB/s][r=5489 IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=18924: Fri Aug  6 18:14:45 2021
  read: IOPS=5406, BW=21.1MiB/s (22.2MB/s)(212MiB/10013msec)
    slat (usec): min=11, max=5186, avg=33.24, stdev=86.55
    clat (usec): min=270, max=109448, avg=11791.97, stdev=8112.79
     lat (usec): min=500, max=109482, avg=11826.26, stdev=8113.15
    clat percentiles (usec):
     |  1.00th=[   889],  5.00th=[  1811], 10.00th=[  2868], 20.00th=[  4948],
     | 30.00th=[  6980], 40.00th=[  8979], 50.00th=[ 10945], 60.00th=[ 13173],
     | 70.00th=[ 15270], 80.00th=[ 17433], 90.00th=[ 20055], 95.00th=[ 22152],
     | 99.00th=[ 41681], 99.50th=[ 53216], 99.90th=[ 77071], 99.95th=[ 84411],
     | 99.99th=[101188]
   bw (  KiB/s): min=20439, max=22544, per=100.00%, avg=21653.55, stdev=619.27, samples=20
   iops        : min= 5109, max= 5636, avg=5413.35, stdev=154.89, samples=20
  lat (usec)   : 500=0.01%, 750=0.56%, 1000=1.00%
  lat (msec)   : 2=4.31%, 4=9.58%, 10=29.49%, 20=45.00%, 50=9.54%
  lat (msec)   : 100=0.62%, 250=0.01%
  cpu          : usr=9.19%, sys=18.32%, ctx=42186, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=54140,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=21.1MiB/s (22.2MB/s), 21.1MiB/s-21.1MiB/s (22.2MB/s-22.2MB/s), io=212MiB (222MB), run=10013-10013msec

Disk stats (read/write):
  mmcblk0: ios=59986/28, merge=4939/23, ticks=711745/345, in_queue=591628, util=99.22%
size=100 Mo, runtime=60sec, jobs=4 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
write_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 2 (f=2): [W(1),_(2),W(1)][100.0%][w=166MiB/s][w=166 IOPS][eta 00m:00s]
write_throughput: (groupid=0, jobs=4): err= 0: pid=19023: Fri Aug  6 18:18:36 2021
  write: IOPS=54, BW=58.2MiB/s (60.0MB/s)(3536MiB/60802msec); 0 zone resets
    slat (usec): min=140, max=2140.7k, avg=72147.98, stdev=178167.58
    clat (msec): min=171, max=12484, avg=4378.15, stdev=2388.05
     lat (msec): min=301, max=12623, avg=4448.41, stdev=2408.96
    clat percentiles (msec):
     |  1.00th=[  835],  5.00th=[ 1989], 10.00th=[ 2433], 20.00th=[ 2735],
     | 30.00th=[ 2937], 40.00th=[ 3104], 50.00th=[ 3339], 60.00th=[ 3809],
     | 70.00th=[ 4799], 80.00th=[ 6409], 90.00th=[ 8221], 95.00th=[ 9597],
     | 99.00th=[11879], 99.50th=[12281], 99.90th=[12416], 99.95th=[12416],
     | 99.99th=[12550]
   bw (  KiB/s): min=12278, max=137216, per=100.00%, avg=68214.69, stdev=7623.93, samples=394
   iops        : min=   10, max=  134, avg=65.71, stdev= 7.47, samples=394
  lat (msec)   : 250=0.03%, 500=0.21%, 750=0.66%, 1000=0.75%, 2000=3.90%
  lat (msec)   : >=2000=100.45%
  cpu          : usr=0.22%, sys=0.41%, ctx=3392, majf=0, minf=60
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=1.6%, >=64=98.4%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,3335,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=58.2MiB/s (60.0MB/s), 58.2MiB/s-58.2MiB/s (60.0MB/s-60.0MB/s), io=3536MiB (3708MB), run=60802-60802msec

Disk stats (read/write):
  mmcblk0: ios=41/9396, merge=0/2479, ticks=3991/7744749, in_queue=7729884, util=99.35%
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
write_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [w(1)][100.0%][w=15.9MiB/s][w=4080 IOPS][eta 00m:00s]
write_iops: (groupid=0, jobs=1): err= 0: pid=19053: Fri Aug  6 18:19:40 2021
  write: IOPS=3172, BW=12.4MiB/s (12.0MB/s)(744MiB/60020msec); 0 zone resets
    slat (usec): min=13, max=109794, avg=47.40, stdev=302.48
    clat (usec): min=379, max=473596, avg=20115.54, stdev=20813.60
     lat (usec): min=476, max=473642, avg=20164.04, stdev=20821.14
    clat percentiles (usec):
     |  1.00th=[   963],  5.00th=[  2311], 10.00th=[  3884], 20.00th=[  6980],
     | 30.00th=[ 10028], 40.00th=[ 13042], 50.00th=[ 16057], 60.00th=[ 19006],
     | 70.00th=[ 22414], 80.00th=[ 26084], 90.00th=[ 34866], 95.00th=[ 58459],
     | 99.00th=[107480], 99.50th=[126354], 99.90th=[193987], 99.95th=[233833],
     | 99.99th=[354419]
   bw (  KiB/s): min= 2920, max=19280, per=99.98%, avg=12690.41, stdev=5229.37, samples=120
   iops        : min=  730, max= 4820, avg=3172.53, stdev=1307.38, samples=120
  lat (usec)   : 500=0.01%, 750=0.43%, 1000=0.66%
  lat (msec)   : 2=2.96%, 4=6.30%, 10=19.73%, 20=32.92%, 50=30.80%
  lat (msec)   : 100=4.91%, 250=1.28%, 500=0.04%
  cpu          : usr=5.36%, sys=12.60%, ctx=181457, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,190408,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=12.4MiB/s (12.0MB/s), 12.4MiB/s-12.4MiB/s (12.0MB/s-12.0MB/s), io=744MiB (780MB), run=60020-60020msec

Disk stats (read/write):
  mmcblk0: ios=45/191323, merge=0/5603, ticks=736/3818125, in_queue=3438384, util=99.84%
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.16
Starting 4 processes
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
read_throughput: Laying out IO file (1 file / 100MiB)
Jobs: 4 (f=4): [R(4)][100.0%][r=154MiB/s][r=154 IOPS][eta 00m:00s]  
read_throughput: (groupid=0, jobs=4): err= 0: pid=19176: Fri Aug  6 18:21:07 2021
  read: IOPS=156, BW=161MiB/s (168MB/s)(9682MiB/60309msec)
    slat (usec): min=77, max=533055, avg=25473.90, stdev=41138.31
    clat (msec): min=215, max=2878, avg=1591.23, stdev=394.34
     lat (msec): min=286, max=2946, avg=1616.70, stdev=396.85
    clat percentiles (msec):
     |  1.00th=[  776],  5.00th=[ 1099], 10.00th=[ 1200], 20.00th=[ 1318],
     | 30.00th=[ 1401], 40.00th=[ 1469], 50.00th=[ 1519], 60.00th=[ 1586],
     | 70.00th=[ 1670], 80.00th=[ 1787], 90.00th=[ 2265], 95.00th=[ 2500],
     | 99.00th=[ 2702], 99.50th=[ 2735], 99.90th=[ 2836], 99.95th=[ 2836],
     | 99.99th=[ 2869]
   bw (  KiB/s): min=79813, max=263950, per=97.83%, avg=160820.68, stdev=11036.60, samples=480
   iops        : min=   76, max=  256, avg=156.56, stdev=10.76, samples=480
  lat (msec)   : 250=0.02%, 500=0.38%, 750=0.51%, 1000=1.93%, 2000=87.13%
  lat (msec)   : >=2000=12.70%
  cpu          : usr=0.10%, sys=1.01%, ctx=8224, majf=0, minf=64
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=9426,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=161MiB/s (168MB/s), 161MiB/s-161MiB/s (168MB/s-168MB/s), io=9682MiB (10.2GB), run=60309-60309msec

Disk stats (read/write):
  mmcblk0: ios=28001/41, merge=983/17, ticks=7672123/3929, in_queue=7619976, util=99.96%
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.16
Starting 1 process
read_iops: Laying out IO file (1 file / 100MiB)
Jobs: 1 (f=1): [r(1)][100.0%][r=17.0MiB/s][r=4355 IOPS][eta 00m:00s]
read_iops: (groupid=0, jobs=1): err= 0: pid=19202: Fri Aug  6 18:22:12 2021
  read: IOPS=4499, BW=17.6MiB/s (18.4MB/s)(1055MiB/60015msec)
    slat (usec): min=11, max=14031, avg=32.01, stdev=105.65
    clat (usec): min=158, max=145097, avg=14182.98, stdev=9582.97
     lat (usec): min=505, max=145122, avg=14215.94, stdev=9582.80
    clat percentiles (usec):
     |  1.00th=[   996],  5.00th=[  2040], 10.00th=[  3326], 20.00th=[  5866],
     | 30.00th=[  8455], 40.00th=[ 10945], 50.00th=[ 13435], 60.00th=[ 16057],
     | 70.00th=[ 18482], 80.00th=[ 21365], 90.00th=[ 24249], 95.00th=[ 26608],
     | 99.00th=[ 45351], 99.50th=[ 61604], 99.90th=[ 91751], 99.95th=[104334],
     | 99.99th=[123208]
   bw (  KiB/s): min=16480, max=20712, per=99.98%, avg=17998.13, stdev=797.79, samples=120
   iops        : min= 4120, max= 5178, avg=4499.49, stdev=199.49, samples=120
  lat (usec)   : 250=0.01%, 500=0.01%, 750=0.13%, 1000=0.91%
  lat (msec)   : 2=3.79%, 4=7.86%, 10=23.55%, 20=39.10%, 50=23.85%
  lat (msec)   : 100=0.76%, 250=0.06%
  cpu          : usr=7.39%, sys=15.57%, ctx=257306, majf=0, minf=15
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=270031,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=17.6MiB/s (18.4MB/s), 17.6MiB/s-17.6MiB/s (18.4MB/s-18.4MB/s), io=1055MiB (1106MB), run=60015-60015msec

Disk stats (read/write):
  mmcblk0: ios=272753/46, merge=7775/46, ticks=3866656/24504, in_queue=3346848, util=99.91%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment