Skip to content

Instantly share code, notes, and snippets.

@Hubro

Hubro/bench-irq-mode.txt

Created May 14, 2021 09:48
Show Gist options
  • Save Hubro/abdaa89ea2d7d32306b7e989028e83c4 to your computer and use it in GitHub Desktop.
Save Hubro/abdaa89ea2d7d32306b7e989028e83c4 to your computer and use it in GitHub Desktop.
Download ZIP
Interrupt mode vs poll mode, NVMe RAID
Raw
bench-irq-mode.txt
#############################
### 1024k sequential read ###
#############################
TEST: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
TEST: (groupid=0, jobs=1): err= 0: pid=12576: Thu May 13 21:29:25 2021
read: IOPS=8919, BW=8920MiB/s (9353MB/s)(10.0GiB/1148msec)
slat (usec): min=15, max=219, avg=37.12, stdev= 7.56
clat (usec): min=613, max=6805, avg=3498.72, stdev=645.55
lat (usec): min=632, max=6847, avg=3535.97, stdev=645.23
clat percentiles (usec):
| 1.00th=[ 1156], 5.00th=[ 2180], 10.00th=[ 3261], 20.00th=[ 3392],
| 30.00th=[ 3458], 40.00th=[ 3523], 50.00th=[ 3556], 60.00th=[ 3589],
| 70.00th=[ 3589], 80.00th=[ 3621], 90.00th=[ 3785], 95.00th=[ 4080],
| 99.00th=[ 5866], 99.50th=[ 6194], 99.90th=[ 6456], 99.95th=[ 6456],
| 99.99th=[ 6718]
bw ( MiB/s): min= 8900, max= 8938, per=99.99%, avg=8919.00, stdev=26.87, samples=2
iops : min= 8900, max= 8938, avg=8919.00, stdev=26.87, samples=2
lat (usec) : 750=0.06%, 1000=0.04%
lat (msec) : 2=4.41%, 4=89.78%, 10=5.71%
cpu : usr=1.13%, sys=33.39%, ctx=7610, majf=0, minf=8201
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=10240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=8920MiB/s (9353MB/s), 8920MiB/s-8920MiB/s (9353MB/s-9353MB/s), io=10.0GiB (10.7GB), run=1148-1148msec
Disk stats (read/write):
dm-4: ios=8145/0, merge=0/0, ticks=27617/0, in_queue=27618, util=90.40%, aggrios=81920/0, aggrmerge=0/0, aggrticks=205082/0, aggrin_queue=205083, aggrutil=87.56%
md0: ios=81920/0, merge=0/0, ticks=205082/0, in_queue=205083, util=87.56%, aggrios=27306/0, aggrmerge=0/0, aggrticks=65180/0, aggrin_queue=65180, aggrutil=87.56%
nvme1n1: ios=27320/0, merge=0/0, ticks=85054/0, in_queue=85054, util=87.48%
nvme0n1: ios=27321/0, merge=0/0, ticks=25530/0, in_queue=25530, util=87.25%
nvme2n1: ios=27279/0, merge=0/0, ticks=84958/0, in_queue=84958, util=87.56%
##############################
### 1024k sequential write ###
##############################
TEST: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=12612: Thu May 13 21:29:27 2021
write: IOPS=7116, BW=7116MiB/s (7462MB/s)(10.0GiB/1439msec); 0 zone resets
slat (usec): min=22, max=7324, avg=35.03, stdev=72.15
clat (usec): min=1023, max=29380, avg=4394.20, stdev=2734.21
lat (usec): min=1054, max=29417, avg=4429.34, stdev=2738.10
clat percentiles (usec):
| 1.00th=[ 1090], 5.00th=[ 2409], 10.00th=[ 3458], 20.00th=[ 3490],
| 30.00th=[ 3523], 40.00th=[ 3556], 50.00th=[ 3589], 60.00th=[ 3621],
| 70.00th=[ 3884], 80.00th=[ 4228], 90.00th=[ 6849], 95.00th=[ 8455],
| 99.00th=[20055], 99.50th=[22676], 99.90th=[24511], 99.95th=[26346],
| 99.99th=[29230]
bw ( MiB/s): min= 8202, max= 8414, per=100.00%, avg=8308.00, stdev=149.91, samples=2
iops : min= 8202, max= 8414, avg=8308.00, stdev=149.91, samples=2
lat (msec) : 2=4.13%, 4=68.33%, 10=24.26%, 20=2.28%, 50=1.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=150, max=150, avg=150.00, stdev= 0.00
sync percentiles (nsec):
| 1.00th=[ 151], 5.00th=[ 151], 10.00th=[ 151], 20.00th=[ 151],
| 30.00th=[ 151], 40.00th=[ 151], 50.00th=[ 151], 60.00th=[ 151],
| 70.00th=[ 151], 80.00th=[ 151], 90.00th=[ 151], 95.00th=[ 151],
| 99.00th=[ 151], 99.50th=[ 151], 99.90th=[ 151], 99.95th=[ 151],
| 99.99th=[ 151]
cpu : usr=8.55%, sys=20.24%, ctx=9992, majf=0, minf=12
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10240,0,1 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=7116MiB/s (7462MB/s), 7116MiB/s-7116MiB/s (7462MB/s-7462MB/s), io=10.0GiB (10.7GB), run=1439-1439msec
Disk stats (read/write):
dm-4: ios=0/10128, merge=0/0, ticks=0/41953, in_queue=41953, util=92.79%, aggrios=0/81957, aggrmerge=0/0, aggrticks=0/213097, aggrin_queue=213097, aggrutil=87.35%
md0: ios=0/81957, merge=0/0, ticks=0/213097, in_queue=213097, util=87.35%, aggrios=0/27317, aggrmerge=0/5, aggrticks=0/64928, aggrin_queue=64961, aggrutil=87.35%
nvme1n1: ios=0/27330, merge=0/0, ticks=0/51242, in_queue=51245, util=83.35%
nvme0n1: ios=0/27334, merge=0/7, ticks=0/55125, in_queue=55129, util=83.35%
nvme2n1: ios=0/27289, merge=0/9, ticks=0/88418, in_queue=88510, util=87.35%
######################
### 4k random read ###
######################
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=12648: Thu May 13 21:30:27 2021
read: IOPS=12.7k, BW=49.7MiB/s (52.1MB/s)(2981MiB/60001msec)
slat (nsec): min=1590, max=27979, avg=3339.85, stdev=966.41
clat (usec): min=6, max=22395, avg=74.66, stdev=55.96
lat (usec): min=9, max=22397, avg=78.09, stdev=55.98
clat percentiles (usec):
| 1.00th=[ 37], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 65],
| 30.00th=[ 66], 40.00th=[ 67], 50.00th=[ 68], 60.00th=[ 69],
| 70.00th=[ 85], 80.00th=[ 88], 90.00th=[ 100], 95.00th=[ 103],
| 99.00th=[ 105], 99.50th=[ 106], 99.90th=[ 167], 99.95th=[ 371],
| 99.99th=[ 1860]
bw ( KiB/s): min=22592, max=53344, per=100.00%, avg=50900.03, stdev=2862.64, samples=119
iops : min= 5648, max=13336, avg=12725.01, stdev=715.66, samples=119
lat (usec) : 10=0.01%, 20=0.02%, 50=1.16%, 100=88.76%, 250=9.99%
lat (usec) : 500=0.05%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
cpu : usr=2.23%, sys=7.78%, ctx=763028, majf=0, minf=13
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=763025,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=49.7MiB/s (52.1MB/s), 49.7MiB/s-49.7MiB/s (52.1MB/s-52.1MB/s), io=2981MiB (3125MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=762015/742, merge=0/0, ticks=54484/157, in_queue=54642, util=99.89%, aggrios=763521/1294, aggrmerge=0/0, aggrticks=54305/174, aggrin_queue=54478, aggrutil=99.81%
md0: ios=763521/1294, merge=0/0, ticks=54305/174, in_queue=54478, util=99.81%, aggrios=254522/339, aggrmerge=82/145, aggrticks=18480/87, aggrin_queue=18615, aggrutil=99.81%
nvme1n1: ios=254644/354, merge=87/151, ticks=16448/54, in_queue=16523, util=99.55%
nvme0n1: ios=254543/326, merge=76/151, ticks=16101/47, in_queue=16168, util=99.59%
nvme2n1: ios=254381/339, merge=85/133, ticks=22892/162, in_queue=23154, util=99.81%
#######################
### 4k random write ###
#######################
TEST: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=12711: Thu May 13 21:31:27 2021
read: IOPS=309, BW=1238KiB/s (1268kB/s)(72.6MiB/60002msec)
slat (nsec): min=1880, max=21000, avg=4282.26, stdev=1664.80
clat (usec): min=55, max=7708, avg=79.72, stdev=108.09
lat (usec): min=62, max=7719, avg=84.09, stdev=108.22
clat percentiles (usec):
| 1.00th=[ 61], 5.00th=[ 62], 10.00th=[ 63], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 69],
| 70.00th=[ 85], 80.00th=[ 88], 90.00th=[ 102], 95.00th=[ 105],
| 99.00th=[ 143], 99.50th=[ 359], 99.90th=[ 537], 99.95th=[ 627],
| 99.99th=[ 6915]
bw ( KiB/s): min= 368, max= 1576, per=99.98%, avg=1238.52, stdev=168.46, samples=119
iops : min= 92, max= 394, avg=309.63, stdev=42.11, samples=119
write: IOPS=309, BW=1239KiB/s (1269kB/s)(72.6MiB/60002msec); 0 zone resets
slat (nsec): min=1940, max=24750, avg=4757.99, stdev=1770.41
clat (usec): min=8, max=1840, avg=20.32, stdev=31.93
lat (usec): min=10, max=1843, avg=25.17, stdev=32.12
clat percentiles (usec):
| 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14],
| 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 17],
| 70.00th=[ 18], 80.00th=[ 20], 90.00th=[ 24], 95.00th=[ 36],
| 99.00th=[ 46], 99.50th=[ 289], 99.90th=[ 429], 99.95th=[ 465],
| 99.99th=[ 594]
bw ( KiB/s): min= 368, max= 1408, per=100.00%, avg=1239.46, stdev=143.35, samples=119
iops : min= 92, max= 352, avg=309.87, stdev=35.84, samples=119
lat (usec) : 10=0.11%, 20=41.95%, 50=7.47%, 100=43.21%, 250=6.50%
lat (usec) : 500=0.68%, 750=0.06%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=1, max=420, avg=50.72, stdev=22.96
sync percentiles (nsec):
| 1.00th=[ 20], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 40],
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 50], 60.00th=[ 50],
| 70.00th=[ 50], 80.00th=[ 60], 90.00th=[ 70], 95.00th=[ 80],
| 99.00th=[ 151], 99.50th=[ 211], 99.90th=[ 231], 99.95th=[ 282],
| 99.99th=[ 302]
cpu : usr=0.18%, sys=0.78%, ctx=90157, majf=0, minf=16
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=18574,18583,0,37154 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=1238KiB/s (1268kB/s), 1238KiB/s-1238KiB/s (1268kB/s-1268kB/s), io=72.6MiB (76.1MB), run=60002-60002msec
WRITE: bw=1239KiB/s (1269kB/s), 1239KiB/s-1239KiB/s (1269kB/s-1269kB/s), io=72.6MiB (76.1MB), run=60002-60002msec
Disk stats (read/write):
dm-4: ios=18538/118944, merge=0/0, ticks=1687/57478, in_queue=59164, util=99.87%, aggrios=18575/119308, aggrmerge=0/0, aggrticks=1680/57657, aggrin_queue=59337, aggrutil=99.71%
md0: ios=18575/119308, merge=0/0, ticks=1680/57657, in_queue=59337, util=99.71%, aggrios=6191/57712, aggrmerge=0/6844, aggrticks=484/22976, aggrin_queue=38838, aggrutil=98.77%
nvme1n1: ios=6192/57610, merge=0/6923, ticks=409/11509, in_queue=20105, util=87.67%
nvme0n1: ios=6217/57808, merge=0/6742, ticks=437/12422, in_queue=21754, util=88.30%
nvme2n1: ios=6166/57720, merge=0/6869, ticks=608/44997, in_queue=74657, util=98.77%
Raw
bench-poll-mode-16-queues.txt
#############################
### 1024k sequential read ###
#############################
TEST: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
TEST: (groupid=0, jobs=1): err= 0: pid=4145: Fri May 14 11:15:16 2021
read: IOPS=7834, BW=7835MiB/s (8215MB/s)(10.0GiB/1307msec)
slat (usec): min=14, max=185, avg=32.61, stdev= 7.81
clat (usec): min=749, max=140161, avg=4006.24, stdev=6563.38
lat (usec): min=768, max=140266, avg=4038.99, stdev=6567.90
clat percentiles (usec):
| 1.00th=[ 1037], 5.00th=[ 2507], 10.00th=[ 2966], 20.00th=[ 3261],
| 30.00th=[ 3359], 40.00th=[ 3458], 50.00th=[ 3556], 60.00th=[ 3621],
| 70.00th=[ 3818], 80.00th=[ 3949], 90.00th=[ 4228], 95.00th=[ 4686],
| 99.00th=[ 6456], 99.50th=[ 18744], 99.90th=[128451], 99.95th=[135267],
| 99.99th=[139461]
bw ( MiB/s): min= 6182, max= 8856, per=95.97%, avg=7519.00, stdev=1890.80, samples=2
iops : min= 6182, max= 8856, avg=7519.00, stdev=1890.80, samples=2
lat (usec) : 750=0.01%, 1000=0.39%
lat (msec) : 2=2.88%, 4=78.23%, 10=17.92%, 20=0.07%, 50=0.10%
lat (msec) : 100=0.18%, 250=0.22%
cpu : usr=1.38%, sys=28.64%, ctx=8247, majf=0, minf=8203
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=10240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=7835MiB/s (8215MB/s), 7835MiB/s-7835MiB/s (8215MB/s-8215MB/s), io=10.0GiB (10.7GB), run=1307-1307msec
Disk stats (read/write):
dm-4: ios=9940/187, merge=0/0, ticks=37753/390, in_queue=38143, util=91.04%, aggrios=86732/1389, aggrmerge=0/0, aggrticks=209767/390, aggrin_queue=210157, aggrutil=90.21%
md0: ios=86732/1389, merge=0/0, ticks=209767/390, in_queue=210157, util=90.21%, aggrios=27426/266, aggrmerge=1484/212, aggrticks=62304/139, aggrin_queue=62520, aggrutil=90.47%
nvme1n1: ios=27518/276, merge=1730/225, ticks=72720/63, in_queue=72823, util=86.23%
nvme0n1: ios=27381/262, merge=1272/216, ticks=20658/24, in_queue=20692, util=86.43%
nvme2n1: ios=27381/260, merge=1450/197, ticks=93536/331, in_queue=94046, util=90.47%
##############################
### 1024k sequential write ###
##############################
TEST: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4180: Fri May 14 11:15:18 2021
write: IOPS=7944, BW=7944MiB/s (8330MB/s)(10.0GiB/1289msec); 0 zone resets
slat (usec): min=17, max=1263, avg=29.39, stdev=13.10
clat (usec): min=887, max=19424, avg=3938.04, stdev=1547.23
lat (usec): min=912, max=19467, avg=3967.53, stdev=1547.64
clat percentiles (usec):
| 1.00th=[ 947], 5.00th=[ 2343], 10.00th=[ 3392], 20.00th=[ 3490],
| 30.00th=[ 3523], 40.00th=[ 3556], 50.00th=[ 3589], 60.00th=[ 3589],
| 70.00th=[ 3621], 80.00th=[ 3851], 90.00th=[ 5997], 95.00th=[ 6980],
| 99.00th=[ 9896], 99.50th=[12780], 99.90th=[17171], 99.95th=[18220],
| 99.99th=[19006]
bw ( MiB/s): min= 8348, max= 8376, per=100.00%, avg=8362.00, stdev=19.80, samples=2
iops : min= 8348, max= 8376, avg=8362.00, stdev=19.80, samples=2
lat (usec) : 1000=1.67%
lat (msec) : 2=2.53%, 4=76.96%, 10=17.85%, 20=0.99%
fsync/fdatasync/sync_file_range:
sync (nsec): min=170, max=170, avg=170.00, stdev= 0.00
sync percentiles (nsec):
| 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171],
| 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 171],
| 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 171], 95.00th=[ 171],
| 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171],
| 99.99th=[ 171]
cpu : usr=9.78%, sys=15.68%, ctx=10029, majf=0, minf=12
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10240,0,1 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=7944MiB/s (8330MB/s), 7944MiB/s-7944MiB/s (8330MB/s-8330MB/s), io=10.0GiB (10.7GB), run=1289-1289msec
Disk stats (read/write):
dm-4: ios=4467/9577, merge=0/0, ticks=6766/34617, in_queue=41382, util=95.11%, aggrios=4499/81974, aggrmerge=0/0, aggrticks=6866/204513, aggrin_queue=211380, aggrutil=90.27%
md0: ios=4499/81974, merge=0/0, ticks=6866/204513, in_queue=211380, util=90.27%, aggrios=108/27314, aggrmerge=1391/13, aggrticks=148/63690, aggrin_queue=63848, aggrutil=90.07%
nvme1n1: ios=95/27389, merge=1229/11, ticks=109/70342, in_queue=70463, util=90.07%
nvme0n1: ios=113/27288, merge=1383/23, ticks=180/64081, in_queue=64267, util=88.92%
nvme2n1: ios=118/27266, merge=1563/5, ticks=156/56647, in_queue=56815, util=88.51%
######################
### 4k random read ###
######################
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4216: Fri May 14 11:16:18 2021
read: IOPS=14.5k, BW=56.7MiB/s (59.5MB/s)(3405MiB/60001msec)
slat (nsec): min=1470, max=19600, avg=2613.32, stdev=514.97
clat (usec): min=7, max=14167, avg=65.76, stdev=41.87
lat (usec): min=10, max=14170, avg=68.44, stdev=41.88
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 66], 60.00th=[ 67],
| 70.00th=[ 67], 80.00th=[ 68], 90.00th=[ 68], 95.00th=[ 69],
| 99.00th=[ 70], 99.50th=[ 71], 99.90th=[ 130], 99.95th=[ 334],
| 99.99th=[ 523]
bw ( KiB/s): min=19864, max=59592, per=100.00%, avg=58112.61, stdev=3564.31, samples=119
iops : min= 4966, max=14898, avg=14528.17, stdev=891.08, samples=119
lat (usec) : 10=0.01%, 20=0.02%, 50=0.01%, 100=99.85%, 250=0.06%
lat (usec) : 500=0.05%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
cpu : usr=1.87%, sys=7.33%, ctx=871581, majf=0, minf=13
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=871553,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=56.7MiB/s (59.5MB/s), 56.7MiB/s-56.7MiB/s (59.5MB/s-59.5MB/s), io=3405MiB (3570MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=870066/1080, merge=0/0, ticks=54521/37, in_queue=54558, util=99.87%, aggrios=871560/1309, aggrmerge=0/0, aggrticks=54298/40, aggrin_queue=54338, aggrutil=99.73%
md0: ios=871560/1309, merge=0/0, ticks=54298/40, in_queue=54338, util=99.73%, aggrios=290520/305, aggrmerge=0/173, aggrticks=18564/35, aggrin_queue=18617, aggrutil=99.73%
nvme1n1: ios=291434/312, merge=0/188, ticks=18958/35, in_queue=19010, util=99.73%
nvme0n1: ios=290140/280, merge=0/164, ticks=18192/34, in_queue=18245, util=99.51%
nvme2n1: ios=289986/325, merge=0/167, ticks=18543/36, in_queue=18596, util=99.51%
#######################
### 4k random write ###
#######################
TEST: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4602: Fri May 14 11:17:18 2021
read: IOPS=858, BW=3434KiB/s (3517kB/s)(201MiB/60001msec)
slat (nsec): min=1830, max=24340, avg=3473.63, stdev=1233.51
clat (usec): min=56, max=7628, avg=67.85, stdev=84.37
lat (usec): min=61, max=7635, avg=71.39, stdev=84.48
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 65],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 67],
| 70.00th=[ 68], 80.00th=[ 68], 90.00th=[ 69], 95.00th=[ 69],
| 99.00th=[ 81], 99.50th=[ 97], 99.90th=[ 416], 99.95th=[ 586],
| 99.99th=[ 4883]
bw ( KiB/s): min= 256, max= 4200, per=99.99%, avg=3434.02, stdev=855.22, samples=119
iops : min= 64, max= 1050, avg=858.50, stdev=213.81, samples=119
write: IOPS=855, BW=3422KiB/s (3505kB/s)(201MiB/60001msec); 0 zone resets
slat (nsec): min=2030, max=28040, avg=3679.50, stdev=1325.21
clat (usec): min=7, max=11801, avg=16.90, stdev=54.78
lat (usec): min=10, max=11805, avg=20.65, stdev=54.85
clat percentiles (usec):
| 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 15],
| 30.00th=[ 16], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 18],
| 70.00th=[ 18], 80.00th=[ 19], 90.00th=[ 19], 95.00th=[ 19],
| 99.00th=[ 23], 99.50th=[ 37], 99.90th=[ 137], 99.95th=[ 281],
| 99.99th=[ 433]
bw ( KiB/s): min= 320, max= 3880, per=99.93%, avg=3420.44, stdev=834.90, samples=119
iops : min= 80, max= 970, avg=855.11, stdev=208.72, samples=119
lat (usec) : 10=0.14%, 20=48.96%, 50=0.70%, 100=49.90%, 250=0.20%
lat (usec) : 500=0.07%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=0, max=9220, avg=44.39, stdev=53.14
sync percentiles (nsec):
| 1.00th=[ 20], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 30],
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 40],
| 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 80],
| 99.00th=[ 141], 99.50th=[ 171], 99.90th=[ 231], 99.95th=[ 231],
| 99.99th=[ 241]
cpu : usr=0.46%, sys=2.04%, ctx=274417, majf=0, minf=18
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=51514,51337,0,102848 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=3434KiB/s (3517kB/s), 3434KiB/s-3434KiB/s (3517kB/s-3517kB/s), io=201MiB (211MB), run=60001-60001msec
WRITE: bw=3422KiB/s (3505kB/s), 3422KiB/s-3422KiB/s (3505kB/s-3505kB/s), io=201MiB (210MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=52120/254059, merge=0/0, ticks=5143/52935, in_queue=58077, util=99.87%, aggrios=52206/254965, aggrmerge=0/0, aggrticks=5123/53155, aggrin_queue=58277, aggrutil=99.73%
md0: ios=52206/254965, merge=0/0, ticks=5123/53155, in_queue=58277, util=99.73%, aggrios=17206/142730, aggrmerge=196/10846, aggrticks=1147/27159, aggrin_queue=49701, aggrutil=98.09%
nvme1n1: ios=17375/142915, merge=224/10684, ticks=1139/26067, in_queue=47755, util=96.19%
nvme0n1: ios=17113/142469, merge=168/11120, ticks=1153/27877, in_queue=51014, util=98.09%
nvme2n1: ios=17130/142806, merge=196/10734, ticks=1150/27533, in_queue=50335, util=97.31%
Raw
bench-poll-mode-32-queues.txt
#############################
### 1024k sequential read ###
#############################
TEST: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
TEST: (groupid=0, jobs=1): err= 0: pid=4380: Fri May 14 11:38:19 2021
read: IOPS=6877, BW=6877MiB/s (7211MB/s)(10.0GiB/1489msec)
slat (usec): min=12, max=174, avg=21.13, stdev= 7.20
clat (usec): min=567, max=96312, avg=4590.19, stdev=5458.76
lat (usec): min=586, max=96416, avg=4611.40, stdev=5462.35
clat percentiles (usec):
| 1.00th=[ 865], 5.00th=[ 2606], 10.00th=[ 3195], 20.00th=[ 3458],
| 30.00th=[ 3523], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3589],
| 70.00th=[ 3621], 80.00th=[ 3654], 90.00th=[ 4948], 95.00th=[15008],
| 99.00th=[17957], 99.50th=[18482], 99.90th=[89654], 99.95th=[94897],
| 99.99th=[95945]
bw ( MiB/s): min= 5924, max= 7348, per=96.49%, avg=6636.00, stdev=1006.92, samples=2
iops : min= 5924, max= 7348, avg=6636.00, stdev=1006.92, samples=2
lat (usec) : 750=0.70%, 1000=0.60%
lat (msec) : 2=1.88%, 4=84.38%, 10=5.80%, 20=6.21%, 50=0.11%
lat (msec) : 100=0.31%
cpu : usr=0.67%, sys=15.32%, ctx=9108, majf=0, minf=8204
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=10240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=6877MiB/s (7211MB/s), 6877MiB/s-6877MiB/s (7211MB/s-7211MB/s), io=10.0GiB (10.7GB), run=1489-1489msec
Disk stats (read/write):
dm-4: ios=8916/0, merge=0/0, ticks=40203/0, in_queue=40203, util=93.06%, aggrios=81920/73, aggrmerge=0/0, aggrticks=241772/40, aggrin_queue=241812, aggrutil=90.30%
md0: ios=81920/73, merge=0/0, ticks=241772/40, in_queue=241812, util=90.30%, aggrios=27306/12, aggrmerge=0/16, aggrticks=74800/15, aggrin_queue=74831, aggrutil=90.30%
nvme1n1: ios=27321/13, merge=0/8, ticks=83095/10, in_queue=83114, util=83.88%
nvme0n1: ios=27298/14, merge=0/26, ticks=25985/4, in_queue=25993, util=82.24%
nvme2n1: ios=27301/10, merge=0/14, ticks=115321/33, in_queue=115387, util=90.30%
##############################
### 1024k sequential write ###
##############################
TEST: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4580: Fri May 14 11:38:21 2021
write: IOPS=7431, BW=7431MiB/s (7792MB/s)(10.0GiB/1378msec); 0 zone resets
slat (usec): min=15, max=152, avg=30.54, stdev= 4.23
clat (usec): min=832, max=21997, avg=4218.36, stdev=2182.84
lat (usec): min=857, max=22026, avg=4249.00, stdev=2182.16
clat percentiles (usec):
| 1.00th=[ 1012], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 3490],
| 30.00th=[ 3523], 40.00th=[ 3523], 50.00th=[ 3556], 60.00th=[ 3589],
| 70.00th=[ 3621], 80.00th=[ 3818], 90.00th=[ 6915], 95.00th=[ 8979],
| 99.00th=[12387], 99.50th=[14222], 99.90th=[21890], 99.95th=[21890],
| 99.99th=[21890]
bw ( MiB/s): min= 5672, max= 8508, per=95.41%, avg=7090.00, stdev=2005.35, samples=2
iops : min= 5672, max= 8508, avg=7090.00, stdev=2005.35, samples=2
lat (usec) : 1000=0.44%
lat (msec) : 2=4.11%, 4=76.43%, 10=16.74%, 20=1.97%, 50=0.31%
fsync/fdatasync/sync_file_range:
sync (nsec): min=80, max=80, avg=80.00, stdev= 0.00
sync percentiles (nsec):
| 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80],
| 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 80],
| 70.00th=[ 80], 80.00th=[ 80], 90.00th=[ 80], 95.00th=[ 80],
| 99.00th=[ 80], 99.50th=[ 80], 99.90th=[ 80], 99.95th=[ 80],
| 99.99th=[ 80]
cpu : usr=8.50%, sys=16.05%, ctx=10054, majf=0, minf=11
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10240,0,1 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=7431MiB/s (7792MB/s), 7431MiB/s-7431MiB/s (7792MB/s-7792MB/s), io=10.0GiB (10.7GB), run=1378-1378msec
Disk stats (read/write):
dm-4: ios=0/8290, merge=0/0, ticks=0/34841, in_queue=34840, util=91.59%, aggrios=0/81938, aggrmerge=0/0, aggrticks=0/224996, aggrin_queue=224996, aggrutil=88.24%
md0: ios=0/81938, merge=0/0, ticks=0/224996, in_queue=224996, util=88.24%, aggrios=0/27308, aggrmerge=0/5, aggrticks=0/69983, aggrin_queue=69985, aggrutil=88.24%
nvme1n1: ios=0/27324, merge=0/15, ticks=0/64814, in_queue=64814, util=86.96%
nvme0n1: ios=0/27299, merge=0/0, ticks=0/60193, in_queue=60197, util=86.96%
nvme2n1: ios=0/27302, merge=0/0, ticks=0/84943, in_queue=84944, util=88.24%
######################
### 4k random read ###
######################
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4619: Fri May 14 11:39:21 2021
read: IOPS=14.6k, BW=57.2MiB/s (60.0MB/s)(3431MiB/60001msec)
slat (nsec): min=1490, max=29279, avg=2617.45, stdev=665.48
clat (usec): min=6, max=788, avg=65.20, stdev= 6.82
lat (usec): min=9, max=791, avg=67.88, stdev= 6.89
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 66], 60.00th=[ 67],
| 70.00th=[ 67], 80.00th=[ 68], 90.00th=[ 68], 95.00th=[ 69],
| 99.00th=[ 70], 99.50th=[ 71], 99.90th=[ 90], 99.95th=[ 108],
| 99.99th=[ 469]
bw ( KiB/s): min=56880, max=59704, per=100.00%, avg=58577.14, stdev=529.87, samples=119
iops : min=14220, max=14926, avg=14644.29, stdev=132.47, samples=119
lat (usec) : 10=0.01%, 20=0.02%, 50=0.01%, 100=99.92%, 250=0.03%
lat (usec) : 500=0.02%, 750=0.01%, 1000=0.01%
cpu : usr=2.03%, sys=7.29%, ctx=878398, majf=0, minf=13
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=878387,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=57.2MiB/s (60.0MB/s), 57.2MiB/s-57.2MiB/s (60.0MB/s-60.0MB/s), io=3431MiB (3598MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=877477/908, merge=0/0, ticks=54735/180, in_queue=54914, util=99.86%, aggrios=878947/1447, aggrmerge=0/0, aggrticks=54528/200, aggrin_queue=54728, aggrutil=99.76%
md0: ios=878947/1447, merge=0/0, ticks=54528/200, in_queue=54728, util=99.76%, aggrios=292824/383, aggrmerge=159/169, aggrticks=18572/48, aggrin_queue=18637, aggrutil=99.76%
nvme1n1: ios=293009/379, merge=155/155, ticks=18723/43, in_queue=18780, util=99.76%
nvme0n1: ios=292707/380, merge=152/163, ticks=18319/46, in_queue=18383, util=99.76%
nvme2n1: ios=292757/392, merge=171/189, ticks=18675/56, in_queue=18748, util=99.76%
#######################
### 4k random write ###
#######################
TEST: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=5022: Fri May 14 11:40:22 2021
read: IOPS=737, BW=2950KiB/s (3021kB/s)(173MiB/60001msec)
slat (nsec): min=1910, max=98858, avg=3387.09, stdev=1236.57
clat (usec): min=57, max=7737, avg=67.85, stdev=88.90
lat (usec): min=61, max=7742, avg=71.30, stdev=88.98
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 65],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 67],
| 70.00th=[ 67], 80.00th=[ 68], 90.00th=[ 69], 95.00th=[ 69],
| 99.00th=[ 82], 99.50th=[ 95], 99.90th=[ 375], 99.95th=[ 537],
| 99.99th=[ 5211]
bw ( KiB/s): min= 328, max= 4032, per=100.00%, avg=2969.08, stdev=1154.74, samples=119
iops : min= 82, max= 1008, avg=742.27, stdev=288.69, samples=119
write: IOPS=732, BW=2931KiB/s (3001kB/s)(172MiB/60001msec); 0 zone resets
slat (nsec): min=1950, max=35519, avg=3554.86, stdev=1254.58
clat (usec): min=8, max=25519, avg=17.26, stdev=125.74
lat (usec): min=10, max=25532, avg=20.88, stdev=125.81
clat percentiles (usec):
| 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 15],
| 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 17],
| 70.00th=[ 18], 80.00th=[ 18], 90.00th=[ 19], 95.00th=[ 19],
| 99.00th=[ 35], 99.50th=[ 37], 99.90th=[ 101], 99.95th=[ 289],
| 99.99th=[ 562]
bw ( KiB/s): min= 360, max= 4000, per=100.00%, avg=2949.51, stdev=1160.10, samples=119
iops : min= 90, max= 1000, avg=737.38, stdev=290.02, samples=119
lat (usec) : 10=0.27%, 20=48.54%, 50=0.94%, 100=49.98%, 250=0.18%
lat (usec) : 500=0.05%, 750=0.02%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 50=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=10, max=3790, avg=36.40, stdev=24.33
sync percentiles (nsec):
| 1.00th=[ 20], 5.00th=[ 20], 10.00th=[ 30], 20.00th=[ 30],
| 30.00th=[ 30], 40.00th=[ 30], 50.00th=[ 30], 60.00th=[ 30],
| 70.00th=[ 40], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 70],
| 99.00th=[ 110], 99.50th=[ 151], 99.90th=[ 241], 99.95th=[ 251],
| 99.99th=[ 282]
cpu : usr=0.35%, sys=1.74%, ctx=232332, majf=0, minf=18
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=44254,43962,0,88213 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=2950KiB/s (3021kB/s), 2950KiB/s-2950KiB/s (3021kB/s-3021kB/s), io=173MiB (181MB), run=60001-60001msec
WRITE: bw=2931KiB/s (3001kB/s), 2931KiB/s-2931KiB/s (3001kB/s-3001kB/s), io=172MiB (180MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=44401/223696, merge=0/0, ticks=4430/54051, in_queue=58480, util=99.85%, aggrios=44421/224135, aggrmerge=0/0, aggrticks=4399/54095, aggrin_queue=58495, aggrutil=99.67%
md0: ios=44421/224135, merge=0/0, ticks=4399/54095, in_queue=58495, util=99.67%, aggrios=14757/123643, aggrmerge=50/9904, aggrticks=975/26371, aggrin_queue=47499, aggrutil=97.62%
nvme1n1: ios=14834/123515, merge=60/10053, ticks=991/31103, in_queue=55253, util=97.62%
nvme0n1: ios=14764/123627, merge=60/9812, ticks=966/23474, in_queue=42771, util=94.98%
nvme2n1: ios=14673/123789, merge=30/9849, ticks=968/24537, in_queue=44473, util=95.09%
Raw
bench-poll-mode-4-queues.txt
#############################
### 1024k sequential read ###
#############################
TEST: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
TEST: (groupid=0, jobs=1): err= 0: pid=4423: Fri May 14 11:20:09 2021
read: IOPS=8935, BW=8935MiB/s (9369MB/s)(10.0GiB/1146msec)
slat (usec): min=13, max=203, avg=25.23, stdev= 6.87
clat (usec): min=580, max=6788, avg=3517.29, stdev=694.99
lat (usec): min=600, max=6804, avg=3542.61, stdev=694.43
clat percentiles (usec):
| 1.00th=[ 799], 5.00th=[ 2442], 10.00th=[ 3228], 20.00th=[ 3294],
| 30.00th=[ 3359], 40.00th=[ 3425], 50.00th=[ 3523], 60.00th=[ 3621],
| 70.00th=[ 3687], 80.00th=[ 3818], 90.00th=[ 3916], 95.00th=[ 4080],
| 99.00th=[ 5997], 99.50th=[ 6325], 99.90th=[ 6652], 99.95th=[ 6652],
| 99.99th=[ 6718]
bw ( MiB/s): min= 8930, max= 8940, per=100.00%, avg=8935.00, stdev= 7.07, samples=2
iops : min= 8930, max= 8940, avg=8935.00, stdev= 7.07, samples=2
lat (usec) : 750=0.06%, 1000=1.82%
lat (msec) : 2=1.97%, 4=89.32%, 10=6.84%
cpu : usr=1.14%, sys=23.84%, ctx=8082, majf=0, minf=8200
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=10240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=8935MiB/s (9369MB/s), 8935MiB/s-8935MiB/s (9369MB/s-9369MB/s), io=10.0GiB (10.7GB), run=1146-1146msec
Disk stats (read/write):
dm-4: ios=9960/0, merge=0/0, ticks=33973/0, in_queue=33973, util=91.91%, aggrios=81920/0, aggrmerge=0/0, aggrticks=213302/0, aggrin_queue=213302, aggrutil=86.40%
md0: ios=81920/0, merge=0/0, ticks=213302/0, in_queue=213302, util=86.40%, aggrios=27306/0, aggrmerge=0/0, aggrticks=68202/0, aggrin_queue=68202, aggrutil=86.40%
nvme1n1: ios=27300/0, merge=0/0, ticks=88683/0, in_queue=88684, util=86.40%
nvme0n1: ios=27320/0, merge=0/0, ticks=27384/0, in_queue=27384, util=86.18%
nvme2n1: ios=27300/0, merge=0/0, ticks=88539/0, in_queue=88539, util=86.40%
##############################
### 1024k sequential write ###
##############################
TEST: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4458: Fri May 14 11:20:11 2021
write: IOPS=8304, BW=8305MiB/s (8708MB/s)(10.0GiB/1233msec); 0 zone resets
slat (usec): min=16, max=3283, avg=30.89, stdev=62.11
clat (usec): min=803, max=11671, avg=3775.07, stdev=1154.28
lat (usec): min=828, max=11701, avg=3806.05, stdev=1153.36
clat percentiles (usec):
| 1.00th=[ 1012], 5.00th=[ 2212], 10.00th=[ 3294], 20.00th=[ 3458],
| 30.00th=[ 3490], 40.00th=[ 3523], 50.00th=[ 3556], 60.00th=[ 3589],
| 70.00th=[ 3621], 80.00th=[ 3752], 90.00th=[ 5014], 95.00th=[ 6783],
| 99.00th=[ 7242], 99.50th=[ 8356], 99.90th=[10945], 99.95th=[11338],
| 99.99th=[11600]
bw ( MiB/s): min= 8340, max= 8394, per=100.00%, avg=8367.00, stdev=38.18, samples=2
iops : min= 8340, max= 8394, avg=8367.00, stdev=38.18, samples=2
lat (usec) : 1000=0.82%
lat (msec) : 2=3.66%, 4=80.13%, 10=15.14%, 20=0.25%
fsync/fdatasync/sync_file_range:
sync (nsec): min=310, max=310, avg=310.00, stdev= 0.00
sync percentiles (nsec):
| 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 310],
| 30.00th=[ 310], 40.00th=[ 310], 50.00th=[ 310], 60.00th=[ 310],
| 70.00th=[ 310], 80.00th=[ 310], 90.00th=[ 310], 95.00th=[ 310],
| 99.00th=[ 310], 99.50th=[ 310], 99.90th=[ 310], 99.95th=[ 310],
| 99.99th=[ 310]
cpu : usr=8.77%, sys=18.83%, ctx=9951, majf=0, minf=11
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10240,0,1 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=8305MiB/s (8708MB/s), 8305MiB/s-8305MiB/s (8708MB/s-8708MB/s), io=10.0GiB (10.7GB), run=1233-1233msec
Disk stats (read/write):
dm-4: ios=2/9609, merge=0/0, ticks=3/34990, in_queue=34993, util=91.66%, aggrios=2/82050, aggrmerge=0/0, aggrticks=4/208929, aggrin_queue=208933, aggrutil=86.20%
md0: ios=2/82050, merge=0/0, ticks=4/208929, in_queue=208933, util=86.20%, aggrios=0/27332, aggrmerge=0/26, aggrticks=0/64978, aggrin_queue=65009, aggrutil=86.20%
nvme1n1: ios=1/27326, merge=0/26, ticks=1/66568, in_queue=66595, util=86.20%
nvme0n1: ios=0/27352, merge=0/26, ticks=0/67152, in_queue=67188, util=86.13%
nvme2n1: ios=1/27320, merge=0/27, ticks=1/61215, in_queue=61244, util=86.13%
######################
### 4k random read ###
######################
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4494: Fri May 14 11:21:11 2021
read: IOPS=14.6k, BW=56.9MiB/s (59.6MB/s)(3413MiB/60001msec)
slat (nsec): min=1490, max=21249, avg=2617.96, stdev=337.29
clat (usec): min=8, max=4884, avg=65.58, stdev= 9.47
lat (usec): min=10, max=4887, avg=68.26, stdev= 9.50
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 66], 60.00th=[ 67],
| 70.00th=[ 67], 80.00th=[ 68], 90.00th=[ 69], 95.00th=[ 69],
| 99.00th=[ 70], 99.50th=[ 71], 99.90th=[ 90], 99.95th=[ 108],
| 99.99th=[ 445]
bw ( KiB/s): min=56928, max=59408, per=100.00%, avg=58257.82, stdev=532.74, samples=119
iops : min=14232, max=14852, avg=14564.45, stdev=133.19, samples=119
lat (usec) : 10=0.01%, 20=0.02%, 50=0.01%, 100=99.92%, 250=0.03%
lat (usec) : 500=0.02%, 750=0.01%
lat (msec) : 10=0.01%
cpu : usr=2.21%, sys=7.78%, ctx=873734, majf=0, minf=12
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=873726,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=56.9MiB/s (59.6MB/s), 56.9MiB/s-56.9MiB/s (59.6MB/s-59.6MB/s), io=3413MiB (3579MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=872223/706, merge=0/0, ticks=54498/20, in_queue=54517, util=99.86%, aggrios=873727/1198, aggrmerge=0/0, aggrticks=54291/33, aggrin_queue=54324, aggrutil=99.74%
md0: ios=873727/1198, merge=0/0, ticks=54291/33, in_queue=54324, util=99.74%, aggrios=291242/309, aggrmerge=0/134, aggrticks=18480/31, aggrin_queue=18526, aggrutil=99.73%
nvme1n1: ios=291208/301, merge=0/145, ticks=18596/33, in_queue=18642, util=99.73%
nvme0n1: ios=291491/319, merge=0/141, ticks=18214/33, in_queue=18263, util=99.73%
nvme2n1: ios=291028/307, merge=0/118, ticks=18630/29, in_queue=18673, util=99.73%
#######################
### 4k random write ###
#######################
TEST: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4835: Fri May 14 11:22:11 2021
read: IOPS=593, BW=2375KiB/s (2432kB/s)(139MiB/60006msec)
slat (nsec): min=1910, max=21470, avg=3419.20, stdev=1197.90
clat (usec): min=57, max=13803, avg=70.88, stdev=143.83
lat (usec): min=60, max=13814, avg=74.38, stdev=143.98
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 67],
| 70.00th=[ 68], 80.00th=[ 68], 90.00th=[ 69], 95.00th=[ 72],
| 99.00th=[ 96], 99.50th=[ 178], 99.90th=[ 562], 99.95th=[ 3195],
| 99.99th=[ 7635]
bw ( KiB/s): min= 288, max= 4176, per=100.00%, avg=2385.48, stdev=1255.76, samples=119
iops : min= 72, max= 1044, avg=596.37, stdev=313.94, samples=119
write: IOPS=593, BW=2376KiB/s (2433kB/s)(139MiB/60006msec); 0 zone resets
slat (nsec): min=1900, max=21190, avg=3656.21, stdev=1280.09
clat (usec): min=7, max=677, avg=17.65, stdev=19.07
lat (usec): min=10, max=681, avg=21.40, stdev=19.30
clat percentiles (usec):
| 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 13], 20.00th=[ 15],
| 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 17],
| 70.00th=[ 18], 80.00th=[ 19], 90.00th=[ 19], 95.00th=[ 21],
| 99.00th=[ 38], 99.50th=[ 53], 99.90th=[ 347], 99.95th=[ 429],
| 99.99th=[ 537]
bw ( KiB/s): min= 392, max= 3864, per=100.00%, avg=2385.08, stdev=1232.02, samples=119
iops : min= 98, max= 966, avg=596.27, stdev=308.00, samples=119
lat (usec) : 10=0.16%, 20=47.31%, 50=2.28%, 100=49.58%, 250=0.29%
lat (usec) : 500=0.30%, 750=0.04%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=10, max=4500, avg=45.49, stdev=29.08
sync percentiles (nsec):
| 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 40],
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 40],
| 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 80],
| 99.00th=[ 141], 99.50th=[ 191], 99.90th=[ 231], 99.95th=[ 241],
| 99.99th=[ 241]
cpu : usr=0.32%, sys=1.36%, ctx=185291, majf=0, minf=15
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=35634,35638,0,71269 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=2375KiB/s (2432kB/s), 2375KiB/s-2375KiB/s (2432kB/s-2432kB/s), io=139MiB (146MB), run=60006-60006msec
WRITE: bw=2376KiB/s (2433kB/s), 2376KiB/s-2376KiB/s (2433kB/s-2433kB/s), io=139MiB (146MB), run=60006-60006msec
Disk stats (read/write):
dm-4: ios=35774/189059, merge=0/0, ticks=3453/55461, in_queue=58915, util=99.84%, aggrios=35800/189615, aggrmerge=0/0, aggrticks=3429/55551, aggrin_queue=58981, aggrutil=99.71%
md0: ios=35800/189615, merge=0/0, ticks=3429/55551, in_queue=58981, util=99.71%, aggrios=11883/101843, aggrmerge=50/8895, aggrticks=824/25210, aggrin_queue=44660, aggrutil=97.61%
nvme1n1: ios=11867/101560, merge=60/9163, ticks=837/35105, in_queue=60798, util=97.61%
nvme0n1: ios=11890/101951, merge=60/8825, ticks=817/20390, in_queue=36859, util=92.51%
nvme2n1: ios=11893/102020, merge=30/8699, ticks=819/20137, in_queue=36323, util=92.19%
Raw
bench-poll-mode-8-queues.txt
#############################
### 1024k sequential read ###
#############################
TEST: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: Laying out IO file (1 file / 500MiB)
TEST: (groupid=0, jobs=1): err= 0: pid=4406: Fri May 14 11:30:12 2021
read: IOPS=8888, BW=8889MiB/s (9321MB/s)(10.0GiB/1152msec)
slat (usec): min=12, max=188, avg=23.70, stdev= 7.30
clat (usec): min=491, max=6832, avg=3538.56, stdev=701.80
lat (usec): min=516, max=6847, avg=3562.36, stdev=701.29
clat percentiles (usec):
| 1.00th=[ 865], 5.00th=[ 2311], 10.00th=[ 3490], 20.00th=[ 3523],
| 30.00th=[ 3556], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3589],
| 70.00th=[ 3589], 80.00th=[ 3621], 90.00th=[ 3654], 95.00th=[ 4113],
| 99.00th=[ 6325], 99.50th=[ 6521], 99.90th=[ 6783], 99.95th=[ 6783],
| 99.99th=[ 6849]
bw ( MiB/s): min= 8888, max= 8892, per=100.00%, avg=8890.00, stdev= 2.83, samples=2
iops : min= 8888, max= 8892, avg=8890.00, stdev= 2.83, samples=2
lat (usec) : 500=0.02%, 750=0.62%, 1000=1.18%
lat (msec) : 2=2.32%, 4=90.23%, 10=5.62%
cpu : usr=1.22%, sys=23.11%, ctx=10080, majf=0, minf=8201
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=10240,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
READ: bw=8889MiB/s (9321MB/s), 8889MiB/s-8889MiB/s (9321MB/s-9321MB/s), io=10.0GiB (10.7GB), run=1152-1152msec
Disk stats (read/write):
dm-4: ios=8123/0, merge=0/0, ticks=27747/0, in_queue=27747, util=90.40%, aggrios=81921/2, aggrmerge=0/0, aggrticks=218668/0, aggrin_queue=218668, aggrutil=85.10%
md0: ios=81921/2, merge=0/0, ticks=218668/0, in_queue=218668, util=85.10%, aggrios=27307/0, aggrmerge=0/0, aggrticks=70341/0, aggrin_queue=70340, aggrutil=85.10%
nvme1n1: ios=27401/1, merge=0/1, ticks=93042/0, in_queue=93042, util=85.03%
nvme0n1: ios=27281/1, merge=0/0, ticks=28981/0, in_queue=28980, util=85.03%
nvme2n1: ios=27239/0, merge=0/0, ticks=89000/0, in_queue=89000, util=85.10%
##############################
### 1024k sequential write ###
##############################
TEST: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=32
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4603: Fri May 14 11:30:14 2021
write: IOPS=8331, BW=8332MiB/s (8737MB/s)(10.0GiB/1229msec); 0 zone resets
slat (usec): min=15, max=3126, avg=27.63, stdev=30.81
clat (usec): min=762, max=8193, avg=3767.41, stdev=1096.62
lat (usec): min=783, max=8224, avg=3795.15, stdev=1096.23
clat percentiles (usec):
| 1.00th=[ 914], 5.00th=[ 2212], 10.00th=[ 3392], 20.00th=[ 3458],
| 30.00th=[ 3490], 40.00th=[ 3523], 50.00th=[ 3589], 60.00th=[ 3589],
| 70.00th=[ 3621], 80.00th=[ 3752], 90.00th=[ 5145], 95.00th=[ 6718],
| 99.00th=[ 7111], 99.50th=[ 7242], 99.90th=[ 7439], 99.95th=[ 7635],
| 99.99th=[ 8094]
bw ( MiB/s): min= 8372, max= 8390, per=100.00%, avg=8381.00, stdev=12.73, samples=2
iops : min= 8372, max= 8390, avg=8381.00, stdev=12.73, samples=2
lat (usec) : 1000=2.17%
lat (msec) : 2=2.32%, 4=81.65%, 10=13.86%
fsync/fdatasync/sync_file_range:
sync (nsec): min=100, max=100, avg=100.00, stdev= 0.00
sync percentiles (nsec):
| 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100],
| 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 100],
| 70.00th=[ 100], 80.00th=[ 100], 90.00th=[ 100], 95.00th=[ 100],
| 99.00th=[ 100], 99.50th=[ 100], 99.90th=[ 100], 99.95th=[ 100],
| 99.99th=[ 100]
cpu : usr=7.90%, sys=16.94%, ctx=10059, majf=0, minf=11
IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=93.6%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
issued rwts: total=0,10240,0,1 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=32
Run status group 0 (all jobs):
WRITE: bw=8332MiB/s (8737MB/s), 8332MiB/s-8332MiB/s (8737MB/s-8737MB/s), io=10.0GiB (10.7GB), run=1229-1229msec
Disk stats (read/write):
dm-4: ios=0/9587, merge=0/0, ticks=0/34807, in_queue=34806, util=91.59%, aggrios=0/81968, aggrmerge=0/0, aggrticks=0/200523, aggrin_queue=200523, aggrutil=86.80%
md0: ios=0/81968, merge=0/0, ticks=0/200523, in_queue=200523, util=86.80%, aggrios=0/27311, aggrmerge=0/12, aggrticks=0/62366, aggrin_queue=62369, aggrutil=86.80%
nvme1n1: ios=0/27405, merge=0/9, ticks=0/68368, in_queue=68370, util=86.59%
nvme0n1: ios=0/27286, merge=0/29, ticks=0/57525, in_queue=57528, util=86.80%
nvme2n1: ios=0/27243, merge=0/0, ticks=0/61206, in_queue=61210, util=86.52%
######################
### 4k random read ###
######################
TEST: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=4645: Fri May 14 11:31:14 2021
read: IOPS=14.2k, BW=55.5MiB/s (58.2MB/s)(3328MiB/60001msec)
slat (nsec): min=1590, max=29070, avg=3154.69, stdev=701.24
clat (usec): min=8, max=9154, avg=66.68, stdev=49.76
lat (usec): min=10, max=9157, avg=69.92, stdev=49.77
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 64], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 67],
| 70.00th=[ 68], 80.00th=[ 69], 90.00th=[ 69], 95.00th=[ 70],
| 99.00th=[ 72], 99.50th=[ 76], 99.90th=[ 180], 99.95th=[ 388],
| 99.99th=[ 1254]
bw ( KiB/s): min=19912, max=59224, per=100.00%, avg=56832.67, stdev=4039.04, samples=119
iops : min= 4978, max=14806, avg=14208.15, stdev=1009.76, samples=119
lat (usec) : 10=0.01%, 20=0.02%, 50=0.01%, 100=99.77%, 250=0.12%
lat (usec) : 500=0.06%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
cpu : usr=2.37%, sys=8.35%, ctx=852095, majf=0, minf=13
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=852092,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=55.5MiB/s (58.2MB/s), 55.5MiB/s-55.5MiB/s (58.2MB/s-58.2MB/s), io=3328MiB (3490MB), run=60001-60001msec
Disk stats (read/write):
dm-4: ios=850671/874, merge=0/0, ticks=53665/37, in_queue=53701, util=99.90%, aggrios=852141/1442, aggrmerge=0/0, aggrticks=53361/37, aggrin_queue=53398, aggrutil=99.77%
md0: ios=852141/1442, merge=0/0, ticks=53361/37, in_queue=53398, util=99.77%, aggrios=284033/334, aggrmerge=14/188, aggrticks=18354/33, aggrin_queue=18407, aggrutil=99.77%
nvme1n1: ios=284990/348, merge=12/206, ticks=18972/38, in_queue=19032, util=99.77%
nvme0n1: ios=283787/338, merge=15/167, ticks=17838/34, in_queue=17889, util=99.44%
nvme2n1: ios=283322/317, merge=15/193, ticks=18253/29, in_queue=18300, util=99.47%
#######################
### 4k random write ###
#######################
TEST: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
fio-3.26
Starting 1 process
TEST: (groupid=0, jobs=1): err= 0: pid=5157: Fri May 14 11:32:15 2021
read: IOPS=769, BW=3079KiB/s (3153kB/s)(180MiB/60004msec)
slat (nsec): min=1890, max=20060, avg=3439.14, stdev=1018.84
clat (usec): min=56, max=7279, avg=67.28, stdev=72.93
lat (usec): min=61, max=7283, avg=70.79, stdev=73.01
clat percentiles (usec):
| 1.00th=[ 62], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 64],
| 30.00th=[ 65], 40.00th=[ 66], 50.00th=[ 67], 60.00th=[ 67],
| 70.00th=[ 68], 80.00th=[ 68], 90.00th=[ 69], 95.00th=[ 70],
| 99.00th=[ 83], 99.50th=[ 92], 99.90th=[ 219], 99.95th=[ 502],
| 99.99th=[ 4621]
bw ( KiB/s): min= 304, max= 4064, per=100.00%, avg=3095.19, stdev=1102.32, samples=119
iops : min= 76, max= 1016, avg=773.80, stdev=275.58, samples=119
write: IOPS=765, BW=3062KiB/s (3135kB/s)(179MiB/60004msec); 0 zone resets
slat (nsec): min=1910, max=21629, avg=3622.57, stdev=1104.93
clat (usec): min=8, max=1885, avg=16.58, stdev=13.07
lat (usec): min=10, max=1896, avg=20.27, stdev=13.29
clat percentiles (usec):
| 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 13], 20.00th=[ 15],
| 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 17],
| 70.00th=[ 18], 80.00th=[ 19], 90.00th=[ 19], 95.00th=[ 19],
| 99.00th=[ 36], 99.50th=[ 37], 99.90th=[ 96], 99.95th=[ 281],
| 99.99th=[ 457]
bw ( KiB/s): min= 384, max= 3960, per=100.00%, avg=3076.84, stdev=1077.83, samples=119
iops : min= 96, max= 990, avg=769.21, stdev=269.46, samples=119
lat (usec) : 10=0.14%, 20=48.53%, 50=1.09%, 100=50.01%, 250=0.16%
lat (usec) : 500=0.04%, 750=0.02%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
fsync/fdatasync/sync_file_range:
sync (nsec): min=10, max=10820, avg=42.21, stdev=56.61
sync percentiles (nsec):
| 1.00th=[ 20], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 30],
| 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 40],
| 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 50], 95.00th=[ 70],
| 99.00th=[ 110], 99.50th=[ 131], 99.90th=[ 211], 99.95th=[ 221],
| 99.99th=[ 221]
cpu : usr=0.42%, sys=1.72%, ctx=242444, majf=0, minf=15
IO depths : 1=200.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=46184,45928,0,92109 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: bw=3079KiB/s (3153kB/s), 3079KiB/s-3079KiB/s (3153kB/s-3153kB/s), io=180MiB (189MB), run=60004-60004msec
WRITE: bw=3062KiB/s (3135kB/s), 3062KiB/s-3062KiB/s (3135kB/s-3135kB/s), io=179MiB (188MB), run=60004-60004msec
Disk stats (read/write):
dm-4: ios=46580/232535, merge=0/0, ticks=4483/53848, in_queue=58331, util=99.85%, aggrios=46607/233166, aggrmerge=0/0, aggrticks=4450/54118, aggrin_queue=58568, aggrutil=99.71%
md0: ios=46607/233166, merge=0/0, ticks=4450/54118, in_queue=58568, util=99.71%, aggrios=15417/128939, aggrmerge=118/10232, aggrticks=1019/26572, aggrin_queue=47939, aggrutil=98.43%
nvme1n1: ios=15450/128888, merge=145/10324, ticks=1015/23602, in_queue=43091, util=95.43%
nvme0n1: ios=15508/128759, merge=100/10331, ticks=1010/24407, in_queue=44496, util=96.21%
nvme2n1: ios=15293/129172, merge=111/10043, ticks=1032/31708, in_queue=56232, util=98.43%
Raw
bench.sh
echo
echo "#############################"
echo "### 1024k sequential read ###"
echo "#############################"
echo
fio \
--name TEST \
--eta-newline=5s \
--filename=fio-tempfile.dat \
--rw=read \
--size=500m \
--io_size=10g \
--blocksize=1024k \
--ioengine=libaio \
--fsync=10000 \
--iodepth=32 \
--direct=1 \
--numjobs=1 \
--runtime=60 \
--group_reporting
echo
echo "##############################"
echo "### 1024k sequential write ###"
echo "##############################"
echo
fio \
--name TEST \
--eta-newline=5s \
--filename=fio-tempfile.dat \
--rw=write \
--size=500m \
--io_size=10g \
--blocksize=1024k \
--ioengine=libaio \
--fsync=10000 \
--iodepth=32 \
--direct=1 \
--numjobs=1 \
--runtime=60 \
--group_reporting
echo
echo "######################"
echo "### 4k random read ###"
echo "######################"
echo
fio \
--name=TEST \
--eta-newline=5s \
--filename=fio-tempfile.dat \
--rw=randread \
--size=500m \
--io_size=10g \
--blocksize=4k \
--ioengine=libaio \
--fsync=1 \
--iodepth=1 \
--direct=1 \
--numjobs=1 \
--runtime=60 \
--group_reporting
echo
echo "#######################"
echo "### 4k random write ###"
echo "#######################"
echo
fio \
--name=TEST \
--eta-newline=5s \
--filename=fio-tempfile.dat \
--rw=randrw \
--size=500m \
--io_size=10g \
--blocksize=4k \
--ioengine=libaio \
--fsync=1 \
--iodepth=1 \
--direct=1 \
--numjobs=1 \
--runtime=60 \
--group_reporting
rm fio-tempfile.dat &>/dev/null
Raw
interrupts-irq.txt
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31
0: 37 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 2-edge timer
7: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 7-fasteoi pinctrl_amd
8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 8-edge rtc0
9: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 9-fasteoi acpi
26: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IOMMU-MSI 0-edge AMD-Vi
46: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1060 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524288-edge nvme0q0
47: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1060 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097152-edge nvme1q0
48: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1060 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621440-edge nvme2q0
51: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815746-edge ahci2
52: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815747-edge ahci3
65: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340032-edge ahci0
66: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340033-edge ahci1
69: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340036-edge ahci4
70: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340037-edge ahci5
81: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524289-edge nvme0q1
82: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 36208 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524290-edge nvme0q2
83: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18179 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524291-edge nvme0q3
84: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3451 0 0 0 0 0 0 0 0 IR-PCI-MSI 524292-edge nvme0q4
85: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 119423 0 0 0 0 0 0 IR-PCI-MSI 524293-edge nvme0q5
86: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 36199 0 0 0 0 IR-PCI-MSI 524294-edge nvme0q6
87: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26262 0 0 IR-PCI-MSI 524295-edge nvme0q7
88: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 174891 IR-PCI-MSI 524296-edge nvme0q8
89: 0 26490 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097153-edge nvme1q1
90: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26581 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621441-edge nvme2q1
91: 0 0 0 35880 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097154-edge nvme1q2
92: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 36169 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621442-edge nvme2q2
93: 0 0 0 0 0 18060 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097155-edge nvme1q3
94: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18167 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621443-edge nvme2q3
95: 0 0 0 0 0 0 0 3439 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097156-edge nvme1q4
96: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3434 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621444-edge nvme2q4
97: 0 0 0 0 0 0 0 0 0 118932 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097157-edge nvme1q5
98: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 118498 0 0 0 0 0 0 0 IR-PCI-MSI 2621445-edge nvme2q5
99: 0 0 0 0 0 0 0 0 0 0 0 36527 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097158-edge nvme1q6
100: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 36352 0 0 0 0 0 IR-PCI-MSI 2621446-edge nvme2q6
101: 0 0 0 0 0 0 0 0 0 0 0 0 0 26367 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097159-edge nvme1q7
102: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 26105 0 0 0 IR-PCI-MSI 2621447-edge nvme2q7
103: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 174711 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097160-edge nvme1q8
104: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 174798 0 IR-PCI-MSI 2621448-edge nvme2q8
105: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 79888 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4194304-edge amdgpu
106: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 8120 0 0 0 0 0 0 0 0 IR-PCI-MSI 6293504-edge xhci_hcd
107: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4687 0 0 0 0 0 0 0 IR-PCI-MSI 6297600-edge xhci_hcd
108: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297601-edge xhci_hcd
109: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297602-edge xhci_hcd
110: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297603-edge xhci_hcd
111: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297604-edge xhci_hcd
112: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297605-edge xhci_hcd
113: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297606-edge xhci_hcd
114: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297607-edge xhci_hcd
116: 191058 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919040-edge xhci_hcd
117: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919041-edge xhci_hcd
118: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919042-edge xhci_hcd
119: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919043-edge xhci_hcd
120: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919044-edge xhci_hcd
121: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919045-edge xhci_hcd
122: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919046-edge xhci_hcd
123: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8919047-edge xhci_hcd
124: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242880-edge enp10s0
125: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6135 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242881-edge enp10s0-rx-0
126: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4707 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242882-edge enp10s0-rx-1
127: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6127 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242883-edge enp10s0-tx-0
128: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 5115 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242884-edge enp10s0-tx-1
134: 0 0 0 0 0 0 0 0 0 538 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4196352-edge snd_hda_intel:card0
136: 0 0 0 0 0 0 0 0 0 0 1739 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 8921088-edge snd_hda_intel:card1
137: 0 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718592-edge iwlwifi: default queue
138: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718593-edge iwlwifi: queue 1
139: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718594-edge iwlwifi: queue 2
140: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718595-edge iwlwifi: queue 3
141: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718596-edge iwlwifi: queue 4
142: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718597-edge iwlwifi: queue 5
143: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718598-edge iwlwifi: queue 6
144: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718599-edge iwlwifi: queue 7
145: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718600-edge iwlwifi: queue 8
146: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718601-edge iwlwifi: queue 9
147: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718602-edge iwlwifi: queue 10
148: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718603-edge iwlwifi: queue 11
149: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718604-edge iwlwifi: queue 12
150: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718605-edge iwlwifi: queue 13
151: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718606-edge iwlwifi: queue 14
152: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 IR-PCI-MSI 4718607-edge iwlwifi: exception
NMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 325553 117878 55308 53583 7740 6044 6303 5311 5465 5305 3068 2960 3283 3324 2406 6981 25474 27152 27083 23819 4096 2964 2356 3422 3851 7265 5447 2994 3241 3573 5763 7477 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Performance monitoring interrupts
IWI: 0 0 0 0 2326 1383 379 268 369 330 278 234 1750 2470 229 264 4 0 0 0 3051 652 214 181 205 198 192 231 307 4390 239 337 IRQ work interrupts
RTR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 APIC ICR read retries
RES: 39715 95729 69198 65082 55276 38785 38544 29777 37138 35409 19895 22113 26023 21929 13776 135173 41558 40547 41189 47452 39528 22216 31695 24880 35956 130234 77878 32701 24944 39889 80955 114080 Rescheduling interrupts
CAL: 31851 81544 70044 67517 69900 65568 62464 61757 75453 101063 69916 65168 69503 74857 68665 65623 70850 66065 66284 65201 64502 62752 62815 67334 62719 62902 73161 67937 69295 71601 68838 64435 Function call interrupts
TLB: 9093 12308 13000 9499 12346 12958 13545 10211 24011 44825 17396 13104 15600 13119 57119 15607 11648 13985 10558 10673 13592 11841 11340 13841 11447 9901 22904 20477 16345 14393 17226 11058 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Threshold APIC interrupts
DFR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Deferred Error APIC interrupts
MCE: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Machine check exceptions
MCP: 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 Machine check polls
ERR: 0
MIS: 0
PIN: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt notification event
NPI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Nested posted-interrupt event
PIW: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt wakeup event
Raw
interrupts-poll-16-queues.txt
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31
0: 37 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 2-edge timer
7: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 7-fasteoi pinctrl_amd
8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 8-edge rtc0
9: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 9-fasteoi acpi
26: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IOMMU-MSI 0-edge AMD-Vi
48: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 402 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524288-edge nvme0q0
51: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815746-edge ahci2
52: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815747-edge ahci3
65: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 84796 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524289-edge nvme0q1
66: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 148807 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524290-edge nvme0q2
67: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340032-edge ahci0
68: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340033-edge ahci1
71: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340036-edge ahci4
72: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340037-edge ahci5
83: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 154605 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524291-edge nvme0q3
84: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 402 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097152-edge nvme1q0
85: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 121382 0 0 0 0 0 0 0 0 IR-PCI-MSI 524292-edge nvme0q4
86: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 84946 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097153-edge nvme1q1
87: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6163 0 0 0 0 0 0 IR-PCI-MSI 524293-edge nvme0q5
88: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 149605 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097154-edge nvme1q2
89: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6688 0 0 0 0 IR-PCI-MSI 524294-edge nvme0q6
90: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 402 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621440-edge nvme2q0
91: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 155535 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097155-edge nvme1q3
92: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 34520 0 0 IR-PCI-MSI 524295-edge nvme0q7
93: 0 84582 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621441-edge nvme2q1
94: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 121622 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097156-edge nvme1q4
95: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3505 IR-PCI-MSI 524296-edge nvme0q8
96: 0 0 0 148401 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621442-edge nvme2q2
97: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6339 0 0 0 0 0 0 0 IR-PCI-MSI 2097157-edge nvme1q5
98: 0 0 0 0 0 155004 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621443-edge nvme2q3
99: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6800 0 0 0 0 0 IR-PCI-MSI 2097158-edge nvme1q6
100: 0 0 0 0 0 0 0 121355 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621444-edge nvme2q4
101: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 34504 0 0 0 IR-PCI-MSI 2097159-edge nvme1q7
102: 0 0 0 0 0 0 0 0 0 6403 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621445-edge nvme2q5
103: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3492 0 IR-PCI-MSI 2097160-edge nvme1q8
104: 0 0 0 0 0 0 0 0 0 0 0 6620 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621446-edge nvme2q6
105: 0 0 0 0 0 0 0 0 0 0 0 0 0 34462 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621447-edge nvme2q7
106: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3497 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621448-edge nvme2q8
107: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 73 0 0 0 0 0 0 0 0 IR-PCI-MSI 6293504-edge xhci_hcd
108: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2138 0 0 0 0 0 0 0 IR-PCI-MSI 6297600-edge xhci_hcd
109: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297601-edge xhci_hcd
110: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297602-edge xhci_hcd
111: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297603-edge xhci_hcd
112: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297604-edge xhci_hcd
113: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297605-edge xhci_hcd
114: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297606-edge xhci_hcd
115: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297607-edge xhci_hcd
117: 42489 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967616-edge xhci_hcd
118: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967617-edge xhci_hcd
119: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967618-edge xhci_hcd
120: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967619-edge xhci_hcd
121: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967620-edge xhci_hcd
122: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967621-edge xhci_hcd
123: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967622-edge xhci_hcd
124: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967623-edge xhci_hcd
125: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242880-edge enp10s0
126: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4690 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242881-edge enp10s0-rx-0
127: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2427 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242882-edge enp10s0-rx-1
128: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3740 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242883-edge enp10s0-tx-0
129: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4757 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242884-edge enp10s0-tx-1
135: 0 0 0 0 0 0 0 0 0 568 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4196352-edge snd_hda_intel:card0
137: 0 0 0 0 0 0 0 0 0 0 1371 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9969664-edge snd_hda_intel:card1
138: 0 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718592-edge iwlwifi: default queue
139: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718593-edge iwlwifi: queue 1
140: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718594-edge iwlwifi: queue 2
141: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718595-edge iwlwifi: queue 3
142: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718596-edge iwlwifi: queue 4
143: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718597-edge iwlwifi: queue 5
144: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718598-edge iwlwifi: queue 6
145: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718599-edge iwlwifi: queue 7
146: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718600-edge iwlwifi: queue 8
147: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718601-edge iwlwifi: queue 9
148: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718602-edge iwlwifi: queue 10
149: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718603-edge iwlwifi: queue 11
150: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718604-edge iwlwifi: queue 12
151: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718605-edge iwlwifi: queue 13
152: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718606-edge iwlwifi: queue 14
153: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 IR-PCI-MSI 4718607-edge iwlwifi: exception
154: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30094 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4194304-edge amdgpu
NMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 124261 36394 19367 23047 4708 5215 2950 5942 2389 2248 2402 2329 2114 2456 1414 2117 33543 20167 16263 16843 6094 7453 10114 5755 2786 2219 2330 2134 2474 2287 2010 2485 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Performance monitoring interrupts
IWI: 0 0 0 0 19440 13066 6036 6561 137 142 198 327 186 172 197 164 0 0 0 0 20170 13443 4688 2642 303 383 2312 153 168 199 371 148 IRQ work interrupts
RTR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 APIC ICR read retries
RES: 17063 77613 39154 57747 76776 69332 34769 101519 14932 9114 7510 9995 18716 10901 11646 9582 59209 56921 64511 120613 130189 51694 109884 47482 13465 8329 18472 14624 14380 9895 10389 10174 Rescheduling interrupts
CAL: 35143 48457 45895 40712 42167 44549 42093 41727 47082 50891 43349 46281 45362 51786 43865 49642 44810 44261 41287 42277 40352 42423 40837 41161 47424 42949 48673 43431 49787 43086 88674 44224 Function call interrupts
TLB: 12905 9592 51583 7995 11282 10740 11723 8559 12338 15901 12637 17579 14351 16361 12349 14940 10795 11157 10294 9284 7942 11419 9706 15913 15311 12493 13734 11487 14315 14493 57097 13740 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Threshold APIC interrupts
DFR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Deferred Error APIC interrupts
MCE: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Machine check exceptions
MCP: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Machine check polls
ERR: 0
MIS: 0
PIN: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt notification event
NPI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Nested posted-interrupt event
PIW: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt wakeup event
Raw
interrupts-poll-32-queues.txt
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31
0: 37 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 2-edge timer
7: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 7-fasteoi pinctrl_amd
8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 8-edge rtc0
9: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 9-fasteoi acpi
26: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IOMMU-MSI 0-edge AMD-Vi
48: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 370 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524288-edge nvme0q0
49: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 100835 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524290-edge nvme0q2
52: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815746-edge ahci2
53: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815747-edge ahci3
66: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 290959 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524291-edge nvme0q3
67: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340032-edge ahci0
68: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340033-edge ahci1
71: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340036-edge ahci4
72: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340037-edge ahci5
83: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 53408 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524289-edge nvme0q1
84: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 37806 0 0 0 0 0 0 0 0 IR-PCI-MSI 524292-edge nvme0q4
85: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18781 0 0 0 0 0 0 IR-PCI-MSI 524293-edge nvme0q5
86: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7536 0 0 0 0 IR-PCI-MSI 524294-edge nvme0q6
87: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3147 0 0 IR-PCI-MSI 524295-edge nvme0q7
88: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 27767 IR-PCI-MSI 524296-edge nvme0q8
89: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 370 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097152-edge nvme1q0
90: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 53561 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097153-edge nvme1q1
91: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 100481 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097154-edge nvme1q2
92: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 291353 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097155-edge nvme1q3
93: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 370 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621440-edge nvme2q0
94: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 38017 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097156-edge nvme1q4
95: 0 53607 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621441-edge nvme2q1
96: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18944 0 0 0 0 0 0 0 IR-PCI-MSI 2097157-edge nvme1q5
97: 0 0 0 100608 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621442-edge nvme2q2
98: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7632 0 0 0 0 0 IR-PCI-MSI 2097158-edge nvme1q6
99: 0 0 0 0 0 290520 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621443-edge nvme2q3
100: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3080 0 0 0 IR-PCI-MSI 2097159-edge nvme1q7
101: 0 0 0 0 0 0 0 38082 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621444-edge nvme2q4
102: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 27880 0 IR-PCI-MSI 2097160-edge nvme1q8
103: 0 0 0 0 0 0 0 0 0 18752 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621445-edge nvme2q5
104: 0 0 0 0 0 0 0 0 0 0 0 7524 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621446-edge nvme2q6
105: 0 0 0 0 0 0 0 0 0 0 0 0 0 3197 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621447-edge nvme2q7
106: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28110 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621448-edge nvme2q8
107: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 72 0 0 0 0 0 0 0 0 IR-PCI-MSI 6293504-edge xhci_hcd
108: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2192 0 0 0 0 0 0 0 IR-PCI-MSI 6297600-edge xhci_hcd
109: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297601-edge xhci_hcd
110: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297602-edge xhci_hcd
111: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297603-edge xhci_hcd
112: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297604-edge xhci_hcd
113: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297605-edge xhci_hcd
114: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297606-edge xhci_hcd
115: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297607-edge xhci_hcd
117: 70244 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967616-edge xhci_hcd
118: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967617-edge xhci_hcd
119: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967618-edge xhci_hcd
120: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967619-edge xhci_hcd
121: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967620-edge xhci_hcd
122: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967621-edge xhci_hcd
123: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967622-edge xhci_hcd
124: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967623-edge xhci_hcd
125: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242880-edge enp10s0
126: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3977 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242881-edge enp10s0-rx-0
127: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2269 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242882-edge enp10s0-rx-1
128: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2852 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242883-edge enp10s0-tx-0
129: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4445 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242884-edge enp10s0-tx-1
135: 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718592-edge iwlwifi: default queue
136: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718593-edge iwlwifi: queue 1
137: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718594-edge iwlwifi: queue 2
138: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718595-edge iwlwifi: queue 3
139: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718596-edge iwlwifi: queue 4
140: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718597-edge iwlwifi: queue 5
141: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718598-edge iwlwifi: queue 6
142: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718599-edge iwlwifi: queue 7
143: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718600-edge iwlwifi: queue 8
144: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718601-edge iwlwifi: queue 9
145: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718602-edge iwlwifi: queue 10
146: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718603-edge iwlwifi: queue 11
147: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718604-edge iwlwifi: queue 12
148: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718605-edge iwlwifi: queue 13
149: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718606-edge iwlwifi: queue 14
150: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 IR-PCI-MSI 4718607-edge iwlwifi: exception
151: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 566 0 0 0 0 0 0 IR-PCI-MSI 4196352-edge snd_hda_intel:card0
153: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1107 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9969664-edge snd_hda_intel:card1
154: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 28650 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4194304-edge amdgpu
NMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 127049 47128 23023 23516 3846 12440 3497 2291 3086 1875 1905 3282 2200 2482 2012 1785 20347 15339 22835 15886 4771 6995 4808 2991 2591 3620 2469 1801 2179 2113 2568 2567 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Performance monitoring interrupts
IWI: 1 0 0 0 20893 6191 234 145 1413 215 339 183 168 226 209 196 0 0 0 0 25013 4420 295 132 225 209 424 149 160 296 182 164 IRQ work interrupts
RTR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 APIC ICR read retries
RES: 19778 61832 38526 65101 78682 342981 12402 17823 14416 10559 9868 9545 7408 12787 11250 13646 25593 51648 38493 53405 62139 89711 68392 29489 15446 14657 16911 8151 10760 9515 15772 9940 Rescheduling interrupts
CAL: 29134 48029 42857 42681 55166 77646 40022 40187 41325 41439 40560 48135 46632 47253 45107 41793 42044 40276 45371 42420 44401 43766 39073 39958 43568 54445 43831 46862 40169 44441 42541 45571 Function call interrupts
TLB: 9220 11921 10333 11688 26406 49807 10888 9889 9944 8771 9302 10266 11534 11216 11010 7932 14106 10715 11364 9300 10292 12790 9003 11113 13773 53945 9855 10395 14056 12002 8923 11980 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Threshold APIC interrupts
DFR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Deferred Error APIC interrupts
MCE: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Machine check exceptions
MCP: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Machine check polls
ERR: 0
MIS: 0
PIN: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt notification event
NPI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Nested posted-interrupt event
PIW: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt wakeup event
Raw
interrupts-poll-4-queues.txt
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31
0: 37 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 2-edge timer
7: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 7-fasteoi pinctrl_amd
8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 8-edge rtc0
9: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 9-fasteoi acpi
26: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IOMMU-MSI 0-edge AMD-Vi
48: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 824 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524288-edge nvme0q0
49: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 37671 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524289-edge nvme0q1
52: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815746-edge ahci2
53: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815747-edge ahci3
66: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 65806 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524290-edge nvme0q2
67: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340032-edge ahci0
68: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340033-edge ahci1
71: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340036-edge ahci4
72: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340037-edge ahci5
83: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 213643 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524291-edge nvme0q3
84: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 157722 0 0 0 0 0 0 0 0 IR-PCI-MSI 524292-edge nvme0q4
85: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3960 0 0 0 0 0 0 IR-PCI-MSI 524293-edge nvme0q5
86: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12300 0 0 0 0 IR-PCI-MSI 524294-edge nvme0q6
87: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 17298 0 0 IR-PCI-MSI 524295-edge nvme0q7
88: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7791 IR-PCI-MSI 524296-edge nvme0q8
89: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 824 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621440-edge nvme2q0
90: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 824 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097152-edge nvme1q0
91: 0 37651 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621441-edge nvme2q1
92: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 37611 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097153-edge nvme1q1
93: 0 0 0 65980 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621442-edge nvme2q2
94: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 66087 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097154-edge nvme1q2
95: 0 0 0 0 0 212943 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621443-edge nvme2q3
96: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 212339 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097155-edge nvme1q3
97: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 157186 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097156-edge nvme1q4
98: 0 0 0 0 0 0 0 156917 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621444-edge nvme2q4
99: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3736 0 0 0 0 0 0 0 IR-PCI-MSI 2097157-edge nvme1q5
100: 0 0 0 0 0 0 0 0 0 3793 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621445-edge nvme2q5
101: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12254 0 0 0 0 0 IR-PCI-MSI 2097158-edge nvme1q6
102: 0 0 0 0 0 0 0 0 0 0 0 11974 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621446-edge nvme2q6
103: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 17327 0 0 0 IR-PCI-MSI 2097159-edge nvme1q7
104: 0 0 0 0 0 0 0 0 0 0 0 0 0 17329 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621447-edge nvme2q7
105: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7791 0 IR-PCI-MSI 2097160-edge nvme1q8
106: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7645 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621448-edge nvme2q8
107: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 73 0 0 0 0 0 0 0 0 IR-PCI-MSI 6293504-edge xhci_hcd
108: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2899 0 0 0 0 0 0 0 IR-PCI-MSI 6297600-edge xhci_hcd
109: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297601-edge xhci_hcd
110: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297602-edge xhci_hcd
111: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297603-edge xhci_hcd
112: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297604-edge xhci_hcd
113: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297605-edge xhci_hcd
114: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297606-edge xhci_hcd
115: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297607-edge xhci_hcd
117: 79035 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967616-edge xhci_hcd
118: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967617-edge xhci_hcd
119: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967618-edge xhci_hcd
120: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967619-edge xhci_hcd
121: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967620-edge xhci_hcd
122: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967621-edge xhci_hcd
123: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967622-edge xhci_hcd
124: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967623-edge xhci_hcd
128: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242880-edge enp10s0
129: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 5087 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242881-edge enp10s0-rx-0
130: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2712 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242882-edge enp10s0-rx-1
131: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3389 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242883-edge enp10s0-tx-0
132: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4690 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242884-edge enp10s0-tx-1
135: 0 0 0 0 0 0 0 0 0 575 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4196352-edge snd_hda_intel:card0
137: 0 0 0 0 0 0 0 0 0 0 1306 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9969664-edge snd_hda_intel:card1
138: 0 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718592-edge iwlwifi: default queue
139: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718593-edge iwlwifi: queue 1
140: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718594-edge iwlwifi: queue 2
141: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718595-edge iwlwifi: queue 3
142: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718596-edge iwlwifi: queue 4
143: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718597-edge iwlwifi: queue 5
144: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718598-edge iwlwifi: queue 6
145: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718599-edge iwlwifi: queue 7
146: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718600-edge iwlwifi: queue 8
147: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718601-edge iwlwifi: queue 9
148: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718602-edge iwlwifi: queue 10
149: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718603-edge iwlwifi: queue 11
150: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718604-edge iwlwifi: queue 12
151: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718605-edge iwlwifi: queue 13
152: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718606-edge iwlwifi: queue 14
153: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 IR-PCI-MSI 4718607-edge iwlwifi: exception
154: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 55847 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4194304-edge amdgpu
NMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 259813 48676 24285 30810 5377 4895 8668 4789 2236 2411 2228 2856 2347 2349 1792 2159 51342 23836 30549 25957 12766 6316 4823 3195 3062 2031 2402 2719 3246 2311 2125 2282 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Performance monitoring interrupts
IWI: 0 0 0 0 11080 5384 263 224 159 349 171 272 259 171 413 249 0 0 0 0 17041 7514 379 135 224 185 198 160 233 122 249 207 IRQ work interrupts
RTR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 APIC ICR read retries
RES: 18892 60205 43961 67494 83531 69624 301388 56487 8192 8011 10979 9375 11113 16428 11970 7863 37083 31829 35420 34046 168077 112160 51917 23674 13686 15442 14732 12517 15148 15480 12973 7341 Rescheduling interrupts
CAL: 31123 68301 61274 65608 95995 60880 55637 53203 58060 58869 53493 54632 55899 52029 51460 57862 61280 57914 54986 54845 54998 56744 54768 53591 57412 57475 58581 61081 63574 69835 59216 55666 Function call interrupts
TLB: 8505 8690 12740 14806 52454 17168 14301 9470 57058 13091 10305 10603 11531 10996 7127 9041 9761 11568 10013 7255 8331 12693 11524 7373 9472 13077 12985 9757 13937 20591 10776 8944 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Threshold APIC interrupts
DFR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Deferred Error APIC interrupts
MCE: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Machine check exceptions
MCP: 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 Machine check polls
ERR: 0
MIS: 0
PIN: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt notification event
NPI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Nested posted-interrupt event
PIW: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt wakeup event
Raw
interrupts-poll-8-queues.txt
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CPU25 CPU26 CPU27 CPU28 CPU29 CPU30 CPU31
0: 37 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 2-edge timer
7: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 7-fasteoi pinctrl_amd
8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 8-edge rtc0
9: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-IO-APIC 9-fasteoi acpi
26: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IOMMU-MSI 0-edge AMD-Vi
48: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 344 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524288-edge nvme0q0
49: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 22586 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524289-edge nvme0q1
52: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815746-edge ahci2
53: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6815747-edge ahci3
66: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 344 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097152-edge nvme1q0
67: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340032-edge ahci0
68: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340033-edge ahci1
71: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340036-edge ahci4
72: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 7340037-edge ahci5
83: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 76272 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524290-edge nvme0q2
84: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 22578 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097153-edge nvme1q1
85: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 73254 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 524291-edge nvme0q3
86: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 344 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621440-edge nvme2q0
87: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 76404 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097154-edge nvme1q2
88: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30440 0 0 0 0 0 0 0 0 IR-PCI-MSI 524292-edge nvme0q4
89: 0 22671 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621441-edge nvme2q1
90: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 73232 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097155-edge nvme1q3
91: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 19751 0 0 0 0 0 0 IR-PCI-MSI 524293-edge nvme0q5
92: 0 0 0 76357 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621442-edge nvme2q2
93: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 30694 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2097156-edge nvme1q4
94: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 76290 0 0 0 0 IR-PCI-MSI 524294-edge nvme0q6
95: 0 0 0 0 0 72842 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621443-edge nvme2q3
96: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 19814 0 0 0 0 0 0 0 IR-PCI-MSI 2097157-edge nvme1q5
97: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 50395 0 0 IR-PCI-MSI 524295-edge nvme0q7
98: 0 0 0 0 0 0 0 30825 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621444-edge nvme2q4
99: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 76443 0 0 0 0 0 IR-PCI-MSI 2097158-edge nvme1q6
100: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 189777 IR-PCI-MSI 524296-edge nvme0q8
101: 0 0 0 0 0 0 0 0 0 19833 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621445-edge nvme2q5
102: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 50943 0 0 0 IR-PCI-MSI 2097159-edge nvme1q7
103: 0 0 0 0 0 0 0 0 0 0 0 75677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621446-edge nvme2q6
104: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 190333 0 IR-PCI-MSI 2097160-edge nvme1q8
105: 0 0 0 0 0 0 0 0 0 0 0 0 0 49782 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621447-edge nvme2q7
106: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 189376 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 2621448-edge nvme2q8
107: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 73 0 0 0 0 0 0 0 0 IR-PCI-MSI 6293504-edge xhci_hcd
108: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2215 0 0 0 0 0 0 0 IR-PCI-MSI 6297600-edge xhci_hcd
109: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297601-edge xhci_hcd
110: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297602-edge xhci_hcd
111: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297603-edge xhci_hcd
112: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297604-edge xhci_hcd
113: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297605-edge xhci_hcd
114: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297606-edge xhci_hcd
115: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 6297607-edge xhci_hcd
117: 65313 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967616-edge xhci_hcd
118: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967617-edge xhci_hcd
119: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967618-edge xhci_hcd
120: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967619-edge xhci_hcd
121: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967620-edge xhci_hcd
122: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967621-edge xhci_hcd
123: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967622-edge xhci_hcd
124: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9967623-edge xhci_hcd
128: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242880-edge enp10s0
129: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2927 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242881-edge enp10s0-rx-0
130: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3188 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242882-edge enp10s0-rx-1
131: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 4473 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242883-edge enp10s0-tx-0
132: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2802 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 5242884-edge enp10s0-tx-1
135: 0 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718592-edge iwlwifi: default queue
136: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718593-edge iwlwifi: queue 1
137: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718594-edge iwlwifi: queue 2
138: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718595-edge iwlwifi: queue 3
139: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718596-edge iwlwifi: queue 4
140: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718597-edge iwlwifi: queue 5
141: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718598-edge iwlwifi: queue 6
142: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718599-edge iwlwifi: queue 7
143: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718600-edge iwlwifi: queue 8
144: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718601-edge iwlwifi: queue 9
145: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718602-edge iwlwifi: queue 10
146: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718603-edge iwlwifi: queue 11
147: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718604-edge iwlwifi: queue 12
148: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718605-edge iwlwifi: queue 13
149: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4718606-edge iwlwifi: queue 14
150: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 IR-PCI-MSI 4718607-edge iwlwifi: exception
151: 0 0 0 0 0 0 0 0 0 575 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4196352-edge snd_hda_intel:card0
153: 0 0 0 0 0 0 0 0 0 0 0 1363 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 9969664-edge snd_hda_intel:card1
154: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 25173 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 IR-PCI-MSI 4194304-edge amdgpu
NMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Non-maskable interrupts
LOC: 128422 40821 31483 21325 3253 4596 3671 3369 2286 2953 2093 2948 2690 2083 1568 6011 33850 12150 13942 15752 3120 2983 2751 2417 2861 2652 3614 4034 3144 2992 4015 7273 Local timer interrupts
SPU: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Spurious interrupts
PMI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Performance monitoring interrupts
IWI: 0 1 0 0 9561 15920 201 6901 189 178 142 172 150 232 203 258 0 0 0 0 22377 14387 187 14400 149 154 142 141 169 162 202 378 IRQ work interrupts
RTR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 APIC ICR read retries
RES: 15939 34396 32705 33838 41695 38650 12343 31533 13039 9147 11147 25242 22160 13544 11799 135965 20605 25288 32309 43817 44293 28678 10660 34514 8791 20880 60021 85286 9899 36738 77659 180267 Rescheduling interrupts
CAL: 31356 51096 40176 40814 38042 40202 64068 40865 43346 44128 42083 44840 41285 42155 40599 39491 39811 44359 40798 42770 39846 39511 38902 43374 40849 39305 39557 42015 71111 82037 46792 49400 Function call interrupts
TLB: 9919 11503 10575 8313 9189 7277 79468 13467 8617 11714 12309 9893 10043 9103 14064 8326 10997 8874 10999 11391 8239 8209 11809 10680 10105 9724 9564 13798 37484 50007 8331 11568 TLB shootdowns
TRM: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Thermal event interrupts
THR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Threshold APIC interrupts
DFR: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Deferred Error APIC interrupts
MCE: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Machine check exceptions
MCP: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Machine check polls
ERR: 0
MIS: 0
PIN: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt notification event
NPI: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Nested posted-interrupt event
PIW: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Posted-interrupt wakeup event
@Hubro
Copy link
Author

Hubro commented May 14, 2021

I wrote a script to count NVMe interrupts:

import sys
import re


def main():
    total_interrupts = 0
    text = sys.stdin.read()

    lines = list(text.splitlines())

    # Ignore header
    lines = lines[1:]

    for line in lines:
        if "nvme" not in line:
            continue

        # Ignore first column
        line = line[10:]

        tokens = re.split(r"\s+", line)

        for token in tokens:
            try:
                total_interrupts += int(token)
            except ValueError:
                pass

    print("Total NVME interrupts:", total_interrupts)


main()

The results were:

  • Interrupt mode: 1324876 interrupts
  • Poll mode (4 queues): 1547226 interrupts
  • Poll mode (8 queues): 1617601 interrupts
  • Poll mode (16 queues): 1684839 interrupts
  • Poll mode (32 queues): 1622697 interrupts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment