Skip to content

Instantly share code, notes, and snippets.

@Suave

Suave/big-seq-read-bs256k.fio

Last active November 21, 2018 05:08
Show Gist options
  • Save Suave/33200fc6661663968decbf9032ead728 to your computer and use it in GitHub Desktop.
Save Suave/33200fc6661663968decbf9032ead728 to your computer and use it in GitHub Desktop.
Download ZIP
大文件顺序读
Raw
big-seq-read-bs256k.fio
root@ip-172-31-40-223:~/benchmark# cat big-seq-read.fio
[global]
nrfiles=1
ioengine=libaio
bs=256K
size=2G
runtime=10s
time_based
group_reporting
new_group
stonewall
numjobs=1
rw=read
[256K]
filename=JuiceFS:bench-page-256k
[512K]
filename=JuiceFS:bench-page-512k
[1M]
filename=JuiceFS:bench-page-1m
[2M]
filename=JuiceFS:bench-page-2m
[4M]
filename=JuiceFS:bench-page-4m
root@ip-172-31-40-223:~/benchmark# fio big-seq-read.fio
256K: (g=0): rw=read, bs=256K-256K/256K-256K/256K-256K, ioengine=libaio, iodepth=1
512K: (g=1): rw=read, bs=256K-256K/256K-256K/256K-256K, ioengine=libaio, iodepth=1
1M: (g=2): rw=read, bs=256K-256K/256K-256K/256K-256K, ioengine=libaio, iodepth=1
2M: (g=3): rw=read, bs=256K-256K/256K-256K/256K-256K, ioengine=libaio, iodepth=1
4M: (g=4): rw=read, bs=256K-256K/256K-256K/256K-256K, ioengine=libaio, iodepth=1
fio-2.2.10
Starting 5 processes
Jobs: 1 (f=2): [_(4),R(1)] [96.3% done] [163.0MB/0KB/0KB /s] [652/0/0 iops] [eta 00m:02s]
256K: (groupid=0, jobs=1): err= 0: pid=46655: Wed Nov 21 05:05:11 2018
read : io=1777.0MB, bw=181947KB/s, iops=710, runt= 10001msec
slat (usec): min=67, max=7132, avg=1385.65, stdev=662.25
clat (usec): min=1, max=9, avg= 1.62, stdev= 0.56
lat (usec): min=69, max=7137, avg=1388.30, stdev=662.32
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 1], 40.00th=[ 1], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 3], 99.50th=[ 3], 99.90th=[ 5], 99.95th=[ 6],
| 99.99th=[ 9]
bw (KB /s): min=166578, max=329216, per=100.00%, avg=182893.84, stdev=41319.39
lat (usec) : 2=40.46%, 4=59.36%, 10=0.18%
cpu : usr=0.16%, sys=7.56%, ctx=6666, majf=0, minf=75
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=7108/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
512K: (groupid=1, jobs=1): err= 0: pid=46685: Wed Nov 21 05:05:11 2018
read : io=1681.0MB, bw=172117KB/s, iops=672, runt= 10001msec
slat (usec): min=69, max=9139, avg=1464.95, stdev=1027.54
clat (usec): min=1, max=5, avg= 1.48, stdev= 0.50
lat (usec): min=71, max=9141, avg=1467.24, stdev=1027.55
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 1], 40.00th=[ 1], 50.00th=[ 1], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 2], 99.50th=[ 2], 99.90th=[ 3], 99.95th=[ 3],
| 99.99th=[ 5]
bw (KB /s): min=162816, max=271360, per=100.00%, avg=172505.53, stdev=23962.06
lat (usec) : 2=51.68%, 4=48.27%, 10=0.04%
cpu : usr=0.00%, sys=6.84%, ctx=6064, majf=0, minf=74
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=6724/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
1M: (groupid=2, jobs=1): err= 0: pid=46693: Wed Nov 21 05:05:11 2018
read : io=1682.6MB, bw=172254KB/s, iops=672, runt= 10002msec
slat (usec): min=64, max=18826, avg=1464.43, stdev=1031.83
clat (usec): min=1, max=13, avg= 1.56, stdev= 0.55
lat (usec): min=66, max=18828, avg=1466.73, stdev=1031.85
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 1], 40.00th=[ 1], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 2], 99.50th=[ 2], 99.90th=[ 3], 99.95th=[ 6],
| 99.99th=[ 13]
bw (KB /s): min=166578, max=269796, per=100.00%, avg=172663.58, stdev=23524.25
lat (usec) : 2=44.74%, 4=55.19%, 10=0.03%, 20=0.04%
cpu : usr=0.00%, sys=6.80%, ctx=6125, majf=0, minf=75
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=6730/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
2M: (groupid=3, jobs=1): err= 0: pid=46702: Wed Nov 21 05:05:11 2018
read : io=1680.0MB, bw=171998KB/s, iops=671, runt= 10002msec
slat (usec): min=71, max=16124, avg=1467.67, stdev=1038.10
clat (usec): min=1, max=5, avg= 1.54, stdev= 0.50
lat (usec): min=73, max=16126, avg=1469.93, stdev=1038.13
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 1], 40.00th=[ 1], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 2], 99.50th=[ 2], 99.90th=[ 2], 99.95th=[ 3],
| 99.99th=[ 5]
bw (KB /s): min=161792, max=270278, per=100.00%, avg=172410.42, stdev=23735.75
lat (usec) : 2=45.77%, 4=54.18%, 10=0.04%
cpu : usr=0.16%, sys=6.64%, ctx=6082, majf=0, minf=74
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=6720/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
4M: (groupid=4, jobs=1): err= 0: pid=46710: Wed Nov 21 05:05:11 2018
read : io=1683.0MB, bw=172288KB/s, iops=672, runt= 10003msec
slat (usec): min=65, max=16842, avg=1464.64, stdev=990.06
clat (usec): min=1, max=15, avg= 1.48, stdev= 0.53
lat (usec): min=67, max=16847, avg=1466.86, stdev=990.11
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 1], 40.00th=[ 1], 50.00th=[ 1], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 2], 99.50th=[ 2], 99.90th=[ 2], 99.95th=[ 4],
| 99.99th=[ 15]
bw (KB /s): min=166912, max=267776, per=100.00%, avg=172754.58, stdev=23018.82
lat (usec) : 2=52.73%, 4=47.21%, 10=0.04%, 20=0.01%
cpu : usr=0.00%, sys=6.76%, ctx=6172, majf=0, minf=75
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=6732/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: io=1777.0MB, aggrb=181946KB/s, minb=181946KB/s, maxb=181946KB/s, mint=10001msec, maxt=10001msec
Run status group 1 (all jobs):
READ: io=1681.0MB, aggrb=172117KB/s, minb=172117KB/s, maxb=172117KB/s, mint=10001msec, maxt=10001msec
Run status group 2 (all jobs):
READ: io=1682.6MB, aggrb=172253KB/s, minb=172253KB/s, maxb=172253KB/s, mint=10002msec, maxt=10002msec
Run status group 3 (all jobs):
READ: io=1680.0MB, aggrb=171997KB/s, minb=171997KB/s, maxb=171997KB/s, mint=10002msec, maxt=10002msec
Run status group 4 (all jobs):
READ: io=1683.0MB, aggrb=172287KB/s, minb=172287KB/s, maxb=172287KB/s, mint=10003msec, maxt=10003msec
Disk stats (read/write):
xvda: ios=67946/50, merge=0/29, ticks=275760/448, in_queue=276212, util=96.37%
Raw
big-seq-read-bs4M.fio
root@ip-172-31-40-223:~/benchmark# cat big-seq-read.fio
[global]
nrfiles=1
ioengine=libaio
bs=4M
size=2G
runtime=10s
time_based
group_reporting
new_group
stonewall
numjobs=1
rw=read
[256K]
filename=JuiceFS:bench-page-256k
[512K]
filename=JuiceFS:bench-page-512k
[1M]
filename=JuiceFS:bench-page-1m
[2M]
filename=JuiceFS:bench-page-2m
[4M]
filename=JuiceFS:bench-page-4m
root@ip-172-31-40-223:~/benchmark# fio big-seq-read.fio
256K: (g=0): rw=read, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=1
512K: (g=1): rw=read, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=1
1M: (g=2): rw=read, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=1
2M: (g=3): rw=read, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=1
4M: (g=4): rw=read, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=1
fio-2.2.10
Starting 5 processes
256K: Laying out IO file(s) (1 file(s) / 1024MB)
512K: Laying out IO file(s) (1 file(s) / 1024MB)
1M: Laying out IO file(s) (1 file(s) / 1024MB)
2M: Laying out IO file(s) (1 file(s) / 1024MB)
Jobs: 1 (f=2): [_(4),R(1)] [96.3% done] [164.0MB/0KB/0KB /s] [41/0/0 iops] [eta 00m:02s]
256K: (groupid=0, jobs=1): err= 0: pid=45698: Wed Nov 21 04:55:05 2018
read : io=1668.0MB, bw=170701KB/s, iops=41, runt= 10006msec
slat (msec): min=9, max=30, avg=23.85, stdev= 3.05
clat (usec): min=1, max=12, avg= 2.65, stdev= 1.03
lat (msec): min=9, max=30, avg=23.85, stdev= 3.05
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 2], 10.00th=[ 2], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 3], 60.00th=[ 3],
| 70.00th=[ 3], 80.00th=[ 3], 90.00th=[ 3], 95.00th=[ 4],
| 99.00th=[ 5], 99.50th=[ 9], 99.90th=[ 12], 99.95th=[ 12],
| 99.99th=[ 12]
bw (KB /s): min=165734, max=236763, per=100.00%, avg=170915.79, stdev=15956.27
lat (usec) : 2=4.56%, 4=86.09%, 10=8.87%, 20=0.48%
cpu : usr=0.00%, sys=6.72%, ctx=5917, majf=0, minf=522
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=417/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
512K: (groupid=1, jobs=1): err= 0: pid=45726: Wed Nov 21 04:55:05 2018
read : io=1684.0MB, bw=172252KB/s, iops=42, runt= 10011msec
slat (msec): min=9, max=25, avg=23.64, stdev= 3.46
clat (usec): min=1, max=4, avg= 1.76, stdev= 0.46
lat (msec): min=9, max=25, avg=23.64, stdev= 3.46
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 1],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 2], 95.00th=[ 2],
| 99.00th=[ 3], 99.50th=[ 3], 99.90th=[ 4], 99.95th=[ 4],
| 99.99th=[ 4]
bw (KB /s): min=167346, max=269796, per=100.00%, avg=172738.11, stdev=23503.64
lat (usec) : 2=24.94%, 4=74.82%, 10=0.24%
cpu : usr=0.00%, sys=5.43%, ctx=5820, majf=0, minf=521
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=421/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
1M: (groupid=2, jobs=1): err= 0: pid=45735: Wed Nov 21 04:55:05 2018
read : io=1684.0MB, bw=172115KB/s, iops=42, runt= 10019msec
slat (msec): min=9, max=25, avg=23.66, stdev= 3.40
clat (usec): min=1, max=14, avg= 2.12, stdev= 1.09
lat (msec): min=9, max=25, avg=23.66, stdev= 3.40
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 2], 80.00th=[ 2], 90.00th=[ 3], 95.00th=[ 4],
| 99.00th=[ 5], 99.50th=[ 5], 99.90th=[ 14], 99.95th=[ 14],
| 99.99th=[ 14]
bw (KB /s): min=167021, max=266078, per=100.00%, avg=172508.21, stdev=22659.19
lat (usec) : 2=19.48%, 4=71.26%, 10=9.03%, 20=0.24%
cpu : usr=0.00%, sys=5.67%, ctx=5828, majf=0, minf=522
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=421/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
2M: (groupid=3, jobs=1): err= 0: pid=45751: Wed Nov 21 04:55:05 2018
read : io=1684.0MB, bw=172012KB/s, iops=41, runt= 10025msec
slat (msec): min=9, max=24, avg=23.68, stdev= 3.34
clat (usec): min=1, max=9, avg= 2.77, stdev= 1.37
lat (msec): min=9, max=24, avg=23.69, stdev= 3.34
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 3],
| 70.00th=[ 3], 80.00th=[ 4], 90.00th=[ 5], 95.00th=[ 5],
| 99.00th=[ 6], 99.50th=[ 7], 99.90th=[ 9], 99.95th=[ 9],
| 99.99th=[ 9]
bw (KB /s): min=167346, max=262462, per=100.00%, avg=172352.11, stdev=21821.11
lat (usec) : 2=11.16%, 4=61.28%, 10=27.55%
cpu : usr=0.00%, sys=6.19%, ctx=5823, majf=0, minf=521
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=421/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
4M: (groupid=4, jobs=1): err= 0: pid=45760: Wed Nov 21 04:55:05 2018
read : io=1680.0MB, bw=171929KB/s, iops=41, runt= 10006msec
slat (msec): min=9, max=37, avg=23.56, stdev= 3.54
clat (usec): min=1, max=10, avg= 2.48, stdev= 1.13
lat (msec): min=9, max=37, avg=23.57, stdev= 3.54
clat percentiles (usec):
| 1.00th=[ 1], 5.00th=[ 1], 10.00th=[ 1], 20.00th=[ 2],
| 30.00th=[ 2], 40.00th=[ 2], 50.00th=[ 2], 60.00th=[ 2],
| 70.00th=[ 3], 80.00th=[ 3], 90.00th=[ 4], 95.00th=[ 5],
| 99.00th=[ 5], 99.50th=[ 6], 99.90th=[ 10], 99.95th=[ 10],
| 99.99th=[ 10]
bw (KB /s): min=167021, max=245269, per=100.00%, avg=172327.79, stdev=18110.50
lat (usec) : 2=11.90%, 4=71.19%, 10=16.67%, 20=0.24%
cpu : usr=0.00%, sys=6.52%, ctx=5997, majf=0, minf=522
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=420/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=1
Run status group 0 (all jobs):
READ: io=1668.0MB, aggrb=170700KB/s, minb=170700KB/s, maxb=170700KB/s, mint=10006msec, maxt=10006msec
Run status group 1 (all jobs):
READ: io=1684.0MB, aggrb=172252KB/s, minb=172252KB/s, maxb=172252KB/s, mint=10011msec, maxt=10011msec
Run status group 2 (all jobs):
READ: io=1684.0MB, aggrb=172114KB/s, minb=172114KB/s, maxb=172114KB/s, mint=10019msec, maxt=10019msec
Run status group 3 (all jobs):
READ: io=1684.0MB, aggrb=172011KB/s, minb=172011KB/s, maxb=172011KB/s, mint=10025msec, maxt=10025msec
Run status group 4 (all jobs):
READ: io=1680.0MB, aggrb=171928KB/s, minb=171928KB/s, maxb=171928KB/s, mint=10006msec, maxt=10006msec
Disk stats (read/write):
xvda: ios=66988/18, merge=0/60, ticks=186492/32, in_queue=186508, util=96.76%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment