FIO 4K vs 64K throughput

FIOnotes.txt

FIO 4K vs 64K file size throughput.  64K and 512K file counts.  Loopback NFS mount on single node cluster.  fio and NFS/MFS on same machine.  16 threads in fio client.
 
rm smallFiles.*; fio --name=smallFiles --numjobs=16 --nrfiles=$[8*8] --filesize=4K --bs=4k --thread=1 --direct=1 --rw=write > fio-smallFiles-64x4K-16T-nfs-mfs.log
rm smallFiles.*; fio --name=smallFiles --numjobs=16 --nrfiles=$[8*8*8] --filesize=4K --bs=4k --thread=1 --direct=1 --rw=write > fio-smallFiles-512x4K-16T-nfs-mfs.log

rm smallFiles.*; fio --name=smallFiles --numjobs=16 --nrfiles=$[8*8*8] --filesize=64K --bs=4k --thread=1 --direct=1 --rw=write > fio-smallFiles-512x64K-16T-nfs-mfs.log
rm smallFiles.*; fio --name=smallFiles --numjobs=16 --nrfiles=$[8*8] --filesize=64K --bs=4k --thread=1 --direct=1 --rw=write > fio-smallFiles-64x64K-16T-nfs-mfs.log

==> fio-smallFiles-512x4K-16T-nfs-mfs.log <==

Run status group 0 (all jobs):
  WRITE: io=32768KB, aggrb=12158KB/s, minb=759KB/s, maxb=778KB/s, mint=2630msec, maxt=2695msec

==> fio-smallFiles-512x64K-16T-nfs-mfs.log <==

Run status group 0 (all jobs):
  WRITE: io=524288KB, aggrb=38647KB/s, minb=2415KB/s, maxb=2440KB/s, mint=13427msec, maxt=13566msec


64Kx64K:
Run status group 0 (all jobs):
  WRITE: io=65536KB, aggrb=46380KB/s, minb=2898KB/s, maxb=2970KB/s, mint=1379msec, maxt=1413msec

64Kx64K without --direct=1 (kernel buffering):

Run status group 0 (all jobs):
  WRITE: io=65536KB, aggrb=171560KB/s, minb=10722KB/s, maxb=15693KB/s, mint=261msec, maxt=382msec

root@psnode40 zsh#0 fio --name=smallFiles --numjobs=16 --nrfiles=$[8*8] --filesize=64K --bs=4k --thread=1 --rw=write