Skip to content

Instantly share code, notes, and snippets.

@jage
Forked from nicwi/iozone.md
Last active August 29, 2015 14:03
Show Gist options
  • Save jage/0d45a997450ffe6a06ef to your computer and use it in GitHub Desktop.
Save jage/0d45a997450ffe6a06ef to your computer and use it in GitHub Desktop.

iozone: marv vs hild vs Storm SSD

  • marv: MacBook Air 11-inch, Mid 2013 (256 GB APPLE SSD SM0256F)
  • hild: Supermicro SuperServer 2027TR-H72RF+ (6x Samsung 840 Pro, HW RAID10)
  • Storm SSD
$ iozone -l 32 -O -i 0 -i 1 -i 2 -e -+n -r 4K -s 4G

    Iozone: Performance Test of File I/O
            Version $Revision: 3.413 $
            Compiled for 64 bit mode.
            Build: macosx

    Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                 Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                 Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                 Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                 Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                 Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                 Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer.
                 Ben England.

    Run began: Tue Aug 27 23:16:11 2013

    OPS Mode. Output is in operations per second.
    Include fsync in write timing
    No retest option selected
    Record Size 4 KB
    File size set to 4194304 KB
    Command line used: iozone -l 32 -O -i 0 -i 1 -i 2 -e -+n -r 4K -s 4G
    Time Resolution = 0.000001 seconds.
    Processor cache size set to 1024 Kbytes.
    Processor cache line size set to 32 bytes.
    File stride size set to 17 * record size.
    Min process = 32
    Max process = 32
    Throughput test with 32 processes
    Each process writes a 4194304 Kbyte file in 4 Kbyte records

marv

    Children see throughput for 32 initial writers  =  143590.09 ops/sec
    Parent sees throughput for 32 initial writers   =  139070.90 ops/sec
    Min throughput per process                      =    4382.16 ops/sec
    Max throughput per process                      =    4623.34 ops/sec
    Avg throughput per process                      =    4487.19 ops/sec
    Min xfer                                        =  993717.00 ops

    Children see throughput for 32 readers          =  191133.57 ops/sec
    Parent sees throughput for 32 readers           =  190986.70 ops/sec
    Min throughput per process                      =    5830.28 ops/sec
    Max throughput per process                      =    6209.41 ops/sec
    Avg throughput per process                      =    5972.92 ops/sec
    Min xfer                                        =  984575.00 ops

    Children see throughput for 32 random readers   =   40193.81 ops/sec
    Parent sees throughput for 32 random readers    =   40173.70 ops/sec
    Min throughput per process                      =    1250.96 ops/sec
    Max throughput per process                      =    1261.16 ops/sec
    Avg throughput per process                      =    1256.06 ops/sec
    Min xfer                                        = 1040136.00 ops

    Children see throughput for 32 random writers   =   32946.70 ops/sec
    Parent sees throughput for 32 random writers    =   31585.71 ops/sec
    Min throughput per process                      =    1001.99 ops/sec
    Max throughput per process                      =    1068.77 ops/sec
    Avg throughput per process                      =    1029.58 ops/sec
    Min xfer                                        =  984853.00 ops

hild

    Children see throughput for 32 initial writers  =   12285.57 ops/sec
    Parent sees throughput for 32 initial writers   =    1048.07 ops/sec
    Min throughput per process                      =     338.85 ops/sec
    Max throughput per process                      =     748.68 ops/sec
    Avg throughput per process                      =     383.92 ops/sec
    Min xfer                                        =  133745.00 ops

    Children see throughput for 32 readers          = 1059311.75 ops/sec
    Parent sees throughput for 32 readers           = 1059005.89 ops/sec
    Min throughput per process                      =    8649.47 ops/sec
    Max throughput per process                      =   54769.31 ops/sec
    Avg throughput per process                      =   33103.49 ops/sec
    Min xfer                                        =  165629.00 ops

    Children see throughput for 32 random readers   = 7235766.41 ops/sec
    Parent sees throughput for 32 random readers    = 7206898.49 ops/sec
    Min throughput per process                      =    2640.76 ops/sec
    Max throughput per process                      =  649978.50 ops/sec
    Avg throughput per process                      =  226117.70 ops/sec
    Min xfer                                        =    4259.00 ops

    Children see throughput for 32 random writers   =    4318.77 ops/sec
    Parent sees throughput for 32 random writers    =    3950.61 ops/sec
    Min throughput per process                      =     122.19 ops/sec
    Max throughput per process                      =     151.62 ops/sec
    Avg throughput per process                      =     134.96 ops/sec
    Min xfer                                        =  990003.00 ops

Idril 843

    Children see throughput for 32 initial writers  =   85204.82 ops/sec
	Parent sees throughput for 32 initial writers   =   65652.99 ops/sec
	Min throughput per process                      =    2524.38 ops/sec 
	Max throughput per process                      =    2964.75 ops/sec
	Avg throughput per process                      =    2662.65 ops/sec
	Min xfer                                        =  758637.00 ops

	Children see throughput for 32 readers          =  329834.15 ops/sec
	Parent sees throughput for 32 readers           =  329720.62 ops/sec
	Min throughput per process                      =    3084.66 ops/sec 
	Max throughput per process                      =   34517.88 ops/sec
	Avg throughput per process                      =   10307.32 ops/sec
	Min xfer                                        =   93725.00 ops

	Children see throughput for 32 random readers   = 5767889.13 ops/sec
	Parent sees throughput for 32 random readers    = 5735259.62 ops/sec
	Min throughput per process                      =    8692.42 ops/sec 
	Max throughput per process                      =  556682.12 ops/sec
	Avg throughput per process                      =  180246.54 ops/sec
	Min xfer                                        =   16360.00 ops

	Children see throughput for 32 random writers   =   59533.00 ops/sec
	Parent sees throughput for 32 random writers    =   54550.09 ops/sec
	Min throughput per process                      =    1692.37 ops/sec 
	Max throughput per process                      =    2057.99 ops/sec
	Avg throughput per process                      =    1860.41 ops/sec
	Min xfer                                        =  995572.00 ops

Bergil 843

	Children see throughput for 32 initial writers  =   94161.98 ops/sec
	Parent sees throughput for 32 initial writers   =   63549.00 ops/sec
	Min throughput per process                      =    2698.27 ops/sec 
	Max throughput per process                      =    3710.76 ops/sec
	Avg throughput per process                      =    2942.56 ops/sec
	Min xfer                                        =  679320.00 ops

	Children see throughput for 32 readers          =  138496.73 ops/sec
	Parent sees throughput for 32 readers           =  138460.01 ops/sec
	Min throughput per process                      =    2986.22 ops/sec 
	Max throughput per process                      =   23521.30 ops/sec
	Avg throughput per process                      =    4328.02 ops/sec
	Min xfer                                        =  133175.00 ops

	Children see throughput for 32 random readers   = 3773636.41 ops/sec
	Parent sees throughput for 32 random readers    = 3754281.80 ops/sec
	Min throughput per process                      =    4544.63 ops/sec 
	Max throughput per process                      =  649926.94 ops/sec
	Avg throughput per process                      =  117926.14 ops/sec
	Min xfer                                        =    7335.00 ops

	Children see throughput for 32 random writers   =   53171.53 ops/sec
	Parent sees throughput for 32 random writers    =   47607.39 ops/sec
	Min throughput per process                      =    1490.37 ops/sec 
	Max throughput per process                      =    1905.16 ops/sec
	Avg throughput per process                      =    1661.61 ops/sec
	Min xfer                                        =  965965.00 ops

Bergil 840 no OP

	Children see throughput for 32 initial writers  =   10779.38 ops/sec
	Parent sees throughput for 32 initial writers   =    4985.56 ops/sec
	Min throughput per process                      =     277.11 ops/sec 
	Max throughput per process                      =     654.01 ops/sec
	Avg throughput per process                      =     336.86 ops/sec
	Min xfer                                        =  304593.00 ops

	Children see throughput for 32 readers          =  265117.60 ops/sec
	Parent sees throughput for 32 readers           =  264930.12 ops/sec
	Min throughput per process                      =    1657.76 ops/sec 
	Max throughput per process                      =   43659.64 ops/sec
	Avg throughput per process                      =    8284.93 ops/sec
	Min xfer                                        =   39837.00 ops

	Children see throughput for 32 random readers   = 5286068.43 ops/sec
	Parent sees throughput for 32 random readers    = 5263616.89 ops/sec
	Min throughput per process                      =    4268.17 ops/sec 
	Max throughput per process                      =  679917.31 ops/sec
	Avg throughput per process                      =  165189.64 ops/sec
	Min xfer                                        =    6584.00 ops

	Children see throughput for 32 random writers   =   10238.72 ops/sec
	Parent sees throughput for 32 random writers    =    9478.82 ops/sec
	Min throughput per process                      =     295.26 ops/sec 
	Max throughput per process                      =     366.57 ops/sec
	Avg throughput per process                      =     319.96 ops/sec
	Min xfer                                        =  961650.00 ops

Bergil 840 OP

	Children see throughput for 32 initial writers  =    9710.91 ops/sec
	Parent sees throughput for 32 initial writers   =    7097.62 ops/sec
	Min throughput per process                      =     286.54 ops/sec 
	Max throughput per process                      =     367.29 ops/sec
	Avg throughput per process                      =     303.47 ops/sec
	Min xfer                                        =  630173.00 ops

	Children see throughput for 32 readers          =   82105.54 ops/sec
	Parent sees throughput for 32 readers           =   82085.51 ops/sec
	Min throughput per process                      =    1845.22 ops/sec 
	Max throughput per process                      =   24826.34 ops/sec
	Avg throughput per process                      =    2565.80 ops/sec
	Min xfer                                        =   77949.00 ops

	Children see throughput for 32 random readers   = 2028186.97 ops/sec
	Parent sees throughput for 32 random readers    = 2017743.36 ops/sec
	Min throughput per process                      =    4541.70 ops/sec 
	Max throughput per process                      =  698997.00 ops/sec
	Avg throughput per process                      =   63380.84 ops/sec
	Min xfer                                        =    6818.00 ops

	Children see throughput for 32 random writers   =   12292.04 ops/sec
	Parent sees throughput for 32 random writers    =   11463.23 ops/sec
	Min throughput per process                      =     353.31 ops/sec 
	Max throughput per process                      =     435.18 ops/sec
	Avg throughput per process                      =     384.13 ops/sec
	Min xfer                                        =  976903.00 ops

Elrond 843

	Children see throughput for 32 initial writers  =   86918.90 ops/sec
	Parent sees throughput for 32 initial writers   =   80014.39 ops/sec
	Min throughput per process                      =    2429.12 ops/sec
	Max throughput per process                      =    3209.43 ops/sec
	Avg throughput per process                      =    2716.22 ops/sec
	Min xfer                                        =  952219.00 ops

	Children see throughput for 32 readers          =   83649.97 ops/sec
	Parent sees throughput for 32 readers           =   83628.73 ops/sec
	Min throughput per process                      =    2517.47 ops/sec
	Max throughput per process                      =    2891.15 ops/sec
	Avg throughput per process                      =    2614.06 ops/sec
	Min xfer                                        =  913091.00 ops

	Children see throughput for 32 random readers   =  104777.12 ops/sec
	Parent sees throughput for 32 random readers    =  104721.68 ops/sec
	Min throughput per process                      =    3100.49 ops/sec
	Max throughput per process                      =    3623.04 ops/sec
	Avg throughput per process                      =    3274.28 ops/sec
	Min xfer                                        =  897388.00 ops

	Children see throughput for 32 random writers   =   60598.27 ops/sec
	Parent sees throughput for 32 random writers    =   52283.50 ops/sec
	Min throughput per process                      =    1621.41 ops/sec
	Max throughput per process                      =    2176.43 ops/sec
	Avg throughput per process                      =    1893.70 ops/sec
	Min xfer                                        =  838073.00 ops

Aragorn Intel 320

Children see throughput for 32 initial writers  =   44074.41 ops/sec
Parent sees throughput for 32 initial writers   =   40365.90 ops/sec
Min throughput per process                      =    1236.41 ops/sec
Max throughput per process                      =    1835.48 ops/sec
Avg throughput per process                      =    1377.33 ops/sec
Min xfer                                        = 1012850.00 ops

Children see throughput for 32 readers          =  334566.64 ops/sec
Parent sees throughput for 32 readers           =  334235.03 ops/sec
Min throughput per process                      =    8183.73 ops/sec
Max throughput per process                      =   12553.96 ops/sec
Avg throughput per process                      =   10455.21 ops/sec
Min xfer                                        =  683585.00 ops

Children see throughput for 32 random readers   =  175114.73 ops/sec
Parent sees throughput for 32 random readers    =  174989.52 ops/sec
Min throughput per process                      =    3951.14 ops/sec
Max throughput per process                      =    6103.68 ops/sec
Avg throughput per process                      =    5472.34 ops/sec
Min xfer                                        =  678781.00 ops

Children see throughput for 32 random writers   =   10197.30 ops/sec
Parent sees throughput for 32 random writers    =    9444.54 ops/sec
Min throughput per process                      =     308.38 ops/sec
Max throughput per process                      =     326.66 ops/sec
Avg throughput per process                      =     318.67 ops/sec
Min xfer                                        =  993096.00 ops

Aragorn 840 Pro 128Gb

Children see throughput for 32 initial writers  =    8274.67 ops/sec
Parent sees throughput for 32 initial writers   =    6945.82 ops/sec
Min throughput per process                      =     215.78 ops/sec
Max throughput per process                      =     378.72 ops/sec
Avg throughput per process                      =     258.58 ops/sec
Min xfer                                        =  257233.00 ops

Children see throughput for 32 readers          =  324715.19 ops/sec
Parent sees throughput for 32 readers           =  323774.54 ops/sec
Min throughput per process                      =    9988.75 ops/sec
Max throughput per process                      =   10336.27 ops/sec
Avg throughput per process                      =   10147.35 ops/sec
Min xfer                                        =  253331.00 ops

Children see throughput for 32 random readers   =  176899.78 ops/sec
Parent sees throughput for 32 random readers    =  176685.93 ops/sec
Min throughput per process                      =    5462.75 ops/sec
Max throughput per process                      =    5595.03 ops/sec
Avg throughput per process                      =    5528.12 ops/sec
Min xfer                                        =  255855.00 ops

Children see throughput for 32 random writers   =   11278.58 ops/sec
Parent sees throughput for 32 random writers    =    9364.47 ops/sec
Min throughput per process                      =     293.00 ops/sec
Max throughput per process                      =     527.19 ops/sec
Avg throughput per process                      =     352.46 ops/sec
Min xfer                                        =  257867.00 ops

Nora ZFS raidz1 5 x 512 GB 840 Pro

compression=lz4, recordsize=16k

Children see throughput for 32 initial writers  =   40538.57 ops/sec
Parent sees throughput for 32 initial writers   =   39586.75 ops/sec
Min throughput per process                      =    1241.48 ops/sec
Max throughput per process                      =    1298.02 ops/sec
Avg throughput per process                      =    1266.83 ops/sec
Min xfer                                        = 1003437.00 ops

Children see throughput for 32 readers          =  116512.33 ops/sec
Parent sees throughput for 32 readers           =  116510.26 ops/sec
Min throughput per process                      =    3492.23 ops/sec
Max throughput per process                      =    3828.08 ops/sec
Avg throughput per process                      =    3641.01 ops/sec
Min xfer                                        =  956585.00 ops

Children see throughput for 32 random readers   =   68942.77 ops/sec
Parent sees throughput for 32 random readers    =   68928.61 ops/sec
Min throughput per process                      =    2085.66 ops/sec
Max throughput per process                      =    2201.90 ops/sec
Avg throughput per process                      =    2154.46 ops/sec
Min xfer                                        =  993222.00 ops

Children see throughput for 32 random writers   =    1592.73 ops/sec
Parent sees throughput for 32 random writers    =    1584.97 ops/sec
Min throughput per process                      =      49.41 ops/sec
Max throughput per process                      =      50.12 ops/sec
Avg throughput per process                      =      49.77 ops/sec
Min xfer                                        = 1033710.00 ops

Tuor ZFS raidz1 5 x 512 GB 840 Pro

compression=lz4, recordsize=16k

Children see throughput for 32 initial writers  =   40172.26 ops/sec
Parent sees throughput for 32 initial writers   =   38351.14 ops/sec
Min throughput per process                      =    1228.58 ops/sec
Max throughput per process                      =    1314.12 ops/sec
Avg throughput per process                      =    1255.38 ops/sec
Min xfer                                        =  980321.00 ops

Children see throughput for 32 readers          =  114675.17 ops/sec
Parent sees throughput for 32 readers           =  114672.94 ops/sec
Min throughput per process                      =    3367.05 ops/sec
Max throughput per process                      =    3835.21 ops/sec
Avg throughput per process                      =    3583.60 ops/sec
Min xfer                                        =  920576.00 ops

Children see throughput for 32 random readers   =   68020.91 ops/sec
Parent sees throughput for 32 random readers    =   68006.74 ops/sec
Min throughput per process                      =    2052.61 ops/sec
Max throughput per process                      =    2162.73 ops/sec
Avg throughput per process                      =    2125.65 ops/sec
Min xfer                                        =  995186.00 ops

Children see throughput for 32 random writers   =    1662.60 ops/sec
Parent sees throughput for 32 random writers    =    1653.84 ops/sec
Min throughput per process                      =      51.64 ops/sec
Max throughput per process                      =      52.39 ops/sec
Avg throughput per process                      =      51.96 ops/sec
Min xfer                                        = 1033608.00 ops
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment