Created
March 18, 2019 12:30
-
-
Save fo40225/b95f5af631b992d1a099aad44a224896 to your computer and use it in GitHub Desktop.
8x Samsung 970 PRO 1TB mdadm raid0 test
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 8x 970pro 1tb | |
| SeqQ32T1read: (groupid=0, jobs=1): err= 0: pid=69405: Sat Mar 2 10:16:09 2019 | |
| read: IOPS=17.5k, BW=2186MiB/s (2292MB/s)(5120MiB/2342msec) | |
| clat (usec): min=53, max=2750, avg=56.51, stdev=37.14 | |
| lat (usec): min=53, max=2750, avg=56.60, stdev=37.14 | |
| clat percentiles (usec): | |
| | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | |
| | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 55], 60.00th=[ 55], | |
| | 70.00th=[ 56], 80.00th=[ 57], 90.00th=[ 59], 95.00th=[ 60], | |
| | 99.00th=[ 109], 99.50th=[ 127], 99.90th=[ 161], 99.95th=[ 180], | |
| | 99.99th=[ 2638] | |
| bw ( MiB/s): min= 1598, max= 2135, per=79.34%, avg=1734.52, stdev=267.22, samples=4 | |
| iops : min=12787, max=17082, avg=13875.50, stdev=2137.72, samples=4 | |
| lat (usec) : 100=98.93%, 250=1.05% | |
| lat (msec) : 4=0.02% | |
| cpu : usr=5.34%, sys=15.04%, ctx=40967, majf=0, minf=43 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=40960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| SeqQ32T1write: (groupid=1, jobs=1): err= 0: pid=69418: Sat Mar 2 10:16:09 2019 | |
| write: IOPS=16.0k, BW=2123MiB/s (2226MB/s)(5120MiB/2412msec); 0 zone resets | |
| clat (usec): min=53, max=2643, avg=57.42, stdev=37.43 | |
| lat (usec): min=53, max=2644, avg=58.21, stdev=37.44 | |
| clat percentiles (usec): | |
| | 1.00th=[ 54], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | |
| | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 56], 60.00th=[ 56], | |
| | 70.00th=[ 59], 80.00th=[ 62], 90.00th=[ 63], 95.00th=[ 65], | |
| | 99.00th=[ 68], 99.50th=[ 69], 99.90th=[ 72], 99.95th=[ 75], | |
| | 99.99th=[ 2606] | |
| bw ( MiB/s): min= 1877, max= 1894, per=88.98%, avg=1888.74, stdev= 7.49, samples=4 | |
| iops : min=15022, max=15158, avg=15109.50, stdev=59.92, samples=4 | |
| lat (usec) : 100=99.98% | |
| lat (msec) : 4=0.02% | |
| cpu : usr=4.65%, sys=18.17%, ctx=40965, majf=0, minf=12 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,40960,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ8T8read: (groupid=2, jobs=8): err= 0: pid=69437: Sat Mar 2 10:16:09 2019 | |
| read: IOPS=129k, BW=503MiB/s (528MB/s)(40.0GiB/81382msec) | |
| clat (usec): min=11, max=2684, avg=60.99, stdev=10.26 | |
| lat (usec): min=11, max=2685, avg=61.08, stdev=10.26 | |
| clat percentiles (usec): | |
| | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 51], 20.00th=[ 51], | |
| | 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 69], | |
| | 70.00th=[ 69], 80.00th=[ 70], 90.00th=[ 71], 95.00th=[ 73], | |
| | 99.00th=[ 88], 99.50th=[ 98], 99.90th=[ 117], 99.95th=[ 122], | |
| | 99.99th=[ 135] | |
| bw ( KiB/s): min=48744, max=64504, per=10.11%, avg=52084.15, stdev=1162.13, samples=1289 | |
| iops : min=12186, max=16126, avg=13020.67, stdev=290.54, samples=1289 | |
| lat (usec) : 20=0.01%, 50=5.11%, 100=94.46%, 250=0.43%, 500=0.01% | |
| lat (usec) : 1000=0.01% | |
| lat (msec) : 2=0.01%, 4=0.01% | |
| cpu : usr=0.44%, sys=10.56%, ctx=10486143, majf=0, minf=748 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=8 | |
| 4kQ8T8write: (groupid=3, jobs=8): err= 0: pid=69931: Sat Mar 2 10:16:09 2019 | |
| write: IOPS=466k, BW=1822MiB/s (1911MB/s)(40.0GiB/22478msec); 0 zone resets | |
| clat (usec): min=10, max=8479, avg=16.28, stdev=11.48 | |
| lat (usec): min=10, max=8480, avg=16.37, stdev=11.49 | |
| clat percentiles (nsec): | |
| | 1.00th=[12224], 5.00th=[12736], 10.00th=[12992], 20.00th=[13248], | |
| | 30.00th=[13504], 40.00th=[13632], 50.00th=[14016], 60.00th=[14400], | |
| | 70.00th=[15296], 80.00th=[21376], 90.00th=[24960], 95.00th=[26496], | |
| | 99.00th=[28800], 99.50th=[30080], 99.90th=[39680], 99.95th=[43264], | |
| | 99.99th=[56576] | |
| bw ( KiB/s): min=100995, max=199829, per=9.07%, avg=169220.26, stdev=38553.20, samples=348 | |
| iops : min=25248, max=49957, avg=42304.67, stdev=9638.29, samples=348 | |
| lat (usec) : 20=79.77%, 50=20.21%, 100=0.02%, 250=0.01%, 500=0.01% | |
| lat (usec) : 750=0.01%, 1000=0.01% | |
| lat (msec) : 2=0.01%, 4=0.01%, 10=0.01% | |
| cpu : usr=1.67%, sys=48.10%, ctx=10486396, majf=0, minf=1339 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,10485760,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=8 | |
| 4kQ32T1read: (groupid=4, jobs=1): err= 0: pid=70071: Sat Mar 2 10:16:09 2019 | |
| read: IOPS=16.3k, BW=63.6MiB/s (66.7MB/s)(5120MiB/80485msec) | |
| clat (usec): min=46, max=2668, avg=60.68, stdev=10.99 | |
| lat (usec): min=46, max=2668, avg=60.76, stdev=10.99 | |
| clat percentiles (usec): | |
| | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 51], 20.00th=[ 51], | |
| | 30.00th=[ 52], 40.00th=[ 54], 50.00th=[ 64], 60.00th=[ 68], | |
| | 70.00th=[ 69], 80.00th=[ 69], 90.00th=[ 71], 95.00th=[ 73], | |
| | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 93], 99.95th=[ 95], | |
| | 99.99th=[ 110] | |
| bw ( KiB/s): min=40065, max=64136, per=68.86%, avg=44858.82, stdev=1708.56, samples=160 | |
| iops : min=10016, max=16034, avg=11214.34, stdev=427.17, samples=160 | |
| lat (usec) : 50=5.91%, 100=94.07%, 250=0.02%, 500=0.01%, 750=0.01% | |
| lat (usec) : 1000=0.01% | |
| lat (msec) : 4=0.01% | |
| cpu : usr=0.04%, sys=10.15%, ctx=1310754, majf=0, minf=178 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ32T1write: (groupid=5, jobs=1): err= 0: pid=70553: Sat Mar 2 10:16:09 2019 | |
| write: IOPS=63.5k, BW=248MiB/s (260MB/s)(5120MiB/20633msec); 0 zone resets | |
| clat (usec): min=11, max=5712, avg=15.08, stdev= 9.99 | |
| lat (usec): min=11, max=5712, avg=15.17, stdev= 9.99 | |
| clat percentiles (nsec): | |
| | 1.00th=[12352], 5.00th=[12480], 10.00th=[12608], 20.00th=[12736], | |
| | 30.00th=[12736], 40.00th=[12864], 50.00th=[12992], 60.00th=[13376], | |
| | 70.00th=[14656], 80.00th=[19072], 90.00th=[21888], 95.00th=[22912], | |
| | 99.00th=[25216], 99.50th=[26240], 99.90th=[31872], 99.95th=[35584], | |
| | 99.99th=[51968] | |
| bw ( KiB/s): min=162828, max=280348, per=96.70%, avg=245721.83, stdev=50348.00, samples=41 | |
| iops : min=40707, max=70087, avg=61430.15, stdev=12587.05, samples=41 | |
| lat (usec) : 20=81.33%, 50=18.65%, 100=0.01%, 250=0.01%, 500=0.01% | |
| lat (msec) : 4=0.01%, 10=0.01% | |
| cpu : usr=1.42%, sys=43.56%, ctx=1310751, majf=0, minf=186 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ1T1read: (groupid=6, jobs=1): err= 0: pid=70680: Sat Mar 2 10:16:09 2019 | |
| read: IOPS=16.3k, BW=63.6MiB/s (66.7MB/s)(5120MiB/80456msec) | |
| clat (usec): min=12, max=2647, avg=60.66, stdev=11.02 | |
| lat (usec): min=12, max=2648, avg=60.75, stdev=11.02 | |
| clat percentiles (usec): | |
| | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 51], 20.00th=[ 51], | |
| | 30.00th=[ 52], 40.00th=[ 54], 50.00th=[ 65], 60.00th=[ 68], | |
| | 70.00th=[ 69], 80.00th=[ 70], 90.00th=[ 71], 95.00th=[ 73], | |
| | 99.00th=[ 77], 99.50th=[ 88], 99.90th=[ 93], 99.95th=[ 95], | |
| | 99.99th=[ 108] | |
| bw ( KiB/s): min=49267, max=63457, per=85.30%, avg=55582.52, stdev=1121.76, samples=160 | |
| iops : min=12316, max=15864, avg=13895.28, stdev=280.46, samples=160 | |
| lat (usec) : 20=0.01%, 50=4.80%, 100=95.18%, 250=0.02%, 500=0.01% | |
| lat (usec) : 750=0.01% | |
| lat (msec) : 4=0.01% | |
| cpu : usr=0.06%, sys=10.16%, ctx=1310748, majf=0, minf=101 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=1 | |
| 4kQ1T1write: (groupid=7, jobs=1): err= 0: pid=71166: Sat Mar 2 10:16:09 2019 | |
| write: IOPS=63.6k, BW=248MiB/s (261MB/s)(5120MiB/20606msec); 0 zone resets | |
| clat (usec): min=11, max=2915, avg=15.06, stdev= 8.97 | |
| lat (usec): min=11, max=2915, avg=15.15, stdev= 8.98 | |
| clat percentiles (nsec): | |
| | 1.00th=[12224], 5.00th=[12480], 10.00th=[12608], 20.00th=[12736], | |
| | 30.00th=[12736], 40.00th=[12864], 50.00th=[12992], 60.00th=[13376], | |
| | 70.00th=[14656], 80.00th=[19072], 90.00th=[21632], 95.00th=[22656], | |
| | 99.00th=[24960], 99.50th=[25984], 99.90th=[31616], 99.95th=[35584], | |
| | 99.99th=[51456] | |
| bw ( KiB/s): min=165016, max=290016, per=99.94%, avg=254269.73, stdev=51037.96, samples=41 | |
| iops : min=41254, max=72504, avg=63567.46, stdev=12759.54, samples=41 | |
| lat (usec) : 20=81.91%, 50=18.08%, 100=0.01%, 250=0.01%, 500=0.01% | |
| lat (msec) : 2=0.01%, 4=0.01% | |
| cpu : usr=1.65%, sys=43.37%, ctx=1310749, majf=0, minf=101 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=1 | |
| Run status group 0 (all jobs): | |
| READ: bw=2186MiB/s (2292MB/s), 2186MiB/s-2186MiB/s (2292MB/s-2292MB/s), io=5120MiB (5369MB), run=2342-2342msec | |
| Run status group 1 (all jobs): | |
| WRITE: bw=2123MiB/s (2226MB/s), 2123MiB/s-2123MiB/s (2226MB/s-2226MB/s), io=5120MiB (5369MB), run=2412-2412msec | |
| Run status group 2 (all jobs): | |
| READ: bw=503MiB/s (528MB/s), 503MiB/s-503MiB/s (528MB/s-528MB/s), io=40.0GiB (42.9GB), run=81382-81382msec | |
| Run status group 3 (all jobs): | |
| WRITE: bw=1822MiB/s (1911MB/s), 1822MiB/s-1822MiB/s (1911MB/s-1911MB/s), io=40.0GiB (42.9GB), run=22478-22478msec | |
| Run status group 4 (all jobs): | |
| READ: bw=63.6MiB/s (66.7MB/s), 63.6MiB/s-63.6MiB/s (66.7MB/s-66.7MB/s), io=5120MiB (5369MB), run=80485-80485msec | |
| Run status group 5 (all jobs): | |
| WRITE: bw=248MiB/s (260MB/s), 248MiB/s-248MiB/s (260MB/s-260MB/s), io=5120MiB (5369MB), run=20633-20633msec | |
| Run status group 6 (all jobs): | |
| READ: bw=63.6MiB/s (66.7MB/s), 63.6MiB/s-63.6MiB/s (66.7MB/s-66.7MB/s), io=5120MiB (5369MB), run=80456-80456msec | |
| Run status group 7 (all jobs): | |
| WRITE: bw=248MiB/s (261MB/s), 248MiB/s-248MiB/s (261MB/s-261MB/s), io=5120MiB (5369MB), run=20606-20606msec | |
| Disk stats (read/write): | |
| md127: ios=13148160/13152276, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=1643520/1643612, aggrmerge=0/2376, aggrticks=91591/15338, aggrin_queue=33764, aggrutil=8.75% | |
| nvme6n1: ios=1643520/1643627, merge=0/2514, ticks=91708/15496, in_queue=33784, util=8.63% | |
| nvme2n1: ios=1643520/1643578, merge=0/1886, ticks=90664/15396, in_queue=33932, util=8.70% | |
| nvme5n1: ios=1643520/1643617, merge=0/2513, ticks=92440/15356, in_queue=33864, util=8.61% | |
| nvme8n1: ios=1643520/1643573, merge=0/1927, ticks=90796/15340, in_queue=33428, util=8.58% | |
| nvme1n1: ios=1643520/1643585, merge=0/2139, ticks=92216/15624, in_queue=33888, util=8.70% | |
| nvme4n1: ios=1643520/1643629, merge=0/2577, ticks=90448/15164, in_queue=33248, util=8.50% | |
| nvme7n1: ios=1643520/1643672, merge=0/2823, ticks=92048/15256, in_queue=34120, util=8.75% | |
| nvme3n1: ios=1643520/1643621, merge=0/2631, ticks=92408/15076, in_queue=33848, util=8.68% |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment