Created
March 18, 2019 12:33
-
-
Save fo40225/e9fa58b1d3369fd1a4aad25153210f87 to your computer and use it in GitHub Desktop.
twgc lustre test
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| lustre | |
| SeqQ32T1read: (groupid=0, jobs=1): err= 0: pid=262: Wed Jan 9 22:44:57 2019 | |
| read: IOPS=1044, BW=131MiB/s (137MB/s)(5120MiB/39232msec) | |
| clat (usec): min=413, max=326768, avg=955.13, stdev=4388.08 | |
| lat (usec): min=413, max=326768, avg=955.40, stdev=4388.09 | |
| clat percentiles (usec): | |
| | 1.00th=[ 482], 5.00th=[ 506], 10.00th=[ 519], 20.00th=[ 537], | |
| | 30.00th=[ 553], 40.00th=[ 578], 50.00th=[ 611], 60.00th=[ 652], | |
| | 70.00th=[ 717], 80.00th=[ 889], 90.00th=[ 1139], 95.00th=[ 1336], | |
| | 99.00th=[ 9110], 99.50th=[ 14091], 99.90th=[ 31065], 99.95th=[ 41157], | |
| | 99.99th=[242222] | |
| bw ( KiB/s): min= 5555, max=193926, per=83.56%, avg=111667.19, stdev=69361.42, samples=78 | |
| iops : min= 43, max= 1515, avg=871.91, stdev=541.88, samples=78 | |
| lat (usec) : 500=3.70%, 750=69.79%, 1000=9.31% | |
| lat (msec) : 2=15.65%, 4=0.20%, 10=0.42%, 20=0.65%, 50=0.23% | |
| lat (msec) : 100=0.01%, 250=0.01%, 500=0.01% | |
| cpu : usr=0.56%, sys=9.07%, ctx=41086, majf=0, minf=281 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=40960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| SeqQ32T1write: (groupid=1, jobs=1): err= 0: pid=263: Wed Jan 9 22:44:57 2019 | |
| write: IOPS=427, BW=53.4MiB/s (56.0MB/s)(5120MiB/95865msec) | |
| clat (usec): min=968, max=20418, avg=2330.24, stdev=842.02 | |
| lat (usec): min=971, max=20424, avg=2335.60, stdev=842.06 | |
| clat percentiles (usec): | |
| | 1.00th=[ 1549], 5.00th=[ 1713], 10.00th=[ 1778], 20.00th=[ 1860], | |
| | 30.00th=[ 1926], 40.00th=[ 1991], 50.00th=[ 2057], 60.00th=[ 2114], | |
| | 70.00th=[ 2278], 80.00th=[ 2900], 90.00th=[ 3163], 95.00th=[ 3490], | |
| | 99.00th=[ 5211], 99.50th=[ 6980], 99.90th=[11207], 99.95th=[13960], | |
| | 99.99th=[17957] | |
| bw ( KiB/s): min=34120, max=50609, per=77.20%, avg=42219.80, stdev=2209.28, samples=191 | |
| iops : min= 266, max= 395, avg=329.36, stdev=17.25, samples=191 | |
| lat (usec) : 1000=0.01% | |
| lat (msec) : 2=42.80%, 4=54.67%, 10=2.38%, 20=0.13%, 50=0.01% | |
| cpu : usr=0.68%, sys=5.74%, ctx=41271, majf=0, minf=289 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,40960,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ8T8read: (groupid=2, jobs=8): err= 0: pid=264: Wed Jan 9 22:44:57 2019 | |
| read: IOPS=609, BW=2437KiB/s (2495kB/s)(40.0GiB/17211287msec) | |
| clat (usec): min=332, max=1363.9k, avg=12345.46, stdev=13916.56 | |
| lat (usec): min=332, max=1363.9k, avg=12345.91, stdev=13916.56 | |
| clat percentiles (usec): | |
| | 1.00th=[ 783], 5.4000th=[ 3687], 10.00th=[ 5538], 20.00th=[ 6915], | |
| | 30.00th=[ 8094], .00th=[ 9241], 50.00th=[ 10421], 60.00th=[ 11600], | |
| | 70.00th=[ 12911], 80.00th=[ 15008], 90.00th=[ 20055], 95.00th=[ 26084], | |
| | 99.00th=[ 45351], 99.50th=[ 56361], 99.90th=[250610], 99.95th=[337642], | |
| | 99.99th=[408945] | |
| bw ( KiB/s): min= 5, max= 1723, per=10.75%, avg=261.84, stdev=63.91, samples=258905 | |
| iops : min= 1, max= 430, avg=65.09, stdev=15.98, samples=258905 | |
| lat (usec) : 500=0.01%, 750=0.78%, 1000=1.14% | |
| lat (msec) : 2=0.51%, 4=3.10%, 10=40.99%, 20=43.56%, 50=9.19% | |
| lat (msec) : 100=0.56%, 250=0.07%, 500=0.10%, 750=0.01%, 1000=0.01% | |
| cpu : usr=0.08%, sys=0.66%, ctx=10503610, majf=12, minf=5939 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=8 | |
| 4kQ8T8write: (groupid=3, jobs=8): err= 0: pid=272: Wed Jan 9 22:44:57 2019 | |
| write: IOPS=1787, BW=7151KiB/s (7322kB/s)(40.0GiB/5865523msec) | |
| clat (usec): min=522, max=6837.3k, avg=4219.66, stdev=21980.07 | |
| lat (usec): min=523, max=6837.3k, avg=4220.29, stdev=21980.08 | |
| clat percentiles (usec): | |
| | 1.00th=[ 1287], 5.00th=[ 1500], 10.00th=[ 1729], 20.00th=[ 2442], | |
| | 30.00th=[ 2606], 40.00th=[ 2737], 50.00th=[ 2966], 60.00th=[ 3294], | |
| | 70.00th=[ 3752], 80.00th=[ 4293], 90.00th=[ 5604], 95.00th=[ 8094], | |
| | 99.00th=[ 17171], 99.50th=[ 22414], 99.90th=[173016], 99.95th=[333448], | |
| | 99.99th=[742392] | |
| bw ( KiB/s): min= 5, max= 3204, per=10.90%, avg=779.69, stdev=374.78, samples=86171 | |
| iops : min= 1, max= 801, avg=194.55, stdev=93.70, samples=86171 | |
| lat (usec) : 750=0.04%, 1000=0.10% | |
| lat (msec) : 2=12.39%, 4=62.66%, 10=21.43%, 20=2.73%, 50=0.47% | |
| lat (msec) : 100=0.04%, 250=0.05%, 500=0.05%, 750=0.01%, 1000=0.01% | |
| cpu : usr=0.24%, sys=1.90%, ctx=10514227, majf=8, minf=4700 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,10485760,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=8 | |
| 4kQ32T1read: (groupid=4, jobs=1): err= 0: pid=280: Wed Jan 9 22:44:57 2019 | |
| read: IOPS=86, BW=346KiB/s (354kB/s)(5120MiB/15151462msec) | |
| clat (usec): min=289, max=515100, avg=11554.13, stdev=7151.48 | |
| lat (usec): min=289, max=515100, avg=11554.61, stdev=7151.48 | |
| clat percentiles (usec): | |
| | 1.00th=[ 1045], 5.00th=[ 5407], 10.00th=[ 6063], 20.00th=[ 7242], | |
| | 30.00th=[ 8356], 40.00th=[ 9372], 50.00th=[ 10421], 60.00th=[ 11469], | |
| | 70.00th=[ 12518], 80.00th=[ 13566], 90.00th=[ 17695], 95.00th=[ 22414], | |
| | 99.00th=[ 39060], 99.50th=[ 47449], 99.90th=[ 66847], 99.95th=[ 77071], | |
| | 99.99th=[154141] | |
| bw ( KiB/s): min= 5, max= 1102, per=80.01%, avg=276.83, stdev=48.04, samples=30302 | |
| iops : min= 1, max= 275, avg=68.84, stdev=12.01, samples=30302 | |
| lat (usec) : 500=0.02%, 750=0.44%, 1000=0.53% | |
| lat (msec) : 2=0.22%, 4=1.60%, 10=43.15%, 20=47.01%, 50=6.64% | |
| lat (msec) : 100=0.38%, 250=0.02%, 500=0.01%, 750=0.01% | |
| cpu : usr=0.10%, sys=0.84%, ctx=1313800, majf=0, minf=1279 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ32T1write: (groupid=5, jobs=1): err= 0: pid=281: Wed Jan 9 22:44:57 2019 | |
| write: IOPS=436, BW=1748KiB/s (1790kB/s)(5120MiB/3000061msec) | |
| clat (usec): min=536, max=1724.4k, avg=2284.29, stdev=10312.34 | |
| lat (usec): min=536, max=1724.4k, avg=2284.84, stdev=10312.34 | |
| clat percentiles (usec): | |
| | 1.00th=[ 685], 5.00th=[ 906], 10.00th=[ 1434], 20.00th=[ 1549], | |
| | 30.00th=[ 1614], 40.00th=[ 1663], 50.00th=[ 1729], 60.00th=[ 1811], | |
| | 70.00th=[ 2073], 80.00th=[ 2638], 90.00th=[ 2999], 95.00th=[ 3720], | |
| | 99.00th=[ 5080], 99.50th=[ 5800], 99.90th=[ 49021], 99.95th=[200279], | |
| | 99.99th=[534774] | |
| bw ( KiB/s): min= 7, max= 3009, per=89.35%, avg=1560.89, stdev=556.56, samples=5937 | |
| iops : min= 1, max= 752, avg=389.85, stdev=139.14, samples=5937 | |
| lat (usec) : 750=2.51%, 1000=3.35% | |
| lat (msec) : 2=62.72%, 4=27.74%, 10=3.53%, 20=0.03%, 50=0.02% | |
| lat (msec) : 100=0.02%, 250=0.04%, 500=0.03%, 750=0.01%, 1000=0.01% | |
| cpu : usr=0.41%, sys=3.50%, ctx=1317926, majf=0, minf=675 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=32 | |
| 4kQ1T1read: (groupid=6, jobs=1): err= 0: pid=282: Wed Jan 9 22:44:57 2019 | |
| read: IOPS=76, BW=304KiB/s (312kB/s)(5120MiB/17229692msec) | |
| clat (usec): min=378, max=581639, avg=13139.60, stdev=14988.73 | |
| lat (usec): min=379, max=581639, avg=13140.08, stdev=14988.74 | |
| clat percentiles (usec): | |
| | 1.00th=[ 791], 5.00th=[ 4424], 10.00th=[ 5997], 20.00th=[ 7373], | |
| | 30.00th=[ 8586], 40.00th=[ 9765], 50.00th=[ 10945], 60.00th=[ 12125], | |
| | 70.00th=[ 13304], 80.00th=[ 15795], 90.00th=[ 21365], 95.00th=[ 28443], | |
| | 99.00th=[ 49021], 99.50th=[ 61080], 99.90th=[287310], 99.95th=[346031], | |
| | 99.99th=[408945] | |
| bw ( KiB/s): min= 5, max= 1516, per=81.07%, avg=246.45, stdev=60.27, samples=34457 | |
| iops : min= 1, max= 379, avg=61.24, stdev=15.07, samples=34457 | |
| lat (usec) : 500=0.01%, 750=0.59%, 1000=2.14% | |
| lat (msec) : 2=0.68%, 4=1.27%, 10=37.13%, 20=46.43%, 50=10.82% | |
| lat (msec) : 100=0.73%, 250=0.09%, 500=0.12%, 750=0.01% | |
| cpu : usr=0.08%, sys=0.63%, ctx=1316316, majf=0, minf=846 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=1310720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=1 | |
| 4kQ1T1write: (groupid=7, jobs=1): err= 0: pid=283: Wed Jan 9 22:44:57 2019 | |
| write: IOPS=384, BW=1537KiB/s (1574kB/s)(5120MiB/3411343msec) | |
| clat (usec): min=480, max=2034.4k, avg=2598.02, stdev=10741.58 | |
| lat (usec): min=481, max=2034.4k, avg=2598.58, stdev=10741.59 | |
| clat percentiles (usec): | |
| | 1.00th=[ 783], 5.00th=[ 1319], 10.00th=[ 1418], 20.00th=[ 1532], | |
| | 30.00th=[ 1631], 40.00th=[ 1778], 50.00th=[ 2089], 60.00th=[ 2442], | |
| | 70.00th=[ 2704], 80.00th=[ 3097], 90.00th=[ 3687], 95.00th=[ 4178], | |
| | 99.00th=[ 5407], 99.50th=[ 6587], 99.90th=[ 44827], 99.95th=[183501], | |
| | 99.99th=[513803] | |
| bw ( KiB/s): min= 7, max= 2992, per=100.00%, avg=1551.30, stdev=522.64, samples=6757 | |
| iops : min= 1, max= 748, avg=387.80, stdev=130.66, samples=6757 | |
| lat (usec) : 500=0.01%, 750=0.80%, 1000=1.08% | |
| lat (msec) : 2=45.61%, 4=45.95%, 10=6.38%, 20=0.07%, 50=0.02% | |
| lat (msec) : 100=0.02%, 250=0.04%, 500=0.03%, 750=0.01%, 1000=0.01% | |
| cpu : usr=0.37%, sys=3.16%, ctx=1318599, majf=0, minf=847 | |
| IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% | |
| submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% | |
| issued rwts: total=0,1310720,0,0 short=0,0,0,0 dropped=0,0,0,0 | |
| latency : target=0, window=0, percentile=100.00%, depth=1 | |
| Run status group 0 (all jobs): | |
| READ: bw=131MiB/s (137MB/s), 131MiB/s-131MiB/s (137MB/s-137MB/s), io=5120MiB (5369MB), run=39232-39232msec | |
| Run status group 1 (all jobs): | |
| WRITE: bw=53.4MiB/s (56.0MB/s), 53.4MiB/s-53.4MiB/s (56.0MB/s-56.0MB/s), io=5120MiB (5369MB), run=95865-95865msec | |
| Run status group 2 (all jobs): | |
| READ: bw=2437KiB/s (2495kB/s), 2437KiB/s-2437KiB/s (2495kB/s-2495kB/s), io=40.0GiB (42.9GB), run=17211287-17211287msec | |
| Run status group 3 (all jobs): | |
| WRITE: bw=7151KiB/s (7322kB/s), 7151KiB/s-7151KiB/s (7322kB/s-7322kB/s), io=40.0GiB (42.9GB), run=5865523-5865523msec | |
| Run status group 4 (all jobs): | |
| READ: bw=346KiB/s (354kB/s), 346KiB/s-346KiB/s (354kB/s-354kB/s), io=5120MiB (5369MB), run=15151462-15151462msec | |
| Run status group 5 (all jobs): | |
| WRITE: bw=1748KiB/s (1790kB/s), 1748KiB/s-1748KiB/s (1790kB/s-1790kB/s), io=5120MiB (5369MB), run=3000061-3000061msec | |
| Run status group 6 (all jobs): | |
| READ: bw=304KiB/s (312kB/s), 304KiB/s-304KiB/s (312kB/s-312kB/s), io=5120MiB (5369MB), run=17229692-17229692msec | |
| Run status group 7 (all jobs): | |
| WRITE: bw=1537KiB/s (1574kB/s), 1537KiB/s-1537KiB/s (1574kB/s-1574kB/s), io=5120MiB (5369MB), run=3411343-3411343msec |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment