Skip to content

Instantly share code, notes, and snippets.

@glennklockwood

glennklockwood/.gitignore

Last active April 7, 2021 05:13
Show Gist options
  • Save glennklockwood/908e22b252e5361bde533f0b70e194d5 to your computer and use it in GitHub Desktop.
Save glennklockwood/908e22b252e5361bde533f0b70e194d5 to your computer and use it in GitHub Desktop.
Download ZIP
IOR Incompressibility Testing
Raw
.gitignore
.ipynb_checkpoints
Raw
README.md

This repo contains some testing I performed to validate the new -l random datapackettype for IOR.

Raw
bz2-compress.txt
-rw-rw---- 1 glock glock 23788405 Apr 6 17:14 /global/gscratch1/sd/glock/mdtest-incompressible.tar.bz2
-rw-rw---- 1 glock glock 26367695 Apr 6 17:14 /global/gscratch1/sd/glock/mdtest-random.tar.bz2
-rw-rw---- 1 glock glock 16310911 Apr 6 17:15 /global/gscratch1/sd/glock/mdworkbench-incompressible.tar.bz2
-rw-rw---- 1 glock glock 41197142 Apr 6 17:14 /global/gscratch1/sd/glock/mdworkbench-random.tar.bz2
Display the source blob
Display the rendered blob
Raw
compare-datapackettype-performance.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Raw
ior-128m-seq-incompressible.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:31:02 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 128m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType i
Machine : Linux nid00060
TestID : 0
StartTime : Tue Apr 6 17:31:02 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 128 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 18570 145.10 0.055086 1048576 131072 0.000115 0.441084 0.007231 0.441130 0
write 18228 142.41 0.056000 1048576 131072 0.000108 0.449399 0.033071 0.449423 1
write 18225 142.39 0.056037 1048576 131072 0.000104 0.449477 0.035849 0.449499 2
write 18312 143.07 0.055725 1048576 131072 0.000088 0.447343 0.037560 0.447366 3
write 18327 143.19 0.055693 1048576 131072 0.000082 0.446958 0.037182 0.446979 4
write 18235 142.47 0.055970 1048576 131072 0.000077 0.449232 0.037291 0.449253 5
write 18136 141.69 0.056304 1048576 131072 0.000068 0.451686 0.039562 0.451705 6
write 18319 143.12 0.055722 1048576 131072 0.000076 0.447177 0.037404 0.447198 7
write 18332 143.22 0.055700 1048576 131072 0.000077 0.446857 0.037253 0.446877 8
write 18223 142.38 0.055943 1048576 131072 0.000079 0.449516 0.037712 0.449536 9
write 18228 142.41 0.055973 1048576 131072 0.000072 0.449398 0.037376 0.449421 10
write 18280 142.82 0.055759 1048576 131072 0.000081 0.448128 0.038303 0.448147 11
write 18334 143.24 0.055668 1048576 131072 0.000079 0.446803 0.037201 0.446823 12
write 18311 143.06 0.055732 1048576 131072 0.000076 0.447357 0.037604 0.447377 13
write 18219 142.34 0.056054 1048576 131072 0.000072 0.449621 0.037257 0.449639 14
write 18310 143.05 0.055718 1048576 131072 0.000075 0.447397 0.037319 0.447417 15
write 18324 143.17 0.055751 1048576 131072 0.000080 0.447027 0.037345 0.447052 16
write 18338 143.28 0.055676 1048576 131072 0.000082 0.446693 0.037286 0.446716 17
write 18260 142.67 0.055899 1048576 131072 0.000069 0.448598 0.036314 0.448619 18
write 18249 142.58 0.055936 1048576 131072 0.000067 0.448873 0.038892 0.448893 19
write 18343 143.31 0.055681 1048576 131072 0.000069 0.446593 0.036849 0.446611 20
write 18332 143.22 0.055694 1048576 131072 0.000071 0.446856 0.037305 0.446874 21
write 18240 142.51 0.055959 1048576 131072 0.000073 0.449100 0.036788 0.449119 22
write 18238 142.49 0.055987 1048576 131072 0.000074 0.449150 0.037319 0.449169 23
write 18305 143.02 0.055712 1048576 131072 0.000073 0.447504 0.037917 0.447525 24
write 18332 143.23 0.055686 1048576 131072 0.000068 0.446839 0.037116 0.446858 25
write 18241 142.52 0.055934 1048576 131072 0.000073 0.449070 0.034510 0.449090 26
write 18224 142.38 0.056021 1048576 131072 0.000098 0.449493 0.034420 0.449515 27
write 18308 143.04 0.055694 1048576 131072 0.000082 0.447432 0.037474 0.447454 28
write 18334 143.24 0.055665 1048576 131072 0.000086 0.446809 0.037384 0.446832 29
write 18223 142.38 0.055992 1048576 131072 0.000078 0.449514 0.037417 0.449538 30
write 18220 142.35 0.056006 1048576 131072 0.000067 0.449596 0.037856 0.449616 31
write 18306 143.02 0.055775 1048576 131072 0.000074 0.447492 0.037356 0.447511 32
write 18334 143.24 0.055683 1048576 131072 0.000075 0.446811 0.037316 0.446832 33
write 18238 142.49 0.055924 1048576 131072 0.000072 0.449148 0.037126 0.449166 34
write 18205 142.23 0.056087 1048576 131072 0.000078 0.449978 0.036853 0.449998 35
write 18320 143.13 0.055737 1048576 131072 0.000075 0.447145 0.037338 0.447165 36
write 18325 143.17 0.055704 1048576 131072 0.000073 0.447018 0.037036 0.447037 37
write 18257 142.64 0.055906 1048576 131072 0.000097 0.448683 0.036620 0.448709 38
write 18220 142.35 0.056031 1048576 131072 0.000078 0.449599 0.036505 0.449623 39
write 18288 142.88 0.055811 1048576 131072 0.000077 0.447928 0.037535 0.447950 40
write 18314 143.08 0.055761 1048576 131072 0.000071 0.447297 0.037377 0.447318 41
write 18328 143.20 0.055662 1048576 131072 0.000070 0.446935 0.037414 0.446956 42
write 18175 142.00 0.056166 1048576 131072 0.000080 0.450690 0.038373 0.450721 43
write 18243 142.53 0.055956 1048576 131072 0.000079 0.449022 0.038878 0.449042 44
write 18329 143.20 0.055702 1048576 131072 0.000076 0.446924 0.037301 0.446944 45
write 18336 143.25 0.055680 1048576 131072 0.000068 0.446759 0.037140 0.446779 46
write 18232 142.44 0.055936 1048576 131072 0.000075 0.449298 0.036823 0.449319 47
write 18235 142.47 0.055977 1048576 131072 0.000072 0.449221 0.037355 0.449243 48
write 18330 143.21 0.055708 1048576 131072 0.000078 0.446902 0.037138 0.446924 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 18570.49 18135.73 18282.27 65.82 145.08 141.69 142.83 0.51 0.44809 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 134217728 8192.0 POSIX 0
Finished : Tue Apr 6 17:31:40 2021
Raw
ior-128m-seq-random.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:30:08 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 128m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType r
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:30:08 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 128 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 9324 72.84 0.105804 1048576 131072 0.000091 0.878583 0.032162 0.878634 0
write 9346 73.02 0.109373 1048576 131072 0.000100 0.876495 0.051322 0.876519 1
write 9349 73.04 0.109343 1048576 131072 0.000055 0.876267 0.055628 0.876289 2
write 9344 73.00 0.109430 1048576 131072 0.000052 0.876672 0.054625 0.876691 3
write 9344 73.00 0.109375 1048576 131072 0.000054 0.876653 0.054139 0.876673 4
write 9343 72.99 0.109481 1048576 131072 0.000057 0.876779 0.055015 0.876798 5
write 9348 73.03 0.109384 1048576 131072 0.000053 0.876315 0.053624 0.876334 6
write 9337 72.95 0.109499 1048576 131072 0.000050 0.877354 0.054930 0.877373 7
write 9340 72.97 0.109426 1048576 131072 0.000052 0.877034 0.054456 0.877053 8
write 9338 72.96 0.109460 1048576 131072 0.000056 0.877232 0.054240 0.877255 9
write 9339 72.96 0.109447 1048576 131072 0.000049 0.877138 0.054364 0.877157 10
write 9336 72.94 0.109480 1048576 131072 0.000052 0.877464 0.054480 0.877483 11
write 9335 72.93 0.109534 1048576 131072 0.000054 0.877518 0.055037 0.877539 12
write 9337 72.95 0.109466 1048576 131072 0.000052 0.877310 0.053850 0.877329 13
write 9341 72.98 0.109461 1048576 131072 0.000049 0.877003 0.055042 0.877021 14
write 9338 72.96 0.109483 1048576 131072 0.000052 0.877244 0.053632 0.877264 15
write 9333 72.92 0.109508 1048576 131072 0.000054 0.877690 0.054381 0.877709 16
write 9364 73.16 0.109190 1048576 131072 0.000057 0.874798 0.054229 0.874820 17
write 9365 73.17 0.109163 1048576 131072 0.000054 0.874688 0.054584 0.874708 18
write 9346 73.02 0.109361 1048576 131072 0.000050 0.876460 0.055773 0.876479 19
write 9339 72.96 0.109473 1048576 131072 0.000056 0.877153 0.055301 0.877174 20
write 9346 73.02 0.109361 1048576 131072 0.000063 0.876528 0.053617 0.876563 21
write 9338 72.96 0.109473 1048576 131072 0.000054 0.877226 0.054783 0.877246 22
write 9345 73.01 0.109393 1048576 131072 0.000067 0.876577 0.052934 0.876600 23
write 9339 72.96 0.109519 1048576 131072 0.000056 0.877206 0.055072 0.877227 24
write 9342 72.99 0.109425 1048576 131072 0.000049 0.876871 0.052368 0.876889 25
write 9334 72.93 0.109475 1048576 131072 0.000049 0.877604 0.054502 0.877622 26
write 9339 72.96 0.109515 1048576 131072 0.000053 0.877194 0.054077 0.877214 27
write 9337 72.95 0.109496 1048576 131072 0.000054 0.877349 0.053999 0.877370 28
write 9340 72.97 0.109468 1048576 131072 0.000052 0.877026 0.054076 0.877044 29
write 9341 72.98 0.109451 1048576 131072 0.000051 0.876956 0.053277 0.876974 30
write 9348 73.03 0.108586 1048576 131072 0.000054 0.876297 0.053025 0.876315 31
write 9342 72.98 0.108694 1048576 131072 0.000053 0.876921 0.053035 0.876940 32
write 9348 73.03 0.108632 1048576 131072 0.000053 0.876297 0.053332 0.876316 33
write 9368 73.19 0.108329 1048576 131072 0.000053 0.874421 0.052973 0.874440 34
write 9369 73.20 0.108373 1048576 131072 0.000052 0.874364 0.053459 0.874384 35
write 9373 73.23 0.108354 1048576 131072 0.000054 0.873997 0.053480 0.874016 36
write 9352 73.06 0.108507 1048576 131072 0.000054 0.875940 0.054936 0.875959 37
write 9352 73.06 0.108593 1048576 131072 0.000052 0.875955 0.052837 0.875973 38
write 9345 73.01 0.108621 1048576 131072 0.000052 0.876612 0.053860 0.876630 39
write 9351 73.06 0.108633 1048576 131072 0.000055 0.875994 0.052499 0.876017 40
write 9342 72.98 0.108542 1048576 131072 0.000052 0.876896 0.053443 0.876915 41
write 9353 73.07 0.108586 1048576 131072 0.000057 0.875836 0.052922 0.875860 42
write 9347 73.02 0.108643 1048576 131072 0.000051 0.876434 0.054098 0.876454 43
write 9351 73.05 0.108537 1048576 131072 0.000050 0.876081 0.052826 0.876099 44
write 9341 72.98 0.108567 1048576 131072 0.000050 0.876950 0.054852 0.876969 45
write 9349 73.04 0.108605 1048576 131072 0.000054 0.876233 0.052720 0.876252 46
write 8860 69.22 0.114674 1048576 131072 0.000049 0.924546 0.050262 0.924564 47
write 9246 72.23 0.109771 1048576 131072 0.000057 0.886030 0.051432 0.886049 48
write 9347 73.02 0.108606 1048576 131072 0.000051 0.876428 0.053056 0.876446 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 9372.83 8860.39 9333.47 69.65 73.23 69.22 72.92 0.54 0.87775 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 134217728 8192.0 POSIX 0
Finished : Tue Apr 6 17:31:01 2021
Raw
ior-128m-seq-timestamp.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:31:41 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 128m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType t
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:31:41 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 128 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 18851 147.28 0.054319 1048576 131072 0.000081 0.434551 0.004781 0.434577 0
write 18837 147.17 0.053083 1048576 131072 0.000085 0.434876 0.015330 0.434897 1
write 18593 145.26 0.051546 1048576 131072 0.000078 0.440581 0.030710 0.440603 2
write 18485 144.42 0.051752 1048576 131072 0.000053 0.443151 0.031243 0.443171 3
write 18582 145.18 0.051488 1048576 131072 0.000056 0.440842 0.031333 0.440863 4
write 18594 145.27 0.051468 1048576 131072 0.000057 0.440544 0.030905 0.440564 5
write 18487 144.44 0.051754 1048576 131072 0.000050 0.443100 0.031103 0.443118 6
write 18589 145.23 0.051524 1048576 131072 0.000053 0.440681 0.030836 0.440701 7
write 18483 144.41 0.051787 1048576 131072 0.000054 0.443192 0.030933 0.443213 8
write 18513 144.64 0.051539 1048576 131072 0.000054 0.442482 0.032490 0.442503 9
write 18590 145.24 0.051460 1048576 131072 0.000051 0.440657 0.031019 0.440675 10
write 18486 144.43 0.051788 1048576 131072 0.000052 0.443126 0.030967 0.443144 11
write 18561 145.02 0.051507 1048576 131072 0.000052 0.441324 0.031559 0.441344 12
write 18582 145.17 0.051462 1048576 131072 0.000053 0.440848 0.031133 0.440867 13
write 18493 144.48 0.051774 1048576 131072 0.000050 0.442955 0.030946 0.442972 14
write 18582 145.18 0.051487 1048576 131072 0.000069 0.440831 0.031049 0.440851 15
write 18487 144.44 0.051809 1048576 131072 0.000054 0.443098 0.030971 0.443119 16
write 18568 145.07 0.051472 1048576 131072 0.000054 0.441176 0.031613 0.441196 17
write 18570 145.08 0.051459 1048576 131072 0.000063 0.441131 0.031401 0.441152 18
write 18502 144.55 0.051743 1048576 131072 0.000055 0.442748 0.030663 0.442771 19
write 18599 145.31 0.051409 1048576 131072 0.000053 0.440434 0.030828 0.440455 20
write 18489 144.45 0.051746 1048576 131072 0.000053 0.443051 0.030506 0.443069 21
write 18579 145.16 0.051491 1048576 131072 0.000052 0.440904 0.031012 0.440922 22
write 18576 145.13 0.051481 1048576 131072 0.000050 0.440989 0.031087 0.441007 23
write 18507 144.59 0.051744 1048576 131072 0.000054 0.442618 0.030197 0.442640 24
write 18589 145.23 0.051471 1048576 131072 0.000048 0.440680 0.031077 0.440698 25
write 18486 144.43 0.051801 1048576 131072 0.000052 0.443132 0.030749 0.443154 26
write 18548 144.91 0.051502 1048576 131072 0.000052 0.441654 0.031454 0.441674 27
write 18587 145.22 0.051460 1048576 131072 0.000056 0.440723 0.031373 0.440745 28
write 18491 144.46 0.051843 1048576 131072 0.000050 0.443020 0.030347 0.443037 29
write 18577 145.14 0.051521 1048576 131072 0.000055 0.440955 0.031339 0.440977 30
write 18577 145.14 0.051475 1048576 131072 0.000054 0.440967 0.030557 0.440986 31
write 18491 144.47 0.051754 1048576 131072 0.000053 0.443008 0.030755 0.443028 32
write 18588 145.23 0.052405 1048576 131072 0.000050 0.440685 0.023156 0.440703 33
write 18481 144.39 0.052119 1048576 131072 0.000051 0.443249 0.028276 0.443268 34
write 18568 145.07 0.051515 1048576 131072 0.000053 0.441178 0.031166 0.441197 35
write 18579 145.15 0.051482 1048576 131072 0.000054 0.440913 0.030810 0.440933 36
write 18495 144.50 0.051880 1048576 131072 0.000053 0.442909 0.029555 0.442929 37
write 18603 145.35 0.051931 1048576 131072 0.000057 0.440326 0.027079 0.440349 38
write 18497 144.52 0.051751 1048576 131072 0.000053 0.442849 0.030573 0.442871 39
write 18582 145.18 0.051501 1048576 131072 0.000053 0.440829 0.030875 0.440849 40
write 18597 145.30 0.051484 1048576 131072 0.000055 0.440473 0.030440 0.440493 41
write 18507 144.59 0.051773 1048576 131072 0.000050 0.442621 0.030416 0.442639 42
write 18587 145.21 0.051487 1048576 131072 0.000055 0.440727 0.031043 0.440749 43
write 18477 144.36 0.051765 1048576 131072 0.000053 0.443334 0.030803 0.443354 44
write 18510 144.62 0.051540 1048576 131072 0.000053 0.442547 0.032509 0.442566 45
write 18598 145.31 0.051462 1048576 131072 0.000052 0.440450 0.030825 0.440469 46
write 18486 144.43 0.051828 1048576 131072 0.000051 0.443134 0.030443 0.443151 47
write 18562 145.02 0.051508 1048576 131072 0.000057 0.441318 0.031519 0.441339 48
write 18567 145.06 0.051497 1048576 131072 0.000054 0.441199 0.030816 0.441219 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 18850.51 18477.33 18556.25 73.48 147.27 144.35 144.97 0.57 0.44148 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 134217728 8192.0 POSIX 0
Finished : Tue Apr 6 17:32:12 2021
Raw
ior-1m-seq-incompressible.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:28:44 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 1m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType i
Machine : Linux nid00060
TestID : 0
StartTime : Tue Apr 6 17:28:44 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 1 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 21388 21389 0.000362 1048576 1024.00 0.000086 0.382997 0.028816 0.383012 0
write 22131 22132 0.000351 1048576 1024.00 0.000112 0.370135 0.010262 0.370156 1
write 22280 22281 0.000356 1048576 1024.00 0.000090 0.367668 0.005384 0.367686 2
write 22413 22414 0.000354 1048576 1024.00 0.000082 0.365490 0.006382 0.365508 3
write 22066 22067 0.000358 1048576 1024.00 0.000059 0.371225 0.008939 0.371245 4
write 21705 21706 0.000354 1048576 1024.00 0.000084 0.377411 0.018991 0.377430 5
write 21998 21999 0.000357 1048576 1024.00 0.000069 0.372383 0.010691 0.372398 6
write 22439 22440 0.000354 1048576 1024.00 0.000078 0.365056 0.006643 0.365076 7
write 22253 22255 0.000357 1048576 1024.00 0.000085 0.368104 0.006666 0.368123 8
write 22443 22444 0.000354 1048576 1024.00 0.000076 0.364994 0.007106 0.365012 9
write 22254 22255 0.000357 1048576 1024.00 0.000067 0.368094 0.006688 0.368110 10
write 22439 22440 0.000354 1048576 1024.00 0.000062 0.365062 0.006503 0.365081 11
write 22261 22262 0.000357 1048576 1024.00 0.000082 0.367989 0.006673 0.368004 12
write 22406 22407 0.000354 1048576 1024.00 0.000082 0.365602 0.006814 0.365619 13
write 22245 22246 0.000357 1048576 1024.00 0.000072 0.368244 0.006476 0.368262 14
write 22430 22431 0.000354 1048576 1024.00 0.000089 0.365208 0.006486 0.365225 15
write 22246 22247 0.000357 1048576 1024.00 0.000068 0.368236 0.006439 0.368252 16
write 22402 22403 0.000354 1048576 1024.00 0.000094 0.365667 0.006834 0.365685 17
write 22235 22236 0.000357 1048576 1024.00 0.000073 0.368418 0.006912 0.368435 18
write 22445 22446 0.000354 1048576 1024.00 0.000077 0.364958 0.006529 0.364975 19
write 22239 22240 0.000357 1048576 1024.00 0.000103 0.368352 0.007036 0.368370 20
write 22425 22426 0.000354 1048576 1024.00 0.000069 0.365288 0.006748 0.365305 21
write 22226 22227 0.000357 1048576 1024.00 0.000065 0.368559 0.007033 0.368573 22
write 22453 22454 0.000353 1048576 1024.00 0.000084 0.364837 0.006594 0.364857 23
write 22327 22327 0.000357 1048576 1024.00 0.000074 0.366902 0.005402 0.366918 24
write 22490 22491 0.000354 1048576 1024.00 0.000072 0.364242 0.005568 0.364258 25
write 22324 22325 0.000357 1048576 1024.00 0.000068 0.366938 0.004963 0.366952 26
write 22435 22436 0.000354 1048576 1024.00 0.000096 0.365120 0.006721 0.365140 27
write 22343 22344 0.000357 1048576 1024.00 0.000086 0.366639 0.005109 0.366654 28
write 22502 22503 0.000354 1048576 1024.00 0.000083 0.364039 0.005641 0.364060 29
write 22076 22077 0.000361 1048576 1024.00 0.000076 0.371066 0.008549 0.371084 30
write 22487 22488 0.000356 1048576 1024.00 0.000069 0.364279 0.005764 0.364299 31
write 22100 22101 0.000361 1048576 1024.00 0.000069 0.370668 0.008956 0.370685 32
write 22533 22534 0.000354 1048576 1024.00 0.000076 0.363547 0.005241 0.363562 33
write 22347 22348 0.000356 1048576 1024.00 0.000068 0.366561 0.005060 0.366576 34
write 22524 22525 0.000354 1048576 1024.00 0.000079 0.363685 0.005014 0.363705 35
write 22358 22359 0.000356 1048576 1024.00 0.000072 0.366385 0.004854 0.366402 36
write 22530 22531 0.000353 1048576 1024.00 0.000080 0.363589 0.005547 0.363608 37
write 22082 22084 0.000361 1048576 1024.00 0.000081 0.370955 0.008968 0.370976 38
write 22529 22530 0.000355 1048576 1024.00 0.000072 0.363602 0.005550 0.363622 39
write 22372 22373 0.000356 1048576 1024.00 0.000071 0.366154 0.005470 0.366170 40
write 22525 22526 0.000355 1048576 1024.00 0.000060 0.363666 0.005556 0.363683 41
write 22347 22348 0.000357 1048576 1024.00 0.000068 0.366564 0.004864 0.366579 42
write 22506 22507 0.000354 1048576 1024.00 0.000083 0.363979 0.005293 0.363999 43
write 22081 22082 0.000361 1048576 1024.00 0.000078 0.370985 0.009097 0.371002 44
write 22516 22517 0.000354 1048576 1024.00 0.000073 0.363808 0.005617 0.363824 45
write 22058 22059 0.000361 1048576 1024.00 0.000073 0.371361 0.009420 0.371378 46
write 22544 22545 0.000353 1048576 1024.00 0.000104 0.363363 0.005173 0.363379 47
write 21944 21945 0.000363 1048576 1024.00 0.000085 0.373293 0.011384 0.373309 48
write 22550 22551 0.000353 1048576 1024.00 0.000072 0.363268 0.004862 0.363285 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 22549.78 21388.36 22305.00 225.50 22549.78 21388.36 22305.00 225.50 0.36731 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 1048576 8192.0 POSIX 0
Finished : Tue Apr 6 17:29:09 2021
Raw
ior-1m-seq-random.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:28:00 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 1m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType r
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:28:00 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 1 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 10438 10438 0.000766 1048576 1024.00 0.000055 0.784800 0.071881 0.784813 0
write 11078 11078 0.000721 1048576 1024.00 0.000092 0.739477 0.012501 0.739512 1
write 11158 11158 0.000713 1048576 1024.00 0.000061 0.734185 0.007787 0.734204 2
write 11175 11175 0.000710 1048576 1024.00 0.000045 0.733080 0.007670 0.733096 3
write 11221 11221 0.000708 1048576 1024.00 0.000046 0.730057 0.007683 0.730077 4
write 11199 11199 0.000707 1048576 1024.00 0.000045 0.731494 0.008986 0.731512 5
write 11156 11157 0.000710 1048576 1024.00 0.000049 0.734277 0.008904 0.734300 6
write 11191 11191 0.000711 1048576 1024.00 0.000049 0.731990 0.006104 0.732011 7
write 11160 11161 0.000710 1048576 1024.00 0.000047 0.734001 0.008972 0.734019 8
write 11166 11167 0.000711 1048576 1024.00 0.000050 0.733617 0.008340 0.733637 9
write 11131 11131 0.000711 1048576 1024.00 0.000049 0.735941 0.010934 0.735961 10
write 11215 11215 0.000708 1048576 1024.00 0.000051 0.730450 0.007774 0.730468 11
write 11209 11209 0.000708 1048576 1024.00 0.000050 0.730810 0.008230 0.730833 12
write 11163 11163 0.000711 1048576 1024.00 0.000049 0.733861 0.008114 0.733881 13
write 11159 11159 0.000711 1048576 1024.00 0.000058 0.734085 0.009088 0.734101 14
write 11142 11143 0.000710 1048576 1024.00 0.000049 0.735198 0.010593 0.735219 15
write 11167 11167 0.000710 1048576 1024.00 0.000052 0.733576 0.008729 0.733595 16
write 11148 11148 0.000710 1048576 1024.00 0.000053 0.734822 0.009489 0.734842 17
write 11179 11179 0.000708 1048576 1024.00 0.000053 0.732777 0.010295 0.732797 18
write 11191 11191 0.000708 1048576 1024.00 0.000046 0.731995 0.009701 0.732012 19
write 11153 11153 0.000710 1048576 1024.00 0.000047 0.734519 0.010021 0.734538 20
write 11157 11157 0.000711 1048576 1024.00 0.000046 0.734242 0.009228 0.734262 21
write 11175 11175 0.000710 1048576 1024.00 0.000050 0.733077 0.008206 0.733097 22
write 11155 11156 0.000711 1048576 1024.00 0.000050 0.734336 0.008372 0.734356 23
write 11176 11176 0.000711 1048576 1024.00 0.000049 0.732985 0.007640 0.733005 24
write 11174 11174 0.000711 1048576 1024.00 0.000049 0.733109 0.007476 0.733128 25
write 11184 11185 0.000708 1048576 1024.00 0.000045 0.732441 0.010141 0.732458 26
write 11184 11184 0.000709 1048576 1024.00 0.000046 0.732488 0.009562 0.732505 27
write 11140 11141 0.000710 1048576 1024.00 0.000047 0.735321 0.010326 0.735342 28
write 11173 11173 0.000711 1048576 1024.00 0.000047 0.733191 0.009165 0.733210 29
write 11157 11157 0.000711 1048576 1024.00 0.000049 0.734223 0.009425 0.734241 30
write 11145 11146 0.000711 1048576 1024.00 0.000048 0.734992 0.009424 0.735011 31
write 11153 11153 0.000710 1048576 1024.00 0.000047 0.734520 0.009899 0.734538 32
write 11218 11218 0.000709 1048576 1024.00 0.000047 0.730269 0.007465 0.730285 33
write 11172 11172 0.000708 1048576 1024.00 0.000047 0.733244 0.010840 0.733262 34
write 11165 11165 0.000711 1048576 1024.00 0.000049 0.733730 0.008363 0.733750 35
write 11144 11144 0.000710 1048576 1024.00 0.000047 0.735093 0.009519 0.735111 36
write 11133 11133 0.000711 1048576 1024.00 0.000067 0.735800 0.010469 0.735824 37
write 11179 11179 0.000711 1048576 1024.00 0.000049 0.732806 0.007858 0.732826 38
write 11156 11156 0.000711 1048576 1024.00 0.000045 0.734284 0.009211 0.734301 39
write 11200 11200 0.000709 1048576 1024.00 0.000048 0.731425 0.009760 0.731444 40
write 11177 11178 0.000708 1048576 1024.00 0.000047 0.732889 0.010286 0.732909 41
write 11149 11149 0.000711 1048576 1024.00 0.000045 0.734783 0.009922 0.734802 42
write 11148 11149 0.000710 1048576 1024.00 0.000047 0.734791 0.009860 0.734812 43
write 11146 11147 0.000711 1048576 1024.00 0.000048 0.734928 0.009272 0.734948 44
write 11182 11183 0.000711 1048576 1024.00 0.000045 0.732566 0.006968 0.732583 45
write 11165 11165 0.000710 1048576 1024.00 0.000047 0.733733 0.008203 0.733753 46
write 11198 11198 0.000708 1048576 1024.00 0.000049 0.731565 0.008970 0.731586 47
write 11182 11182 0.000708 1048576 1024.00 0.000048 0.732591 0.010492 0.732611 48
write 11148 11148 0.000711 1048576 1024.00 0.000047 0.734851 0.009292 0.734870 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 11220.73 10438.16 11152.62 105.08 11220.73 10438.16 11152.62 105.08 0.73461 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 1048576 8192.0 POSIX 0
Finished : Tue Apr 6 17:28:43 2021
Raw
ior-1m-seq-timestamp.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:29:10 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 1m -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType t
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:29:10 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 1 MiB
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 22087 22088 0.000358 1048576 1024.00 0.000060 0.370876 0.014678 0.370894 0
write 22763 22765 0.000348 1048576 1024.00 0.000066 0.359855 0.021064 0.359882 1
write 23020 23021 0.000346 1048576 1024.00 0.000058 0.355842 0.004460 0.355859 2
write 23307 23308 0.000343 1048576 1024.00 0.000063 0.351470 0.006611 0.351487 3
write 23258 23259 0.000343 1048576 1024.00 0.000044 0.352214 0.006103 0.352230 4
write 23301 23302 0.000343 1048576 1024.00 0.000046 0.351555 0.006621 0.351571 5
write 23263 23264 0.000343 1048576 1024.00 0.000044 0.352138 0.006106 0.352153 6
write 23275 23276 0.000344 1048576 1024.00 0.000048 0.351944 0.006323 0.351962 7
write 23253 23254 0.000343 1048576 1024.00 0.000044 0.352287 0.006212 0.352303 8
write 23288 23289 0.000343 1048576 1024.00 0.000049 0.351753 0.006957 0.351768 9
write 23240 23241 0.000343 1048576 1024.00 0.000043 0.352484 0.006187 0.352501 10
write 23107 23108 0.000346 1048576 1024.00 0.000050 0.354503 0.007206 0.354520 11
write 23288 23289 0.000343 1048576 1024.00 0.000043 0.351753 0.006892 0.351768 12
write 23114 23115 0.000346 1048576 1024.00 0.000044 0.354401 0.006826 0.354421 13
write 23272 23273 0.000343 1048576 1024.00 0.000048 0.352000 0.006460 0.352016 14
write 23150 23151 0.000346 1048576 1024.00 0.000049 0.353846 0.006663 0.353866 15
write 23277 23279 0.000343 1048576 1024.00 0.000045 0.351911 0.006563 0.351930 16
write 23094 23095 0.000346 1048576 1024.00 0.000047 0.354707 0.007184 0.354725 17
write 23259 23260 0.000343 1048576 1024.00 0.000052 0.352187 0.006595 0.352206 18
write 23099 23100 0.000346 1048576 1024.00 0.000052 0.354633 0.006920 0.354655 19
write 23225 23226 0.000343 1048576 1024.00 0.000049 0.352710 0.006955 0.352730 20
write 23096 23097 0.000346 1048576 1024.00 0.000045 0.354681 0.006640 0.354697 21
write 23295 23296 0.000343 1048576 1024.00 0.000048 0.351653 0.006205 0.351671 22
write 23126 23127 0.000346 1048576 1024.00 0.000043 0.354223 0.006723 0.354239 23
write 23264 23266 0.000343 1048576 1024.00 0.000049 0.352107 0.006521 0.352125 24
write 23133 23134 0.000345 1048576 1024.00 0.000046 0.354111 0.007102 0.354129 25
write 23257 23258 0.000343 1048576 1024.00 0.000046 0.352219 0.007249 0.352236 26
write 23123 23124 0.000346 1048576 1024.00 0.000048 0.354259 0.007088 0.354275 27
write 23316 23317 0.000342 1048576 1024.00 0.000042 0.351329 0.006506 0.351345 28
write 23251 23252 0.000344 1048576 1024.00 0.000045 0.352317 0.007815 0.352332 29
write 23278 23279 0.000343 1048576 1024.00 0.000049 0.351908 0.006697 0.351926 30
write 23291 23292 0.000343 1048576 1024.00 0.000045 0.351707 0.006765 0.351724 31
write 23166 23167 0.000344 1048576 1024.00 0.000056 0.353609 0.007191 0.353626 32
write 23141 23142 0.000343 1048576 1024.00 0.000049 0.353982 0.009054 0.353998 33
write 23120 23121 0.000342 1048576 1024.00 0.000059 0.354314 0.009468 0.354331 34
write 23147 23148 0.000343 1048576 1024.00 0.000048 0.353891 0.009458 0.353910 35
write 23097 23098 0.000342 1048576 1024.00 0.000046 0.354659 0.009571 0.354675 36
write 23154 23155 0.000343 1048576 1024.00 0.000049 0.353790 0.009105 0.353809 37
write 22896 22897 0.000345 1048576 1024.00 0.000046 0.357770 0.010371 0.357789 38
write 23189 23190 0.000342 1048576 1024.00 0.000062 0.353253 0.009117 0.353271 39
write 22886 22887 0.000345 1048576 1024.00 0.000045 0.357930 0.010445 0.357946 40
write 23189 23190 0.000342 1048576 1024.00 0.000048 0.353257 0.009184 0.353275 41
write 22933 22934 0.000345 1048576 1024.00 0.000050 0.357192 0.010019 0.357213 42
write 23166 23167 0.000343 1048576 1024.00 0.000047 0.353603 0.009387 0.353620 43
write 22944 22945 0.000345 1048576 1024.00 0.000045 0.357027 0.009623 0.357044 44
write 23243 23244 0.000344 1048576 1024.00 0.000046 0.352435 0.006694 0.352454 45
write 23027 23028 0.000346 1048576 1024.00 0.000046 0.355739 0.007140 0.355757 46
write 23211 23212 0.000344 1048576 1024.00 0.000050 0.352918 0.006830 0.352936 47
write 23034 23035 0.000346 1048576 1024.00 0.000045 0.355628 0.006679 0.355643 48
write 23219 23220 0.000345 1048576 1024.00 0.000046 0.352801 0.006973 0.352818 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 23316.11 22087.18 23142.59 194.69 23316.11 22087.18 23142.59 194.69 0.35401 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 1048576 8192.0 POSIX 0
Finished : Tue Apr 6 17:29:34 2021
Raw
ior-4k-rand-incompressible.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:22:19 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -z -i 50 --dataPacketType i
Machine : Linux nid00060
TestID : 0
StartTime : Tue Apr 6 17:22:19 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : random
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 10261 2626986 0.000003 1048576 4.00 0.000055 0.798311 0.067959 0.798327 0
write 11006 2817688 0.000003 1048576 4.00 0.000087 0.744281 0.023054 0.744304 1
write 11196 2866128 0.000003 1048576 4.00 0.000059 0.731702 0.018673 0.731721 2
write 11197 2866391 0.000003 1048576 4.00 0.000053 0.731635 0.018101 0.731656 3
write 11180 2862193 0.000003 1048576 4.00 0.000049 0.732708 0.020280 0.732728 4
write 11223 2873121 0.000003 1048576 4.00 0.000053 0.729921 0.019956 0.729941 5
write 11207 2869011 0.000003 1048576 4.00 0.000053 0.730967 0.019022 0.730989 6
write 11239 2877289 0.000003 1048576 4.00 0.000054 0.728864 0.019182 0.728888 7
write 11170 2859547 0.000003 1048576 4.00 0.000051 0.733386 0.019051 0.733405 8
write 11208 2869285 0.000003 1048576 4.00 0.000052 0.730897 0.019857 0.730919 9
write 11167 2858792 0.000003 1048576 4.00 0.000048 0.733580 0.020827 0.733600 10
write 11186 2863820 0.000003 1048576 4.00 0.000052 0.732292 0.017089 0.732314 11
write 11211 2869989 0.000003 1048576 4.00 0.000051 0.730718 0.016180 0.730737 12
write 11195 2866086 0.000003 1048576 4.00 0.000051 0.731713 0.017754 0.731732 13
write 11192 2865334 0.000003 1048576 4.00 0.000053 0.731905 0.017628 0.731923 14
write 11198 2866892 0.000003 1048576 4.00 0.000053 0.731507 0.019574 0.731530 15
write 11224 2873406 0.000003 1048576 4.00 0.000050 0.729849 0.019032 0.729869 16
write 11176 2861127 0.000003 1048576 4.00 0.000064 0.732981 0.019818 0.733006 17
write 11215 2870994 0.000003 1048576 4.00 0.000052 0.730462 0.015809 0.730482 18
write 11186 2863815 0.000003 1048576 4.00 0.000051 0.732293 0.018601 0.732313 19
write 11208 2869304 0.000003 1048576 4.00 0.000052 0.730892 0.017591 0.730913 20
write 10995 2814856 0.000003 1048576 4.00 0.000056 0.745030 0.023016 0.745049 21
write 11017 2820303 0.000003 1048576 4.00 0.000051 0.743591 0.019210 0.743611 22
write 11201 2867524 0.000003 1048576 4.00 0.000052 0.731346 0.018181 0.731366 23
write 11188 2864250 0.000003 1048576 4.00 0.000052 0.732182 0.018035 0.732202 24
write 11194 2865745 0.000003 1048576 4.00 0.000053 0.731800 0.017624 0.731820 25
write 11225 2873733 0.000003 1048576 4.00 0.000051 0.729766 0.016372 0.729787 26
write 11238 2876902 0.000003 1048576 4.00 0.000050 0.728962 0.018550 0.728982 27
write 11220 2872393 0.000003 1048576 4.00 0.000050 0.730106 0.017567 0.730124 28
write 11189 2864445 0.000003 1048576 4.00 0.000050 0.732132 0.018102 0.732150 29
write 10949 2802985 0.000003 1048576 4.00 0.000049 0.748185 0.025041 0.748205 30
write 11193 2865400 0.000003 1048576 4.00 0.000053 0.731888 0.010785 0.731909 31
write 11192 2865184 0.000003 1048576 4.00 0.000053 0.731943 0.018863 0.731964 32
write 11175 2860765 0.000003 1048576 4.00 0.000052 0.733074 0.019221 0.733096 33
write 11198 2866779 0.000003 1048576 4.00 0.000049 0.731536 0.018110 0.731555 34
write 11191 2864879 0.000003 1048576 4.00 0.000052 0.732021 0.019031 0.732043 35
write 10973 2809237 0.000003 1048576 4.00 0.000052 0.746520 0.020107 0.746540 36
write 11217 2871588 0.000003 1048576 4.00 0.000053 0.730311 0.017608 0.730330 37
write 11232 2875577 0.000003 1048576 4.00 0.000050 0.729298 0.016596 0.729317 38
write 11204 2868434 0.000003 1048576 4.00 0.000051 0.731114 0.017088 0.731135 39
write 11199 2866994 0.000003 1048576 4.00 0.000054 0.731481 0.017959 0.731503 40
write 11208 2869254 0.000003 1048576 4.00 0.000058 0.730905 0.016968 0.730926 41
write 11177 2861358 0.000003 1048576 4.00 0.000052 0.732922 0.017301 0.732941 42
write 11193 2865509 0.000003 1048576 4.00 0.000051 0.731860 0.018570 0.731879 43
write 11194 2865796 0.000003 1048576 4.00 0.000052 0.731787 0.018144 0.731806 44
write 11198 2866646 0.000003 1048576 4.00 0.000051 0.731570 0.017290 0.731588 45
write 11196 2866152 0.000003 1048576 4.00 0.000051 0.731696 0.020332 0.731715 46
write 11230 2874938 0.000003 1048576 4.00 0.000053 0.729460 0.017952 0.729481 47
write 11011 2819002 0.000003 1048576 4.00 0.000050 0.743934 0.029749 0.743954 48
write 11227 2874209 0.000003 1048576 4.00 0.000072 0.729645 0.016812 0.729670 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 11239.04 10261.46 11157.35 146.08 2877194.56 2626933.68 2856281.64 37395.54 0.73436 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:23:04 2021
Raw
ior-4k-rand-random.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:21:14 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -z -i 50 --dataPacketType r
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:21:14 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : random
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 6867 1758055 0.000004 1048576 4.00 0.000062 1.19 0.099079 1.19 0
write 7374 1887682 0.000004 1048576 4.00 0.000091 1.11 0.010082 1.11 1
write 7393 1892754 0.000004 1048576 4.00 0.000051 1.11 0.010319 1.11 2
write 7400 1894376 0.000004 1048576 4.00 0.000048 1.11 0.010298 1.11 3
write 7391 1892195 0.000004 1048576 4.00 0.000068 1.11 0.010478 1.11 4
write 7393 1892615 0.000004 1048576 4.00 0.000056 1.11 0.012029 1.11 5
write 7389 1891584 0.000004 1048576 4.00 0.000064 1.11 0.011092 1.11 6
write 7398 1893854 0.000004 1048576 4.00 0.000051 1.11 0.010530 1.11 7
write 7395 1893081 0.000004 1048576 4.00 0.000051 1.11 0.010146 1.11 8
write 7399 1894239 0.000004 1048576 4.00 0.000054 1.11 0.009173 1.11 9
write 7390 1891883 0.000004 1048576 4.00 0.000050 1.11 0.010889 1.11 10
write 7405 1895655 0.000004 1048576 4.00 0.000048 1.11 0.009925 1.11 11
write 7378 1888715 0.000004 1048576 4.00 0.000050 1.11 0.009858 1.11 12
write 7404 1895333 0.000004 1048576 4.00 0.000051 1.11 0.010384 1.11 13
write 7390 1891796 0.000004 1048576 4.00 0.000049 1.11 0.011235 1.11 14
write 7404 1895427 0.000004 1048576 4.00 0.000051 1.11 0.009238 1.11 15
write 7385 1890486 0.000004 1048576 4.00 0.000054 1.11 0.012152 1.11 16
write 7409 1896754 0.000004 1048576 4.00 0.000055 1.11 0.008803 1.11 17
write 7396 1893292 0.000004 1048576 4.00 0.000054 1.11 0.009718 1.11 18
write 7379 1889028 0.000004 1048576 4.00 0.000051 1.11 0.011116 1.11 19
write 7390 1891967 0.000004 1048576 4.00 0.000052 1.11 0.010407 1.11 20
write 7400 1894324 0.000004 1048576 4.00 0.000056 1.11 0.010768 1.11 21
write 7388 1891231 0.000004 1048576 4.00 0.000050 1.11 0.010925 1.11 22
write 7394 1892861 0.000004 1048576 4.00 0.000063 1.11 0.011063 1.11 23
write 7390 1891798 0.000004 1048576 4.00 0.000049 1.11 0.008731 1.11 24
write 7393 1892596 0.000004 1048576 4.00 0.000051 1.11 0.007830 1.11 25
write 7390 1891837 0.000004 1048576 4.00 0.000051 1.11 0.010878 1.11 26
write 7396 1893519 0.000004 1048576 4.00 0.000055 1.11 0.011256 1.11 27
write 7393 1892557 0.000004 1048576 4.00 0.000051 1.11 0.009767 1.11 28
write 7400 1894366 0.000004 1048576 4.00 0.000052 1.11 0.010847 1.11 29
write 7383 1890012 0.000004 1048576 4.00 0.000053 1.11 0.009939 1.11 30
write 7399 1894253 0.000004 1048576 4.00 0.000050 1.11 0.009740 1.11 31
write 7387 1891158 0.000004 1048576 4.00 0.000050 1.11 0.011676 1.11 32
write 7388 1891478 0.000004 1048576 4.00 0.000054 1.11 0.012785 1.11 33
write 7396 1893306 0.000004 1048576 4.00 0.000053 1.11 0.009503 1.11 34
write 7391 1892125 0.000004 1048576 4.00 0.000051 1.11 0.011091 1.11 35
write 7394 1892806 0.000004 1048576 4.00 0.000053 1.11 0.010329 1.11 36
write 7385 1890520 0.000004 1048576 4.00 0.000053 1.11 0.009559 1.11 37
write 7388 1891309 0.000004 1048576 4.00 0.000051 1.11 0.011200 1.11 38
write 7393 1892552 0.000004 1048576 4.00 0.000049 1.11 0.010693 1.11 39
write 7389 1891623 0.000004 1048576 4.00 0.000053 1.11 0.011650 1.11 40
write 7402 1894903 0.000004 1048576 4.00 0.000056 1.11 0.010107 1.11 41
write 7393 1892659 0.000004 1048576 4.00 0.000051 1.11 0.010780 1.11 42
write 7394 1893027 0.000004 1048576 4.00 0.000051 1.11 0.012287 1.11 43
write 7395 1893135 0.000004 1048576 4.00 0.000049 1.11 0.011004 1.11 44
write 7364 1885233 0.000004 1048576 4.00 0.000053 1.11 0.015403 1.11 45
write 7332 1877117 0.000004 1048576 4.00 0.000050 1.12 0.019209 1.12 46
write 7395 1893257 0.000004 1048576 4.00 0.000052 1.11 0.011498 1.11 47
write 7373 1887463 0.000004 1048576 4.00 0.000052 1.11 0.009484 1.11 48
write 7412 1897593 0.000004 1048576 4.00 0.000056 1.11 0.009024 1.11 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 7412.30 6867.33 7380.44 74.29 1897548.77 1758037.20 1889393.24 19019.12 1.11008 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:22:18 2021
Raw
ior-4k-rand-timestamp.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:23:05 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -z -i 50 --dataPacketType t
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:23:05 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : random
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 10452 2675706 0.000003 1048576 4.00 0.000059 0.783775 0.117512 0.783792 0
write 11265 2883987 0.000003 1048576 4.00 0.000074 0.727171 0.015826 0.727186 1
write 11242 2878106 0.000003 1048576 4.00 0.000049 0.728657 0.015595 0.728676 2
write 11220 2872422 0.000003 1048576 4.00 0.000059 0.730099 0.015409 0.730126 3
write 11241 2877715 0.000003 1048576 4.00 0.000051 0.728756 0.012549 0.728774 4
write 11272 2885650 0.000003 1048576 4.00 0.000053 0.726752 0.010855 0.726772 5
write 11265 2883995 0.000003 1048576 4.00 0.000052 0.727169 0.012618 0.727189 6
write 11206 2868701 0.000003 1048576 4.00 0.000051 0.731046 0.013711 0.731066 7
write 11224 2873362 0.000003 1048576 4.00 0.000064 0.729860 0.015536 0.729879 8
write 11231 2875289 0.000003 1048576 4.00 0.000083 0.729371 0.015408 0.729390 9
write 11287 2889531 0.000003 1048576 4.00 0.000077 0.725776 0.015120 0.725796 10
write 11267 2884384 0.000003 1048576 4.00 0.000052 0.727071 0.014074 0.727089 11
write 11263 2883384 0.000003 1048576 4.00 0.000052 0.727323 0.012352 0.727342 12
write 11238 2876910 0.000003 1048576 4.00 0.000049 0.728960 0.015258 0.728979 13
write 11243 2878260 0.000003 1048576 4.00 0.000057 0.728618 0.013978 0.728642 14
write 11244 2878437 0.000003 1048576 4.00 0.000051 0.728573 0.014959 0.728591 15
write 11238 2877068 0.000003 1048576 4.00 0.000052 0.728920 0.013071 0.728938 16
write 11261 2882984 0.000003 1048576 4.00 0.000052 0.727424 0.011511 0.727445 17
write 11258 2882120 0.000003 1048576 4.00 0.000053 0.727642 0.012742 0.727662 18
write 11263 2883500 0.000003 1048576 4.00 0.000052 0.727294 0.013222 0.727316 19
write 11287 2889566 0.000003 1048576 4.00 0.000050 0.725767 0.014949 0.725786 20
write 11299 2892572 0.000003 1048576 4.00 0.000049 0.725013 0.012349 0.725029 21
write 11275 2886512 0.000003 1048576 4.00 0.000053 0.726535 0.013286 0.726555 22
write 11232 2875557 0.000003 1048576 4.00 0.000051 0.729303 0.014337 0.729321 23
write 11249 2879754 0.000003 1048576 4.00 0.000055 0.728240 0.014155 0.728259 24
write 11232 2875572 0.000003 1048576 4.00 0.000050 0.729299 0.014145 0.729316 25
write 11252 2880486 0.000003 1048576 4.00 0.000050 0.728055 0.014877 0.728075 26
write 11214 2870936 0.000003 1048576 4.00 0.000063 0.730477 0.014938 0.730507 27
write 11247 2879240 0.000003 1048576 4.00 0.000056 0.728370 0.011481 0.728389 28
write 11242 2878122 0.000003 1048576 4.00 0.000054 0.728653 0.015685 0.728670 29
write 11260 2882770 0.000003 1048576 4.00 0.000052 0.727478 0.013996 0.727499 30
write 11254 2881130 0.000003 1048576 4.00 0.000055 0.727892 0.013149 0.727911 31
write 11248 2879545 0.000003 1048576 4.00 0.000065 0.728293 0.012210 0.728312 32
write 11237 2876625 0.000003 1048576 4.00 0.000050 0.729032 0.015053 0.729052 33
write 11220 2872287 0.000003 1048576 4.00 0.000053 0.730133 0.015847 0.730153 34
write 11238 2876981 0.000003 1048576 4.00 0.000055 0.728942 0.013273 0.728965 35
write 11253 2880964 0.000003 1048576 4.00 0.000054 0.727934 0.013169 0.727956 36
write 11267 2884492 0.000003 1048576 4.00 0.000061 0.727044 0.012841 0.727064 37
write 11226 2873878 0.000003 1048576 4.00 0.000052 0.729729 0.017276 0.729748 38
write 11299 2892552 0.000003 1048576 4.00 0.000064 0.725018 0.013425 0.725036 39
write 11262 2883043 0.000003 1048576 4.00 0.000050 0.727409 0.013726 0.727427 40
write 11241 2877727 0.000003 1048576 4.00 0.000050 0.728753 0.014301 0.728771 41
write 11196 2866293 0.000003 1048576 4.00 0.000049 0.731660 0.018375 0.731678 42
write 11214 2870743 0.000003 1048576 4.00 0.000052 0.730526 0.015645 0.730546 43
write 11219 2872138 0.000003 1048576 4.00 0.000050 0.730171 0.015028 0.730188 44
write 11227 2874087 0.000003 1048576 4.00 0.000049 0.729676 0.014303 0.729694 45
write 11240 2877403 0.000003 1048576 4.00 0.000052 0.728835 0.015113 0.728857 46
write 11210 2869804 0.000003 1048576 4.00 0.000052 0.730765 0.016047 0.730785 47
write 11185 2863503 0.000003 1048576 4.00 0.000055 0.732373 0.019990 0.732392 48
write 11260 2882636 0.000003 1048576 4.00 0.000055 0.727512 0.014421 0.727530 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 11298.85 10451.75 11229.26 113.69 2892506.83 2675648.58 2874691.43 29104.34 0.72960 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:23:51 2021
Raw
ior-4k-seq-incompressible.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:25:43 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType i
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:25:43 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 11370 2910714 0.000003 1048576 4.00 0.000086 0.720494 0.052542 0.720511 0
write 11988 3069072 0.000003 1048576 4.00 0.000087 0.683318 0.017567 0.683338 1
write 12115 3101429 0.000003 1048576 4.00 0.000073 0.676189 0.007799 0.676209 2
write 12110 3100292 0.000003 1048576 4.00 0.000050 0.676437 0.009429 0.676456 3
write 12151 3110805 0.000003 1048576 4.00 0.000050 0.674151 0.008831 0.674172 4
write 12167 3114810 0.000003 1048576 4.00 0.000051 0.673284 0.009365 0.673305 5
write 12149 3110228 0.000003 1048576 4.00 0.000051 0.674276 0.007156 0.674298 6
write 12116 3101718 0.000003 1048576 4.00 0.000054 0.676126 0.008960 0.676147 7
write 12143 3108702 0.000003 1048576 4.00 0.000046 0.674607 0.007371 0.674627 8
write 12098 3097083 0.000003 1048576 4.00 0.000048 0.677138 0.009864 0.677157 9
write 12160 3112924 0.000003 1048576 4.00 0.000047 0.673692 0.008663 0.673710 10
write 12101 3097965 0.000003 1048576 4.00 0.000044 0.676945 0.010241 0.676963 11
write 12135 3106542 0.000003 1048576 4.00 0.000049 0.675076 0.007638 0.675095 12
write 12083 3093400 0.000003 1048576 4.00 0.000053 0.677944 0.010689 0.677962 13
write 12140 3107877 0.000003 1048576 4.00 0.000045 0.674786 0.007735 0.674806 14
write 12161 3113373 0.000003 1048576 4.00 0.000048 0.673595 0.009584 0.673613 15
write 12151 3110786 0.000003 1048576 4.00 0.000047 0.674155 0.007492 0.674174 16
write 12114 3101158 0.000003 1048576 4.00 0.000054 0.676248 0.009491 0.676268 17
write 12133 3106178 0.000003 1048576 4.00 0.000052 0.675155 0.007625 0.675175 18
write 12105 3098958 0.000003 1048576 4.00 0.000047 0.676728 0.009017 0.676747 19
write 12195 3122109 0.000003 1048576 4.00 0.000048 0.671710 0.007042 0.671729 20
write 12145 3109191 0.000003 1048576 4.00 0.000047 0.674501 0.009492 0.674518 21
write 12147 3109596 0.000003 1048576 4.00 0.000046 0.674413 0.006939 0.674429 22
write 12096 3096653 0.000003 1048576 4.00 0.000046 0.677232 0.009767 0.677251 23
write 12121 3103077 0.000003 1048576 4.00 0.000047 0.675830 0.008355 0.675849 24
write 12104 3098611 0.000003 1048576 4.00 0.000050 0.676804 0.012573 0.676825 25
write 12189 3120335 0.000003 1048576 4.00 0.000042 0.672092 0.007897 0.672106 26
write 12113 3101007 0.000003 1048576 4.00 0.000047 0.676281 0.009334 0.676299 27
write 12106 3099229 0.000003 1048576 4.00 0.000534 0.676669 0.009850 0.676692 28
write 12112 3100736 0.000003 1048576 4.00 0.000050 0.676340 0.011115 0.676358 29
write 12157 3112157 0.000003 1048576 4.00 0.000048 0.673858 0.012343 0.673877 30
write 12162 3113613 0.000003 1048576 4.00 0.000043 0.673543 0.011983 0.673558 31
write 12114 3101310 0.000003 1048576 4.00 0.000046 0.676215 0.011194 0.676232 32
write 12093 3095939 0.000003 1048576 4.00 0.000045 0.677388 0.012786 0.677408 33
write 12096 3096565 0.000003 1048576 4.00 0.000044 0.677251 0.012247 0.677268 34
write 12170 3115518 0.000003 1048576 4.00 0.000045 0.673131 0.010973 0.673154 35
write 12144 3108951 0.000003 1048576 4.00 0.000045 0.674553 0.012316 0.674571 36
write 12117 3102159 0.000003 1048576 4.00 0.000050 0.676030 0.011437 0.676049 37
write 12107 3099357 0.000003 1048576 4.00 0.000046 0.676641 0.011941 0.676657 38
write 12115 3101544 0.000003 1048576 4.00 0.000047 0.676164 0.010664 0.676183 39
write 12156 3111939 0.000003 1048576 4.00 0.000047 0.673905 0.011839 0.673925 40
write 12163 3113700 0.000003 1048576 4.00 0.000047 0.673524 0.011308 0.673542 41
write 12118 3102222 0.000003 1048576 4.00 0.000046 0.676016 0.012584 0.676034 42
write 12115 3101456 0.000003 1048576 4.00 0.000047 0.676183 0.012106 0.676202 43
write 12119 3102516 0.000003 1048576 4.00 0.000051 0.675952 0.012020 0.675969 44
write 12122 3103269 0.000003 1048576 4.00 0.000049 0.675788 0.013452 0.675809 45
write 12136 3106924 0.000003 1048576 4.00 0.000045 0.674993 0.012945 0.675010 46
write 12117 3102094 0.000003 1048576 4.00 0.000044 0.676044 0.011172 0.676062 47
write 12107 3099572 0.000003 1048576 4.00 0.000048 0.676594 0.012236 0.676615 48
write 12123 3103517 0.000003 1048576 4.00 0.000046 0.675734 0.010169 0.675754 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 12195.40 11369.71 12111.29 110.71 3122021.63 2910645.52 3100490.88 28341.59 0.67645 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:26:23 2021
Raw
ior-4k-seq-random.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:24:42 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType r
Machine : Linux nid00062
TestID : 0
StartTime : Tue Apr 6 17:24:42 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 7314 1872455 0.000004 1048576 4.00 0.000047 1.12 0.097888 1.12 0
write 7765 1987935 0.000004 1048576 4.00 0.000091 1.05 0.007341 1.05 1
write 7779 1991556 0.000004 1048576 4.00 0.000049 1.05 0.010586 1.05 2
write 7779 1991361 0.000004 1048576 4.00 0.000046 1.05 0.012123 1.05 3
write 7781 1991912 0.000004 1048576 4.00 0.000047 1.05 0.011066 1.05 4
write 7780 1991671 0.000004 1048576 4.00 0.000050 1.05 0.011538 1.05 5
write 7782 1992182 0.000004 1048576 4.00 0.000048 1.05 0.009671 1.05 6
write 7781 1992021 0.000004 1048576 4.00 0.000050 1.05 0.012141 1.05 7
write 7780 1991624 0.000004 1048576 4.00 0.000049 1.05 0.010410 1.05 8
write 7778 1991276 0.000004 1048576 4.00 0.000043 1.05 0.012749 1.05 9
write 7780 1991796 0.000004 1048576 4.00 0.000047 1.05 0.010060 1.05 10
write 7757 1985825 0.000004 1048576 4.00 0.000047 1.06 0.012536 1.06 11
write 7782 1992144 0.000004 1048576 4.00 0.000045 1.05 0.010645 1.05 12
write 7776 1990811 0.000004 1048576 4.00 0.000047 1.05 0.012002 1.05 13
write 7725 1977516 0.000004 1048576 4.00 0.000762 1.06 0.014551 1.06 14
write 7788 1993671 0.000004 1048576 4.00 0.000059 1.05 0.007497 1.05 15
write 7755 1985238 0.000004 1048576 4.00 0.000052 1.06 0.013076 1.06 16
write 7786 1993233 0.000004 1048576 4.00 0.000047 1.05 0.008218 1.05 17
write 7757 1985755 0.000004 1048576 4.00 0.000064 1.06 0.012790 1.06 18
write 7786 1993259 0.000004 1048576 4.00 0.000047 1.05 0.008921 1.05 19
write 7760 1986677 0.000004 1048576 4.00 0.000044 1.06 0.011024 1.06 20
write 7788 1993795 0.000004 1048576 4.00 0.000046 1.05 0.008292 1.05 21
write 7776 1990790 0.000004 1048576 4.00 0.000059 1.05 0.007018 1.05 22
write 7788 1993846 0.000004 1048576 4.00 0.000046 1.05 0.008099 1.05 23
write 7781 1992043 0.000004 1048576 4.00 0.000051 1.05 0.009538 1.05 24
write 7781 1991943 0.000004 1048576 4.00 0.000046 1.05 0.007237 1.05 25
write 7791 1994592 0.000004 1048576 4.00 0.000046 1.05 0.008255 1.05 26
write 7788 1993744 0.000004 1048576 4.00 0.000045 1.05 0.007730 1.05 27
write 7793 1994996 0.000004 1048576 4.00 0.000046 1.05 0.007909 1.05 28
write 7792 1994860 0.000004 1048576 4.00 0.000048 1.05 0.007900 1.05 29
write 7788 1993733 0.000004 1048576 4.00 0.000049 1.05 0.006552 1.05 30
write 7786 1993145 0.000004 1048576 4.00 0.000048 1.05 0.008522 1.05 31
write 7788 1993879 0.000004 1048576 4.00 0.000046 1.05 0.008404 1.05 32
write 7791 1994636 0.000004 1048576 4.00 0.000069 1.05 0.007464 1.05 33
write 7790 1994171 0.000004 1048576 4.00 0.000045 1.05 0.008608 1.05 34
write 7787 1993578 0.000004 1048576 4.00 0.000048 1.05 0.007628 1.05 35
write 7796 1995860 0.000004 1048576 4.00 0.000047 1.05 0.008193 1.05 36
write 7787 1993521 0.000004 1048576 4.00 0.000046 1.05 0.007397 1.05 37
write 7789 1993992 0.000004 1048576 4.00 0.000045 1.05 0.008412 1.05 38
write 7793 1995017 0.000004 1048576 4.00 0.000044 1.05 0.007187 1.05 39
write 7792 1994714 0.000004 1048576 4.00 0.000046 1.05 0.007949 1.05 40
write 7786 1993312 0.000004 1048576 4.00 0.000044 1.05 0.008042 1.05 41
write 7790 1994245 0.000004 1048576 4.00 0.000046 1.05 0.008134 1.05 42
write 7784 1992729 0.000004 1048576 4.00 0.000047 1.05 0.008354 1.05 43
write 7791 1994471 0.000004 1048576 4.00 0.000042 1.05 0.008445 1.05 44
write 7786 1993375 0.000004 1048576 4.00 0.000048 1.05 0.008183 1.05 45
write 7720 1976478 0.000004 1048576 4.00 0.000046 1.06 0.015866 1.06 46
write 7654 1959365 0.000004 1048576 4.00 0.000049 1.07 0.026181 1.07 47
write 7792 1994677 0.000004 1048576 4.00 0.000048 1.05 0.007424 1.05 48
write 7789 1994139 0.000004 1048576 4.00 0.000048 1.05 0.006856 1.05 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 7796.20 7314.19 7768.58 68.97 1995826.19 1872433.82 1988756.83 17656.14 1.05459 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:25:42 2021
Raw
ior-4k-seq-timestamp.txt
IOR-3.4.0+dev: MPI Coordinated Test of Parallel I/O
Began : Tue Apr 6 17:26:24 2021
Command line : /global/homes/g/glock/src/git/ior-incompress/build/src/ior -w -F -t 4096 -b 1g -s 1 -o /dev/shm/testFile -i 50 --dataPacketType t
Machine : Linux nid00060
TestID : 0
StartTime : Tue Apr 6 17:26:24 2021
Path : /dev/shm/testFile.00000000
FS : 62.9 GiB Used FS: 0.0% Inodes: 15.7 Mi Used Inodes: 0.0%
Options:
api : POSIX
apiVersion :
test filename : /dev/shm/testFile
access : file-per-process
type : independent
segments : 1
ordering in a file : sequential
ordering inter file : no tasks offsets
nodes : 1
tasks : 8
clients per node : 8
repetitions : 50
xfersize : 4096 bytes
blocksize : 1 GiB
aggregate filesize : 8 GiB
Results:
access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter
------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ----
write 11643 2980712 0.000003 1048576 4.00 0.000081 0.703574 0.062696 0.703604 0
write 12224 3129453 0.000003 1048576 4.00 0.000073 0.670134 0.010169 0.670153 1
write 12218 3127954 0.000003 1048576 4.00 0.000051 0.670455 0.007486 0.670477 2
write 12205 3124515 0.000003 1048576 4.00 0.000048 0.671193 0.008776 0.671213 3
write 12188 3120228 0.000003 1048576 4.00 0.000047 0.672115 0.008606 0.672133 4
write 12250 3136167 0.000003 1048576 4.00 0.000047 0.668699 0.008516 0.668718 5
write 12245 3134851 0.000003 1048576 4.00 0.000047 0.668980 0.007853 0.668999 6
write 12206 3124956 0.000003 1048576 4.00 0.000049 0.671098 0.008616 0.671119 7
write 12263 3139417 0.000003 1048576 4.00 0.000704 0.668007 0.005501 0.668029 8
write 12266 3140160 0.000003 1048576 4.00 0.000046 0.667849 0.006053 0.667868 9
write 12286 3145406 0.000003 1048576 4.00 0.000048 0.666735 0.005160 0.666754 10
write 12310 3151428 0.000003 1048576 4.00 0.000053 0.665461 0.006241 0.665483 11
write 12266 3140272 0.000003 1048576 4.00 0.000043 0.667825 0.004791 0.667843 12
write 12280 3143887 0.000003 1048576 4.00 0.000046 0.667057 0.005804 0.667075 13
write 12204 3124426 0.000003 1048576 4.00 0.000049 0.671212 0.007564 0.671234 14
write 12322 3154627 0.000003 1048576 4.00 0.000049 0.664786 0.005216 0.664806 15
write 12303 3149587 0.000003 1048576 4.00 0.000044 0.665850 0.005139 0.665868 16
write 12272 3141683 0.000003 1048576 4.00 0.000052 0.667525 0.005620 0.667545 17
write 12251 3136468 0.000003 1048576 4.00 0.000048 0.668635 0.005422 0.668654 18
write 12272 3141731 0.000003 1048576 4.00 0.000047 0.667515 0.006303 0.667532 19
write 12308 3151006 0.000003 1048576 4.00 0.000047 0.665550 0.005440 0.665569 20
write 12321 3154338 0.000003 1048576 4.00 0.000044 0.664847 0.005680 0.664863 21
write 12265 3139905 0.000003 1048576 4.00 0.000047 0.667903 0.005451 0.667922 22
write 12273 3141970 0.000003 1048576 4.00 0.000053 0.667464 0.006110 0.667484 23
write 12255 3137280 0.000003 1048576 4.00 0.000050 0.668462 0.005309 0.668481 24
write 12322 3154533 0.000003 1048576 4.00 0.000046 0.664806 0.005582 0.664825 25
write 12283 3144505 0.000003 1048576 4.00 0.000044 0.666926 0.006841 0.666941 26
write 12280 3143793 0.000003 1048576 4.00 0.000048 0.667077 0.005697 0.667094 27
write 12249 3135784 0.000003 1048576 4.00 0.000051 0.668781 0.005494 0.668799 28
write 12274 3142215 0.000003 1048576 4.00 0.000046 0.667412 0.005286 0.667430 29
write 12318 3153394 0.000003 1048576 4.00 0.000048 0.665046 0.004017 0.665065 30
write 12280 3143666 0.000003 1048576 4.00 0.000050 0.667104 0.005813 0.667123 31
write 12267 3140451 0.000003 1048576 4.00 0.000045 0.667787 0.004722 0.667807 32
write 12280 3143726 0.000003 1048576 4.00 0.000047 0.667091 0.005534 0.667108 33
write 12186 3119824 0.000003 1048576 4.00 0.000046 0.672202 0.003903 0.672222 34
write 12334 3157606 0.000003 1048576 4.00 0.000049 0.664159 0.005050 0.664179 35
write 12258 3138256 0.000003 1048576 4.00 0.000044 0.668254 0.004898 0.668272 36
write 12282 3144151 0.000003 1048576 4.00 0.000045 0.667001 0.005025 0.667018 37
write 12264 3139608 0.000003 1048576 4.00 0.000045 0.667966 0.004578 0.667984 38
write 12248 3135488 0.000003 1048576 4.00 0.000046 0.668844 0.006467 0.668864 39
write 12308 3150849 0.000003 1048576 4.00 0.000045 0.665583 0.004831 0.665600 40
write 12276 3142869 0.000003 1048576 4.00 0.000048 0.667273 0.005066 0.667293 41
write 12270 3141203 0.000003 1048576 4.00 0.000046 0.667627 0.004276 0.667646 42
write 12267 3140488 0.000003 1048576 4.00 0.000046 0.667779 0.005438 0.667797 43
write 12271 3141344 0.000003 1048576 4.00 0.000046 0.667597 0.005687 0.667616 44
write 12321 3154171 0.000003 1048576 4.00 0.000043 0.664882 0.005389 0.664898 45
write 12268 3140695 0.000003 1048576 4.00 0.000044 0.667735 0.004412 0.667753 46
write 12176 3117112 0.000003 1048576 4.00 0.000043 0.672787 0.010088 0.672805 47
write 12260 3138745 0.000003 1048576 4.00 0.000049 0.668150 0.004994 0.668169 48
write 12312 3151971 0.000003 1048576 4.00 0.000047 0.665346 0.005075 0.665365 49
Summary of all tests:
Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum
write 12334.02 11642.91 12255.03 94.90 3157509.84 2980585.74 3137287.99 24293.80 0.66850 NA NA 0 8 8 50 1 0 1 0 0 1 1073741824 4096 8192.0 POSIX 0
Finished : Tue Apr 6 17:27:04 2021
Raw
test-incompress.sh
#!/usr/bin/env bash
IOR_HOME="$HOME/src/git/ior-incompress/build/src"
IOR="${IOR_HOME}/ior"
MDTEST="${IOR_HOME}/mdtest"
MDWORKBENCH="${IOR_HOME}/md-workbench"
export DARSHAN_DISABLE=1
set -e
srun "$MDTEST" --dataPacketType=i -C -F -w 102400 -n 16 -L
tar --remove-files -cjf mdtest-incompressible.tar.bz2 out
srun "$MDTEST" --dataPacketType=r -C -F -w 102400 -n 16 -L
tar --remove-files -cjf mdtest-random.tar.bz2 out
srun "$MDWORKBENCH" -S 102400 --dataPacketType r --obj-per-proc 1 --data-sets 5 --iterations 1 --precreate-per-set 5 --verbose --run-precreate --run-benchmark
tar --remove-files -cjf mdworkbench-random.tar.bz2 out
srun "$MDWORKBENCH" -S 102400 --dataPacketType i --obj-per-proc 1 --data-sets 5 --iterations 1 --precreate-per-set 5 --verbose --run-precreate --run-benchmark
tar --remove-files -cjf mdworkbench-incompressible.tar.bz2 out
srun "$IOR" -w -r -F -t 4096 -b 4096 -s 1024 -o /dev/shm/testFile -z -i 10
for tsize in 4k 1m 128m; do
for pattern in "seq" "rand"; do
if [ $pattern == "rand" ]; then
extra_opts="-z"
fi
for dpt in r i t; do
srun "$IOR" -w -F -t $tsize -b 1g -s 1 -o /dev/shm/testFile -i 10 $extra_opts --dataPacketType $dpt | tee ior-${tsize}-${pattern}-${dpt}.txt
done
done
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment