Created
August 22, 2014 12:13
-
-
Save suma/738de00f3e1403ba36a5 to your computer and use it in GitHub Desktop.
Infiniband Mellanox ConnectX-2/AMD A10-7700K to i7-920
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # iperf3 IP over IB | |
| [suma@localhost ~]$ iperf3 -c 10.0.0.22 | |
| Connecting to host 10.0.0.22, port 5201 | |
| [ 4] local 10.0.0.21 port 56066 connected to 10.0.0.22 port 5201 | |
| [ ID] Interval Transfer Bandwidth Retr Cwnd | |
| [ 4] 0.00-1.00 sec 721 MBytes 6.04 Gbits/sec 50 451 KBytes | |
| [ 4] 1.00-2.00 sec 885 MBytes 7.43 Gbits/sec 70 303 KBytes | |
| [ 4] 2.00-3.00 sec 859 MBytes 7.21 Gbits/sec 49 298 KBytes | |
| [ 4] 3.00-4.00 sec 867 MBytes 7.27 Gbits/sec 49 265 KBytes | |
| [ 4] 4.00-5.00 sec 886 MBytes 7.44 Gbits/sec 48 325 KBytes | |
| [ 4] 5.00-6.00 sec 884 MBytes 7.42 Gbits/sec 42 467 KBytes | |
| [ 4] 6.00-7.00 sec 875 MBytes 7.34 Gbits/sec 61 305 KBytes | |
| [ 4] 7.00-8.00 sec 877 MBytes 7.35 Gbits/sec 18 319 KBytes | |
| [ 4] 8.00-9.00 sec 853 MBytes 7.16 Gbits/sec 45 218 KBytes | |
| [ 4] 9.00-10.00 sec 869 MBytes 7.29 Gbits/sec 81 247 KBytes | |
| - - - - - - - - - - - - - - - - - - - - - - - - - | |
| [ ID] Interval Transfer Bandwidth Retr | |
| [ 4] 0.00-10.00 sec 8.38 GBytes 7.19 Gbits/sec 513 sender | |
| [ 4] 0.00-10.00 sec 8.37 GBytes 7.19 Gbits/sec receiver | |
| # iperf3 IP over IB rsocket | |
| [suma@localhost ~]$ LD_PRELOAD=/usr/lib64/rsocket/librspreload.so.1 iperf3 -s | |
| ----------------------------------------------------------- | |
| Server listening on 5201 | |
| ----------------------------------------------------------- | |
| Accepted connection from ::, port 58361 | |
| [ 10] local :: port 5201 connected to :: port 60448 | |
| iperf3: getsockopt - Operation not supported | |
| [ ID] Interval Transfer Bandwidth | |
| [ 10] 0.00-1.00 sec 2.36 GBytes 20.3 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 1.00-2.00 sec 2.38 GBytes 20.4 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 2.00-3.00 sec 2.39 GBytes 20.6 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 3.00-4.00 sec 2.38 GBytes 20.5 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 4.00-5.00 sec 2.39 GBytes 20.5 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 5.00-6.00 sec 2.38 GBytes 20.5 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 6.00-7.00 sec 2.37 GBytes 20.4 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 7.00-8.00 sec 2.37 GBytes 20.3 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 8.00-9.00 sec 2.39 GBytes 20.5 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 9.00-10.00 sec 2.37 GBytes 20.4 Gbits/sec | |
| iperf3: getsockopt - Operation not supported | |
| [ 10] 10.00-10.00 sec 2.17 MBytes 17.7 Gbits/sec | |
| - - - - - - - - - - - - - - - - - - - - - - - - - | |
| [ ID] Interval Transfer Bandwidth Retr | |
| [ 10] 0.00-10.00 sec 23.8 GBytes 20.4 Gbits/sec 1 sender | |
| [ 10] 0.00-10.00 sec 23.8 GBytes 20.4 Gbits/sec receiver |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # IB QDR rsocket connection | |
| [suma@localhost ~]$ rstream | |
| name bytes xfers iters total time Gb/sec usec/xfer | |
| 64_lat 64 1 100k 12m 0.29s 0.35 1.47 | |
| 4k_lat 4k 1 10k 78m 0.13s 4.96 6.61 | |
| 64k_lat 64k 1 1k 125m 0.07s 15.82 33.14 | |
| 1m_lat 1m 1 100 200m 0.08s 20.68 405.67 | |
| 64_bw 64 100k 1 12m 0.06s 1.65 0.31 | |
| 4k_bw 4k 10k 1 78m 0.03s 22.83 1.44 | |
| 64k_bw 64k 1k 1 125m 0.04s 24.54 21.36 | |
| 1m_bw 1m 100 1 200m 0.07s 23.29 360.21 | |
| # IB QDR IPoIB connection | |
| [suma@localhost ~]$ rstream -b 10.0.0.21 -T s | |
| name bytes xfers iters total time Gb/sec usec/xfer | |
| 64_lat 64 1 100k 12m 2.56s 0.04 12.81 | |
| 4k_lat 4k 1 10k 78m 0.77s 0.85 38.73 | |
| 64k_lat 64k 1 1k 125m 0.25s 4.25 123.38 | |
| 1m_lat 1m 1 100 200m 0.25s 6.76 1241.30 | |
| 64_bw 64 100k 1 12m 0.42s 0.24 2.11 | |
| 4k_bw 4k 10k 1 78m 0.09s 7.14 4.59 | |
| 64k_bw 64k 1k 1 125m 0.10s 10.30 50.91 | |
| 1m_bw 1m 100 1 200m 0.17s 9.89 848.11 | |
| # 1 GbE TCP/IP connection | |
| [suma@localhost ~]$ rstream -b 192.168.0.141 -T s | |
| name bytes xfers iters total time Gb/sec usec/xfer | |
| 64_lat 64 1 100k 12m 37.38s 0.00 186.91 | |
| 4k_lat 4k 1 10k 78m 4.11s 0.16 205.66 | |
| 64k_lat 64k 1 1k 125m 1.43s 0.73 716.55 | |
| 1m_lat 1m 1 100 200m 1.80s 0.93 9008.36 | |
| 64_bw 64 100k 1 12m 0.17s 0.62 0.83 | |
| 4k_bw 4k 10k 1 78m 0.70s 0.94 34.87 | |
| 64k_bw 64k 1k 1 125m 1.12s 0.94 558.51 | |
| 1m_bw 1m 100 1 200m 1.79s 0.94 8942.80 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment