- How do I do performance testing to test the network bewteen nodes and pods?
- What tool does RedHat use to test network performance?
- OpenShift 4
k8s-netperf is a tool used by RedHat
Download: k8s-netperf_Linux_v0.1.27_x86_64.tar.gz
Image: quay.io/rjhowe/oc-k8s-netperf:latest
Apply a label to the nodes you want the client and server running
$ oc label nodes node-name netperf=client
$ oc label nodes node-name netperf=server
Run k8s-netperf from an image
$ podman run -it --rm --entrypoint /bin/k8s-netperf -v ~/.kube/config:/config:z -e KUBECONFIG=/config quay.io/rjhowe/oc-k8s-netperf:latest --all --iperf --netperf
$ cat ./netperf.yml
tests :
- TCPStream1:
parallelism: 1
profile: "TCP_STREAM"
duration: 10
samples: 3
messagesize: 1024
burst: 1
service: false
- TCPStream2:
parallelism: 1
profile: "TCP_STREAM"
duration: 10
samples: 3
messagesize: 4096
burst: 3
service: false
Run test locally if binary is installed
$ k8s-netperf --config ./test.yml --all --iperf --netperf
+-------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+--------------------+---------------------------------+
| RESULT TYPE | DRIVER | SCENARIO | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | BURST | SAME NODE | DURATION | SAMPLES | AVG VALUE | 95% CONFIDENCE INTERVAL |
+-------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+--------------------+---------------------------------+
| 📊 Stream Results | netperf | TCP_STREAM | 1 | true | false | 1024 | 1 | false | 10 | 1 | 1361.230000 (Mb/s) | 0.000000-0.000000 (Mb/s) |
| 📊 Stream Results | netperf | TCP_STREAM | 1 | false | false | 1024 | 1 | false | 10 | 1 | 563.400000 (Mb/s) | 0.000000-0.000000 (Mb/s) |
| 📊 Stream Results | iperf3 | TCP_STREAM | 1 | true | false | 1024 | 1 | false | 10 | 1 | 2573.913088 (Mb/s) | 0.000000-0.000000 (Mb/s) |
| 📊 Stream Results | iperf3 | TCP_STREAM | 1 | false | false | 1024 | 1 | false | 10 | 1 | 501.386560 (Mb/s) | 0.000000-0.000000 (Mb/s) |
| 📊 Stream Results | netperf | TCP_STREAM | 1 | true | false | 4096 | 3 | false | 10 | 3 | 8199.230000 (Mb/s) | 6172.157062-10226.302938 (Mb/s) |
| 📊 Stream Results | netperf | TCP_STREAM | 1 | false | false | 4096 | 3 | false | 10 | 3 | 744.193333 (Mb/s) | 690.455708-797.930959 (Mb/s) |
| 📊 Stream Results | iperf3 | TCP_STREAM | 1 | true | false | 4096 | 3 | false | 10 | 3 | 8435.345749 (Mb/s) | 7369.573127-9501.118372 (Mb/s) |
| 📊 Stream Results | iperf3 | TCP_STREAM | 1 | false | false | 4096 | 3 | false | 10 | 3 | 764.838613 (Mb/s) | 712.099503-817.577723 (Mb/s) |
+-------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+--------------------+---------------------------------+
+---------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+-------------+
| TYPE | DRIVER | SCENARIO | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | BURST | SAME NODE | DURATION | SAMPLES | AVG VALUE |
+---------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+-------------+
| TCP Retransmissions | netperf | TCP_STREAM | 1 | true | false | 1024 | 1 | false | 10 | 1 | 0.000000 |
| TCP Retransmissions | netperf | TCP_STREAM | 1 | false | false | 1024 | 1 | false | 10 | 1 | 89.000000 |
| TCP Retransmissions | iperf3 | TCP_STREAM | 1 | true | false | 1024 | 1 | false | 10 | 1 | 25.000000 |
| TCP Retransmissions | iperf3 | TCP_STREAM | 1 | false | false | 1024 | 1 | false | 10 | 1 | 97.000000 |
| TCP Retransmissions | netperf | TCP_STREAM | 1 | true | false | 4096 | 3 | false | 10 | 3 | 3826.666667 |
| TCP Retransmissions | netperf | TCP_STREAM | 1 | false | false | 4096 | 3 | false | 10 | 3 | 109.333333 |
| TCP Retransmissions | iperf3 | TCP_STREAM | 1 | true | false | 4096 | 3 | false | 10 | 3 | 2341.666667 |
| TCP Retransmissions | iperf3 | TCP_STREAM | 1 | false | false | 4096 | 3 | false | 10 | 3 | 86.666667 |
+---------------------+---------+------------+-------------+--------------+---------+--------------+-------+-----------+----------+---------+-------------+
ERRO[2025-03-05 16:51:49] 😥 TCP Single Stream (Message Size : 1024) percent difference when comparing hostNetwork to podNetwork is greater than 10.0 percent (134.8 percent) for 1 streams
ERRO[2025-03-05 16:51:49] 😥 TCP Single Stream (Message Size : 1024) percent difference when comparing hostNetwork to podNetwork is greater than 10.0 percent (134.8 percent) for 1 streams
ERRO[2025-03-05 16:51:49] 😥 TCP Single Stream (Message Size : 4096) percent difference when comparing hostNetwork to podNetwork is greater than 10.0 percent (166.7 percent) for 1 streams
ERRO[2025-03-05 16:51:49] 😥 TCP Single Stream (Message Size : 4096) percent difference when comparing hostNetwork to podNetwork is greater than 10.0 percent (166.7 percent) for 1 streams