Skip to content

Instantly share code, notes, and snippets.

@jacobkahn

jacobkahn/gist:d331c22339a818e92f2ede93c61cd84b

Created July 25, 2019 05:15
Show Gist options
  • Save jacobkahn/d331c22339a818e92f2ede93c61cd84b to your computer and use it in GitHub Desktop.
Save jacobkahn/d331c22339a818e92f2ede93c61cd84b to your computer and use it in GitHub Desktop.
Download ZIP
AWS EFA mpirun.sh
Raw
gistfile1.txt
/home/ec2-user/anaconda3/bin/mpirun -x FI_PROVIDER="efa" -x FI_OFI_RXR_RX_COPY_UNEXP=1 -x FI_OFI_RXR_RX_COPY_OOO=1 -x FI_EFA_MR_CACHE_ENABLE=1 -x FI_OFI_RXR_INLINE_MR_ENABLE=1 -x LD_LIBRARY_PATH=/home/ec2-user/aws-ofi-nccl/install/lib/:/home/ec2-user/nccl/build/lib:/usr/local/cuda-10.0/lib64:/opt/amazon/efa/lib64:$LD_LIBRARY_PATH -x NCCL_DEBUG=INFO -x NCCL_TREE_THRESHOLD=0 -H 172.31.39.141:16,172.31.43.16:16 -n 16 -N 8 --mca btl tcp,self --mca btl_tcp_if_exclude lo,docker0 --bind-to none /home/ec2-user/nccl-tests/build/all_reduce_perf -b 8 -e 1G -f 2 -g 1 -c 1 -n 100
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment