Skip to content

Instantly share code, notes, and snippets.

@weimeng23
Last active August 21, 2024 02:56
Show Gist options
  • Save weimeng23/1c4a16aa7b9a58ec89d20c6f29ec8260 to your computer and use it in GitHub Desktop.
Save weimeng23/1c4a16aa7b9a58ec89d20c6f29ec8260 to your computer and use it in GitHub Desktop.
Build ONNX Runtime with Execution Providers (cuda)
# GCC version must be greater than or equal to 9
# greater than or equal to python3.8
# cuda, cudnn need to be installed
curl -L -o onnxruntime-v1.16.3.tar.gz https://github.com/microsoft/onnxruntime/archive/refs/tags/v1.16.3.tar.gz
tar -zxvf onnxruntime-v1.16.3.tar.gz
cd onnxruntime-v1.16.3
# ./build.sh --use_cuda --cudnn_home /usr/local/cuda-11.8 --cuda_home /usr/local/cuda-11.8 --allow_running_as_root --skip_submodule_sync --parallel
# ./build.sh --config Release --use_cuda --cudnn_home /usr/local/cuda-11.8 --cuda_home /usr/local/cuda-11.8 --allow_running_as_root --skip_submodule_sync --parallel
./build.sh --config RelWithDebInfo --use_cuda --cudnn_home /usr/local/cuda-11.8 --cuda_home /usr/local/cuda-11.8 --allow_running_as_root --skip_submodule_sync --parallel
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment