In order to run Pytorch with CUDA sucesfully, we need to install 2 things:
- The CUDA Toolkit from NVIDIA, which includes the CUDA drivers and NVIDIA drivers
- The CUDA Toolkit from Conda, comes along with Pytorch, to make pytorch interacts with CUDA driver
- Check the current CUDA version that is supported by Pytorch. In the image below we can see that currently Pytorch supports CUDA 11.3
- Next, check if this CUDA version is supported for your GPU. Check the
GPUs supported
session in this CUDA wikiperdia.