Skip to content

Instantly share code, notes, and snippets.

@YCmove

YCmove/docker_could_not_select_device_driver.md

Last active September 16, 2024 13:21
Show Gist options
  • Save YCmove/14d6d4f604e814f03bd02eddff03ebee to your computer and use it in GitHub Desktop.
Save YCmove/14d6d4f604e814f03bd02eddff03ebee to your computer and use it in GitHub Desktop.
Download ZIP
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].
Raw
docker_could_not_select_device_driver.md

First, create a docker sudoer group and add your account

sudo groupadd docker
sudo usermod -aG docker $USER

Second, enable rootless mode

nvidia-ctk runtime configure --runtime=docker --config=$HOME/.config/docker/daemon.json
systemctl --user restart docker
sudo nvidia-ctk config --set nvidia-container-cli.no-cgroups --in-place

Test

docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

Mon Sep 16 13:13:49 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.35.03              Driver Version: 560.35.03      CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3090        Off |   00000000:04:00.0 Off |                  N/A |
|  0%   28C    P8             12W /  350W |      15MiB /  24576MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA GeForce RTX 3080        Off |   00000000:07:00.0  On |                  N/A |
|  0%   47C    P8             24W /  320W |     410MiB /  10240MiB |     13%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment