Ubuntu Docker: could not select device driver “nvidia”

Pinguin sitting on the whale



When I tried to install Stable Diffusion that was wrapped to docker image, I faced next error: Error response from daemon: could not select device driver “nvidia” with capabilities: [[compute utility]] ..

Error response from daemon: could not select device driver "nvidia" with capabilities: [[compute utility]]

To resolve this you need to install nvidia-container-toolkit

Append NVIDIA repository

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
  && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
    sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
    sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

update packages information and install toolkit

$ sudo apt-get update
$ sudo apt-get install -y nvidia-container-toolkit

After that append configuration to docker

$ sudo nvidia-ctk runtime configure --runtime=docker

and restart it

$ sudo systemctl restart docker

Resources

Nvidia Documentation: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

You May Also Like

About the Author: vo