如何在linux下让Docker调用N卡

最新使用Docker跑大模型，发现无法调用显卡，翻阅资料才知道要，安装 NVIDIA Container Toolkit
下面的步骤：

1. 添加 NVIDIA 源与 GPG 密钥

curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey \
  | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg

curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list \
  | sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' \
  | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list

2. 安装

sudo apt update
sudo apt install -y nvidia-container-toolkit

3. 配置 Docker 运行时并重启

sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker

4.Docker Compose 使用 GPU（v2.19+）

docker-compose.yml 示例：

version: '3.8'
services:
  my-gpu-app:
    image: nvidia/cuda:12.3.1-base-ubuntu22.04
    runtime: nvidia
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu, compute, utility]
    command: nvidia-smi