docker container 指定gpu设备

1， 在yaml中   Turn on GPU access with Docker Compose | Docker Docs

Example of a Compose file for running a service with access to 1 GPU device:

services:test:image: nvidia/cuda:12.3.1-base-ubuntu20.04command: nvidia-smideploy:resources:reservations:devices:- driver: nvidiacount: 1capabilities: [gpu]

Access specific devices

To allow access only to GPU-0 and GPU-3 devices:

services:test:image: tensorflow/tensorflow:latest-gpucommand: python -c "import tensorflow as tf;tf.test.gpu_device_name()"deploy:resources:reservations:devices:- driver: nvidiadevice_ids: ['0', '3']capabilities: [gpu]

2，   执行以下命令

docker run --rm -ti --gpus device=1 -p 8080:8080 -e DEBUG=true -e MODELS_PATH=/models -e THREADS=1 -v $PWD/models:/models quay.io/go-skynet/local-ai:master-cublas-cuda12