Face recognition using only cpu, not gpu's, in docker on an ubuntu machine

See more:

Linux

Ubuntu

GPU

docker

nvidia

, +

I am running Codeproject.ai in a Docker container on an Ubuntu 22.04 machine. The machine has 2 nvidia tesla k80s installed. Both cards are functioning properly. I am currently using Codeproject.AI with Blue Iris and everything is running fine but it only works with CPU and not the 4 GPUs.

I cannot figure out where the issue is and how to get Codeproject to use the GPUs rather than the CPU.

What I have tried:

I have ensured that nvidia-smi works from both the machine and container.
I have ensured that nvidia is the default runtime for docker.
I have ensured that all GPUs are accessible to the container.
I have tried enabling the GPU for each module.
I have stopped and restarted the modules.
I have removed the container and persistent volumes multiple times.

Here is my Docker run command

sudo docker run --name CodeProject.AI -d -p 32168:32168 \
--gpus all \
--mount type=bind,source=/home/dax/docker/codeprojectai/ai,target=/etc/codeproject/ai \
--mount type=bind,source=/home/dax/docker/codeprojectai/modules,target=/app/modules \
--mount type=bind,source=/home/dax/docker/codeprojectai/custom-modules,target=/app/modules/ObjectDetectionYolo/custom-models \
  codeproject/ai-server:gpu