LocalAI version:
latest-aio-gpu-nvidia-cuda-11 4627ed8018f2
Environment, CPU architecture, OS, and Version:
name -a
Linux ubuntu-ollama 6.5.0-18-generic #18~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Feb 7 11:40:03 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0
Describe the bug
Getting could not select device driver with capabilities: [[gpu]]
To Reproduce
docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11
Expected behavior
Expecting it to run
Additional context
I did run apt-get install nvidia-container-toolkit prior to running local-ai
LocalAI version:
latest-aio-gpu-nvidia-cuda-11 4627ed8018f2
Environment, CPU architecture, OS, and Version:
name -aLinux ubuntu-ollama 6.5.0-18-generic #18~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Feb 7 11:40:03 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
nvcc --versionnvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0
Describe the bug
Getting
could not select device driver with capabilities: [[gpu]]To Reproduce
docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11
Expected behavior
Expecting it to run
Additional context
I did run
apt-get install nvidia-container-toolkitprior to running local-ai