Skip to content

could not select device driver with capabilities: [[gpu]] #4511

Description

@dmatora

LocalAI version:
latest-aio-gpu-nvidia-cuda-11 4627ed8018f2

Environment, CPU architecture, OS, and Version:
name -a
Linux ubuntu-ollama 6.5.0-18-generic #18~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Feb 7 11:40:03 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Thu_Nov_18_09:45:30_PST_2021
Cuda compilation tools, release 11.5, V11.5.119
Build cuda_11.5.r11.5/compiler.30672275_0

Describe the bug
Getting could not select device driver with capabilities: [[gpu]]

To Reproduce
docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11

Expected behavior
Expecting it to run

Additional context
I did run apt-get install nvidia-container-toolkit prior to running local-ai

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions