Skip to content

feat(abi): explicit device selection through the ONE surface - vllm_model_params.device, ABI v14, --device on server + cli - #136

Closed
localai-bot wants to merge 1 commit into
mainfrom
row/DEVICE-KNOB
Closed

feat(abi): explicit device selection through the ONE surface - vllm_model_params.device, ABI v14, --device on server + cli#136
localai-bot wants to merge 1 commit into
mainfrom
row/DEVICE-KNOB