Might be possible to use vllm from: https://hub.docker.com/r/rocm/vllm
Might be possible to use vllm from:
https://hub.docker.com/r/rocm/vllm