perf(vulkan): fused attn preamble native -- 16 host round trips/token gone - #183

perf(vulkan): fused attn preamble native -- 16 host round trips/token gone#183

mudler merged 2 commits into

mainmudler/vllm.cpp:mainfrom

row/BACKEND-VULKAN-QKNORMmudler/vllm.cpp:row/BACKEND-VULKAN-QKNORMCopy head branch name to clipboard