[FEAT] Improved PagedAttention FP8 (faster kvcache dequant v2) #347
Closed
tjtanaa wants to merge 5 commits intoROCm:llama_fp8_12062024from
Closed
[FEAT] Improved PagedAttention FP8 (faster kvcache dequant v2) #347tjtanaa wants to merge 5 commits intoROCm:llama_fp8_12062024from
tjtanaa wants to merge 5 commits intoROCm:llama_fp8_12062024from
Commits
Commits on Dec 20, 2024
Commits on Dec 27, 2024
Commits on Dec 29, 2024
- committed
vllmellm
Commits on Dec 30, 2024
- committedvllmellm