[ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 #12408
Merged
youkaichao merged 1 commit intovllm-project:mainfrom Jan 25, 2025
Merged
[ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 #12408youkaichao merged 1 commit intovllm-project:mainfrom
youkaichao merged 1 commit intovllm-project:mainfrom
