Skip to content

[ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 #12408

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
youkaichao merged 1 commit into from
Jan 25, 2025

mi300 moe tuned configs fp16 & fp8

9183318
Select commit
Loading
Failed to load commit list.
Merged

[ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 #12408

mi300 moe tuned configs fp16 & fp8
9183318
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs