Skip to content

[#6186][feat] Introduce QKNormRoPEAttention module - #6830

Merged
Funatiq merged 7 commits into
NVIDIA:mainfrom
Funatiq:dev/feat/qk_norm
Sep 5, 2025
Merged

[#6186][feat] Introduce QKNormRoPEAttention module#6830
Funatiq merged 7 commits into
NVIDIA:mainfrom
Funatiq:dev/feat/qk_norm

[fix] Update yarn parameter computation in QK normalization attention

a5ec935
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 3, 2025 in 1s

DCO

All commits are signed off!

View more details on DCO