Skip to content

fp16/GQA export fixes + capture-safe static-cache attention (supersedes #328) - #340

Closed
titaiwangms wants to merge 30 commits into
mainfrom
fix/gqa-fp16-fold-salvage
Closed

fp16/GQA export fixes + capture-safe static-cache attention (supersedes #328)#340
titaiwangms wants to merge 30 commits into
mainfrom
fix/gqa-fp16-fold-salvage