feat(tenstorrent): Qwen3-dense ops, device residency, and paged-KV decode path - #240

Closed

lu-zero wants to merge 16 commits into

mudler:mainfrom

lu-zero:row/BACKEND-TENSTORRENT-QWEN3

Commits on Aug 10, 2026

feat(tenstorrent): land kRmsNorm on BACKEND-TENSTORRENT (Qwen3-dense #1)
lu-zero
committed
c00142f
feat(tenstorrent): land kSiluAndMul on BACKEND-TENSTORRENT (Qwen3-dense #2)
lu-zero
committed
098f263
feat(tenstorrent): land Cast + RoPE ops for Qwen3-dense (Qwen3 #3)
lu-zero
committed
2045df9
feat(tenstorrent): allow Qwen3ForCausalLM on BACKEND-TENSTORRENT
lu-zero
committed
27aecbf
feat(tenstorrent): device-resident shadows for compute chain
lu-zero
committed
eb74c68
feat(tenstorrent): Qwen3-0.6B gate wiring + device goldens
lu-zero
committed
cf1ae2e
feat(tenstorrent): run kSiluAndMul on-device (slice + silu + mul)
lu-zero
committed
1d7ed0b
perf(tenstorrent): speed up host kPagedAttention (NEON + q hoist)
lu-zero
committed
d24723d
feat(tenstorrent): device NeoX RoPE apply (hybrid host/device)
lu-zero
committed
f13a6f4
feat(tenstorrent): device kQkvSplit when qkv is resident
lu-zero
committed
9aa37f3
perf(tenstorrent): decode-oriented host PA (dense gather + small pool)
lu-zero
committed
2dcc182
feat(tenstorrent): pure-decode paged SDPA via ttnn-layout KV shadows
lu-zero
committed
4e5c937
perf(tenstorrent): incremental ttnn-layout KV mirror after RAC
lu-zero
committed
602ab58
feat(tenstorrent): on-device paged_update_cache after RAC when shadow live
lu-zero
committed
e82551a
perf(tenstorrent): batch multi-token RAC into paged_update/fill
lu-zero
committed
c033b41
feat(tenstorrent): fused KV update + on-device prefill SDPA
lu-zero
committed
34e4a99