Skip to content

[None][fix] Fix compute token accounting for KV cache reuse with context chunking - #12976

Merged
longlee0622 merged 10 commits into
NVIDIA:mainfrom
lancelly:fix_resue_compute
Apr 18, 2026
Merged

[None][fix] Fix compute token accounting for KV cache reuse with context chunking#12976
longlee0622 merged 10 commits into
NVIDIA:mainfrom
lancelly:fix_resue_compute

Commits

Commits on Apr 13, 2026

Commits on Apr 15, 2026

Commits on Apr 16, 2026