Skip to content

[TRTLLM-14903][fix] Free partially-allocated warmup dummy KV blocks and count spec extra tokens in warmup block estimates - #17162

Open
brnguyen2 wants to merge 4 commits into
NVIDIA:mainfrom
brnguyen2:fix/TRTLLM-14903-estimation-warmup-leak
Open

[TRTLLM-14903][fix] Free partially-allocated warmup dummy KV blocks and count spec extra tokens in warmup block estimates#17162
brnguyen2 wants to merge 4 commits into
NVIDIA:mainfrom
brnguyen2:fix/TRTLLM-14903-estimation-warmup-leak

[TRTLLM-14903][fix] Document one-engine warmup token accounting

5bdb732
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Aug 3, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO