Skip to content

[None][fix] Cherry-pick Python-side remaining_budget guard for KV reuse budget overflow - #13601

Closed
nv-yna wants to merge 4 commits into
NVIDIA:mainfrom
nv-yna:dyn-2868-fix
Closed

[None][fix] Cherry-pick Python-side remaining_budget guard for KV reuse budget overflow#13601
nv-yna wants to merge 4 commits into
NVIDIA:mainfrom
nv-yna:dyn-2868-fix

[None][fix] Use analyze_prefix_reuse for budget guard re-probe

8322e01
Select commit
Loading
Failed to load commit list.