Skip to content

[TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold. - #7283

Merged
zheyuf merged 14 commits into
NVIDIA:mainfrom
zheyuf:roll_avg
Oct 13, 2025
Merged

[TRTLLM-7412][feat] Turn off spec decode when the rolling average acceptance length drops below threshold.#7283
zheyuf merged 14 commits into
NVIDIA:mainfrom
zheyuf:roll_avg

Commits

Commits on Sep 26, 2025

Commits on Oct 9, 2025

Commits on Oct 10, 2025

Commits on Oct 11, 2025

Commits on Oct 13, 2025