Skip to content

[TRTLLM-14054][perf] Reduce per-step host preparation overhead in the PyTorch executor decode path - #16313

Merged
kaiyux merged 5 commits into
NVIDIA:mainfrom
kaiyux:perf/decode-step-host-prep-20260713
Jul 17, 2026
Merged

[TRTLLM-14054][perf] Reduce per-step host preparation overhead in the PyTorch executor decode path#16313
kaiyux merged 5 commits into
NVIDIA:mainfrom
kaiyux:perf/decode-step-host-prep-20260713

[TRTLLM-14054][chore] Assert state-indices length matches the batch size

190c73c
Select commit
Loading
Failed to load commit list.