Skip to content

fix: XQA is not enabled when history_length < kMinHistoryTokensPerBlock. - #4264

Merged
bobboli merged 4 commits into
NVIDIA:mainfrom
bobboli:fix_xqa
Jun 11, 2025
Merged

fix: XQA is not enabled when history_length < kMinHistoryTokensPerBlock.#4264
bobboli merged 4 commits into
NVIDIA:mainfrom
bobboli:fix_xqa

Need to use TRTLLM_FORCE_XQA.

f0392bd
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs