[TRTLLM-5000][feat] Pytorch implementation of ngram drafter - #3936

Merged

chzblych merged 9 commits into

NVIDIA:mainfrom

thorjohnsen:user/tjohnsen/alt_ngram_drafter

May 21, 2025

Commits on May 20, 2025

v1.5
wili-65535
committed
v1.5.5: fix CI error
wili-65535
committed
v1.6: fix CI error 8196 > 8192
wili-65535
committed
Address reviewer concerns

thorjohnsen
authored and
wili-65535
committed
Address reviewer concerns

thorjohnsen
authored and
wili-65535
committed
precommit run

thorjohnsen
authored and
wili-65535
committed
v2.0: Address reviewer concerns
wili-65535
committed
v2.1: add fix from wili
wili-65535
committed
Revert changes that require use of TypeAlias because that requires python version >= 3.10
thorjohnsen
committed