Revert "feature: unify new_tokens format sample state to trtllm samper new_tokens format (#4401)" - #5474

Revert "feature: unify new_tokens format sample state to trtllm samper new_tokens format (#4401)"#5474

litaotju merged 2 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

netanel-haber:user/nhaber/fix-revert-torch-sampler-perf-regressionnetanel-haber/TensorRT-LLM:user/nhaber/fix-revert-torch-sampler-perf-regressionCopy head branch name to clipboard