Skip to content

[TRTLLM-14708][fix] Populate speculative-decoding request perf metrics in the PyTorch one-engine flow - #17082

Open
brnguyen2 wants to merge 6 commits into
NVIDIA:mainfrom
brnguyen2:feat/spec-dec-perf-metrics
Open

[TRTLLM-14708][fix] Populate speculative-decoding request perf metrics in the PyTorch one-engine flow#17082
brnguyen2 wants to merge 6 commits into
NVIDIA:mainfrom
brnguyen2:feat/spec-dec-perf-metrics

[None][fix] Launch LMBenchmark client without PYTHONSAFEPATH

c4232ce
Select commit
Loading
Failed to load commit list.