Skip to content

[TRTLLM-14511][feat] BREAKING: refactor per-request perf metrics for multi-process trtllm-server - #16668

Open
reasonsolo wants to merge 11 commits into
NVIDIA:mainfrom
reasonsolo:feat/per_req_perf_metrics
Open

[TRTLLM-14511][feat] BREAKING: refactor per-request perf metrics for multi-process trtllm-server#16668
reasonsolo wants to merge 11 commits into
NVIDIA:mainfrom
reasonsolo:feat/per_req_perf_metrics

fix failed CI test

e3ec67f
Select commit
Loading
Failed to load commit list.