Skip to content

[None][fix] Fix disaggregated cached token usage (feat/bench_x) - #13623

Closed
v-shobhit wants to merge 1 commit into
NVIDIA:feat/bench_xfrom
v-shobhit:codex/fix-disagg-cached-token-usage-bench-x
Closed

[None][fix] Fix disaggregated cached token usage (feat/bench_x)#13623
v-shobhit wants to merge 1 commit into
NVIDIA:feat/bench_xfrom
v-shobhit:codex/fix-disagg-cached-token-usage-bench-x

Conversation

@v-shobhit

Copy link
Copy Markdown
Collaborator

Summary

Validation

  • python3 -m py_compile tensorrt_llm/serve/openai_disagg_service.py tests/unittest/disaggregated/test_openai_disagg_service.py
  • python3 -m pytest tests/unittest/disaggregated/test_openai_disagg_service.py -q could not run locally because pytest is not installed in this environment

Signed-off-by: Shobhit Verma <shobhitv@nvidia.com>
(cherry picked from commit 9fc353c)
@dongfengy
dongfengy marked this pull request as ready for review April 29, 2026 23:15
@dongfengy
dongfengy requested a review from a team as a code owner April 29, 2026 23:15
@dongfengy
dongfengy requested review from zhenhuaw-me and removed request for a team April 29, 2026 23:15
@v-shobhit v-shobhit changed the title Fix disaggregated cached token usage (feat/bench_x) [None][fix] Fix disaggregated cached token usage (feat/bench_x) Apr 29, 2026
@dongfengy

Copy link
Copy Markdown
Collaborator

No CI needed in the feature branch. Please merge once the main PR is merged: #13620

@v-shobhit

Copy link
Copy Markdown
Collaborator Author

Already fixed by Shicheng on 548cac5, closing

@v-shobhit v-shobhit closed this Apr 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants