Skip to content

[None][docs] define Python native KV transfer ownership contract#16347

Draft
chienchunhung wants to merge 2 commits into
NVIDIA:mainfrom
chienchunhung:codex/disagg-kv-transfer-ownership-design
Draft

[None][docs] define Python native KV transfer ownership contract#16347
chienchunhung wants to merge 2 commits into
NVIDIA:mainfrom
chienchunhung:codex/disagg-kv-transfer-ownership-design

Conversation

@chienchunhung

Copy link
Copy Markdown
Collaborator

Summary

Scope

This targets Python-native KvCacheTransceiverV2 direct, bounce, and fallback paths. The separate C++ CacheTransceiver is a non-goal; small KV-manager or NIXL binding changes may still be required to enforce leases and expose definitive quiescence.

Validation

  • completed iterative trtllm-review self-review passes through a final clean pass covering lifecycle/protocol correctness, documentation/scope, and performance/capacity
  • pre-commit run --files docs/design/README.md docs/design/disagg-kv-transfer-ownership/README.md docs/design/disagg-kv-transfer-ownership/implementation-plan.md
  • git diff --check 54d484fd3

Documentation only; no runtime or GPU tests were required.

Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
@chienchunhung

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59129 [ run ] triggered by Bot. Commit: b9ff215 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59129 [ run ] completed with state SUCCESS. Commit: b9ff215
/LLM/main/L0_MergeRequest_PR pipeline #47639 completed with status: 'SUCCESS'

CI Report

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants