Skip to content

[NVBUG-6448152][test] TEST ONLY; DO NOT REVIEW historical source with current runtime - #16747

Closed
chienchunhung wants to merge 8 commits into
NVIDIA:mainfrom
chienchunhung:codex/nvbug-6448152-historical-source-current-runtime
Closed

[NVBUG-6448152][test] TEST ONLY; DO NOT REVIEW historical source with current runtime#16747
chienchunhung wants to merge 8 commits into
NVIDIA:mainfrom
chienchunhung:codex/nvbug-6448152-historical-source-current-runtime

Conversation

@chienchunhung

Copy link
Copy Markdown
Collaborator

Purpose

TEST ONLY. This diagnostic isolates the runtime/toolchain contribution to the PP4 context-side throughput change by retaining the previously fast historical source tree and changing only its five CI image assignments to the exact image set used by the current-source comparison.

Factor isolation

  • Historical source parent: 5e2498b46a71, tree 68e92a26956da25a659860082da887567b9d36c3.
  • The five historical image assignments from build 202606051544-14972 are replaced with the exact five assignments from current-source base a2fca7808c94, build 202607151440-16194.
  • Product code, benchmark YAML, selector, workload, coordinator behavior, traffic, admission, and timeout settings are unchanged.

This is a one-factor crossover: historical source plus current runtime/toolchain. It is not intended for review or merge.

Validation

  • The committed diff is exactly one file and five line substitutions.
  • The resulting image-tag file is byte-identical to the current-source comparison's image-tag file.
  • Shell parsing and all five required key/value checks passed.
  • The image-renaming utility parsed all five entries in dry-run mode.
  • Repository pre-commit and DCO checks passed.

Targeted validation is limited to the exact GB300 PP4 disaggregated performance-sanity workload. Throughput from this diagnostic will be interpreted only if every submitted request succeeds and the official metric is valid.

chienchunhung and others added 7 commits July 17, 2026 15:10
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Yanchao Lu <yanchaol@nvidia.com>
(cherry picked from commit 833ddd2)
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Apply only the CacheSender readiness synchronization portion of NVIDIA#15737 to the exact NVIDIA#15139 boundary experiment. This keeps the historical control and treatment matched while removing the known lost-wakeup confound.

Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Keep the historical experiment tree unchanged while making the diagnostic PR mergeable for the Blossom launch gate.

Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
Signed-off-by: Chien-Chun Hung <2679986+chienchunhung@users.noreply.github.com>
@chienchunhung

Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list "GB300-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-1"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #61036 [ run ] triggered by Bot. Commit: 9bbcbde Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #61036 [ run ] completed with state FAILURE. Commit: 9bbcbde
/LLM/main/L0_MergeRequest_PR pipeline #49293 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@chienchunhung

Copy link
Copy Markdown
Collaborator Author

/bot run --stage-list "GB300-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-1"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #61046 [ run ] triggered by Bot. Commit: 9bbcbde Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #61046 [ run ] completed with state FAILURE. Commit: 9bbcbde
/LLM/main/L0_MergeRequest_PR pipeline #49303 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants