Skip to content

[None][test] CI bisect nvbugs/6280721: probe 316430f / pm-2762 (Waive step3p7 due to ckpt update #14997) - #15336

Closed
tensorrt-cicd wants to merge 2 commits into
chenfeiz/test-v32-func-8k1k-5f106dfa-basefrom
chenfeiz/test-v32-func-8k1k-5f106dfa-head
Closed

[None][test] CI bisect nvbugs/6280721: probe 316430f / pm-2762 (Waive step3p7 due to ckpt update #14997)#15336
tensorrt-cicd wants to merge 2 commits into
chenfeiz/test-v32-func-8k1k-5f106dfa-basefrom
chenfeiz/test-v32-func-8k1k-5f106dfa-head

Conversation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

Purpose

CI-only diagnostic PR — DO NOT MERGE.

Probes commit 5f106dfabd768489304223caec99829604cdf905 to verify whether this case passes stably on it:

perf/test_perf_sanity.py::test_e2e[aggr_upload-deepseek_v32_fp4_grace_blackwell-v32_fp4_tep4_mtp3_8k1k]

The base branch is pinned at the parent commit (255a54bb8b) so CI builds exactly 5f106dfa's tree, not main. The head adds a trivial no-op comment to test_perf_sanity.py to force the perf-sanity stage to re-run instead of skipping. (Structure mirrors #15261.)

…14997)

Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast --stage-list "GB200-4_GPUs-PyTorch-PerfSanity-Post-Merge-3"

1 similar comment
@chenfeiz0326

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast --stage-list "GB200-4_GPUs-PyTorch-PerfSanity-Post-Merge-3"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54043 [ run ] triggered by Bot. Commit: 9448fa9 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54043 [ run ] completed with state SUCCESS. Commit: 9448fa9
/LLM/main/L0_MergeRequest_PR pipeline #43127 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@tensorrt-cicd
tensorrt-cicd force-pushed the chenfeiz/test-v32-func-8k1k-5f106dfa-head branch from 9448fa9 to 316430f Compare June 15, 2026 07:11
@tensorrt-cicd
tensorrt-cicd changed the base branch from chenfeiz/test-v32-func-8k1k-5f106dfa-base to chenfeiz/bisect-6280721-2762-base June 15, 2026 07:12
@tensorrt-cicd
tensorrt-cicd changed the base branch from chenfeiz/bisect-6280721-2762-base to chenfeiz/test-v32-func-8k1k-5f106dfa-base June 15, 2026 07:12
@tensorrt-cicd tensorrt-cicd changed the title [None][test] CI-only: probe gb200 deepseek-v32 perf-sanity at 5f106dfa (DO NOT MERGE) [None][test] CI bisect nvbugs/6280721: probe 316430f / pm-2762 (Waive step3p7 due to ckpt update #14997) Jun 15, 2026
@chenfeiz0326

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast --stage-list "GB200-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-7,GB200-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-5"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54251 [ run ] triggered by Bot. Commit: 316430f Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54251 [ run ] completed with state SUCCESS. Commit: 316430f
/LLM/main/L0_MergeRequest_PR pipeline #43325 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@chenfeiz0326

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast --stage-list "GB200-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-7,GB200-12_GPUs-3_Nodes-PyTorch-Disagg-PerfSanity-CTX1-NODE1-GPU4-GEN1-NODE2-GPU8-Post-Merge-5"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54306 [ run ] triggered by Bot. Commit: 76de9de Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54306 [ run ] completed with state SUCCESS. Commit: 76de9de
/LLM/main/L0_MergeRequest_PR pipeline #43377 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@chzblych chzblych closed this Jun 16, 2026
@chzblych
chzblych deleted the chenfeiz/test-v32-func-8k1k-5f106dfa-head branch June 16, 2026 06:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants