Skip to content

[https://nvbugs/6185212][fix] Fix B300 MoE test list ids - #14401

Merged
xxi-nv merged 1 commit into
NVIDIA:mainfrom
xxi-nv:dev-xxi-bug6185212-bot
May 22, 2026
Merged

[https://nvbugs/6185212][fix] Fix B300 MoE test list ids#14401
xxi-nv merged 1 commit into
NVIDIA:mainfrom
xxi-nv:dev-xxi-bug6185212-bot

Conversation

@xxi-nv

@xxi-nv xxi-nv commented May 21, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Fix B300 MoE test-list entries that referenced local-only DeepSeek-V3 e256_k8_h7168_i2048 IDs by switching the affected coverage to CI DeepSeek-V4-Flash e256_k6_h4096_i2048.
  • Remove the temporary NVBug 6185212 waivers.
  • Move explicit B300 MoE unit-test coverage from post_merge to pre_merge in l0_dgx_b300.yml.

Validation

  • Static B300 MoE placement validation: PASS (post_merge: 0 explicit MoE unit cases, pre_merge: 19)
  • YAML validation: PASS
  • git diff --check: PASS
  • ./scripts/check_test_list.py --validate: PASS (2925 unique entries)
  • Pre-commit: PASS

Notes

  • Full B300 local pytest is being run separately after B300 allocation.

Summary by CodeRabbit

  • Tests
    • Reorganized MoE test suite execution stages with updated test parameters for enhanced validation coverage.
    • Removed waivers for specific MoE multi-GPU test cases to strengthen reliability expectations.

Review Change Stack

@xxi-nv

xxi-nv commented May 21, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --extra-stage "DGX_B300-4_GPUs-PyTorch-1"

@coderabbitai

coderabbitai Bot commented May 21, 2026

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

This PR promotes MoE multi-GPU test execution from post-merge to pre-merge stage by relocating test blocks in the L0 DGX B300 test configuration, updating parameter sizing for specific backends, and removing corresponding test waivers to align with the earlier execution tier.

Changes

MoE Test Promotion

Layer / File(s) Summary
Test stage migration and parameter updates
tests/integration/test_lists/test-db/l0_dgx_b300.yml
Multi-GPU MoE test blocks (components, configurable multi-GPU parametrizations, and EPLB cases) move from stage: post_merge to stage: pre_merge; CUTLASS and TRTLLM sizing parameters update from e256_k8_h7168_i2048 to e256_k6_h4096_i2048.
Waiver removal for promoted tests
tests/integration/test_lists/waives.txt
Removes three SKIP waivers for test_configurable_moe_multi_gpu with parallel=DEP-comm=NVLINK_ONE_SIDED that are no longer required after test promotion to pre-merge stage.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14235: Directly addresses the same MoE multi-GPU test cases and removal of the three matching test_configurable_moe_multi_gpu waivers.
  • NVIDIA/TensorRT-LLM#13964: Updates MoE model configuration lists with the same parameter swap from e256_k8_h7168_i2048 to e256_k6_h4096_i2048.

Suggested reviewers

  • leslie-fang25
  • mzweilz
  • niukuo
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title accurately describes the main change: fixing B300 MoE test list IDs by updating them from DeepSeek-V3 to DeepSeek-V4-Flash configurations.
Description check ✅ Passed The description includes a clear summary of changes, validation results, and notes. However, it lacks the 'Test Coverage' section specified in the template.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
tests/integration/test_lists/test-db/l0_dgx_b300.yml (1)

87-114: QA list follow-up is likely unnecessary for this layer.

This change updates authoritative test-db pre-merge selection and does not add new tests/integration/defs/ cases or new perf definitions. A QA scheduled list update is optional here unless you want QA cadence to mirror this exact stage/ID migration immediately (then tests/integration/test_lists/qa/llm_function_core.txt is the likely target).

As per coding guidelines, "If the PR only touches unittest/ or narrow unit scope, say explicitly whether QA list updates are unnecessary or optional."

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@tests/integration/test_lists/test-db/l0_dgx_b300.yml` around lines 87 - 114,
The QA list update mention is unnecessary or optional for this PR because it
only modifies authoritative test-db pre-merge selections under
tests/integration/test_lists and does not add new test definitions; explicitly
state in the PR description that QA list updates are optional and not required
(or that no changes to tests/integration/defs/ or perf definitions were made) so
reviewers know QA cadence need not change; update the PR description and any
changelog notes to include this explicit statement and reference the modified
test list file name (tests/integration/test_lists/test-db/l0_dgx_b300.yml) and
the set of removed MoE test cases to make the intent clear.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/test-db/l0_dgx_b300.yml`:
- Line 109: The pre-merge list still contains the local-only MoE shape ID
"e256_k8_h7168_i2048" and the routing tag "DeepSeekV3"; replace that stale shape
ID with the CI-sanctioned DeepSeek-V4-Flash shape ID used elsewhere in the suite
and update the routing tag to "DeepSeekV4-Flash" so the test entry (the string
containing
e256_k8_h7168_i2048-seq=1-dtype=torch.bfloat16-backend=MEGAMOE_DEEPGEMM-quant=W4A8_MXFP4_MXFP8-routing=DeepSeekV3)
matches CI IDs and avoids mismatches.

---

Nitpick comments:
In `@tests/integration/test_lists/test-db/l0_dgx_b300.yml`:
- Around line 87-114: The QA list update mention is unnecessary or optional for
this PR because it only modifies authoritative test-db pre-merge selections
under tests/integration/test_lists and does not add new test definitions;
explicitly state in the PR description that QA list updates are optional and not
required (or that no changes to tests/integration/defs/ or perf definitions were
made) so reviewers know QA cadence need not change; update the PR description
and any changelog notes to include this explicit statement and reference the
modified test list file name
(tests/integration/test_lists/test-db/l0_dgx_b300.yml) and the set of removed
MoE test cases to make the intent clear.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: f1410bf1-365d-4bb6-9641-43131950b801

📥 Commits

Reviewing files that changed from the base of the PR and between 6b95463 and c028186.

📒 Files selected for processing (2)
  • tests/integration/test_lists/test-db/l0_dgx_b300.yml
  • tests/integration/test_lists/waives.txt
💤 Files with no reviewable changes (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/test-db/l0_dgx_b300.yml
@xxi-nv
xxi-nv requested a review from ZhanruiSunCh May 21, 2026 09:01
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49667 [ run ] triggered by Bot. Commit: c028186 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49667 [ run ] completed with state SUCCESS. Commit: c028186
/LLM/main/L0_MergeRequest_PR pipeline #39277 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@xxi-nv
xxi-nv force-pushed the dev-xxi-bug6185212-bot branch from c028186 to c5b63c3 Compare May 21, 2026 23:46
@xxi-nv
xxi-nv enabled auto-merge (squash) May 21, 2026 23:46
@xxi-nv

xxi-nv commented May 21, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --extra-stage "DGX_B300-4_GPUs-PyTorch-1"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49787 [ run ] triggered by Bot. Commit: c5b63c3 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49787 [ run ] completed with state SUCCESS. Commit: c5b63c3
/LLM/main/L0_MergeRequest_PR pipeline #39378 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@xxi-nv

xxi-nv commented May 22, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49851 [ run ] triggered by Bot. Commit: c5b63c3 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49851 [ run ] completed with state SUCCESS. Commit: c5b63c3
/LLM/main/L0_MergeRequest_PR pipeline #39435 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@xxi-nv

xxi-nv commented May 22, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49904 [ run ] triggered by Bot. Commit: c5b63c3 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49904 [ run ] completed with state SUCCESS. Commit: c5b63c3
/LLM/main/L0_MergeRequest_PR pipeline #39483 completed with status: 'SUCCESS'

CI Report

Link to invocation

@xxi-nv
xxi-nv merged commit 8791347 into NVIDIA:main May 22, 2026
7 of 8 checks passed
@xxi-nv
xxi-nv deleted the dev-xxi-bug6185212-bot branch May 22, 2026 11:41
KleinBlueC pushed a commit to KleinBlueC/TensorRT-LLM that referenced this pull request May 26, 2026
bmarimuthu-nv pushed a commit to nv-auto-deploy/TensorRT-LLM that referenced this pull request May 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants