Skip to content

[None][test] Waive 7 failed cases for main in QA CI - #16950

Merged
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260728-111811
Jul 28, 2026
Merged

[None][test] Waive 7 failed cases for main in QA CI#16950
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260728-111811

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Jul 28, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6525007, 6525008, 6525009, 6525010, 6525011, 6526186

Waive entries added

full:B200/accuracy/test_llm_api_pytorch.py::TestNemotronV3Ultra::test_nvfp4_4gpus_block_reuse[ADP4_MTP] SKIP (https://nvbugs/6525008)
full:B200/accuracy/test_llm_api_pytorch.py::TestNemotronV3Ultra::test_nvfp4_4gpus_block_reuse[ADP4] SKIP (https://nvbugs/6525008)
full:B200/accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_nvfp4_tp4[torch_compile=True] SKIP (https://nvbugs/6525010)
full:B200/accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy_contention_opt SKIP (https://nvbugs/6525009)
full:B200/accuracy/test_llm_api_pytorch.py::TestLagunaXS::test_fp8 SKIP (https://nvbugs/6525011)
full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_cute_dsl_nvfp4_4gpus[tp4-fp8kv=False-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=False] SKIP (https://nvbugs/6526186)
full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_bfloat16_4gpus[tp4-mtp_nextn=0-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=False] SKIP (https://nvbugs/6525007)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • Updated tests/integration/test_lists/waives.txt with seven additional SKIP waivers for failed B200 accuracy and serving tests.
  • Existing B200 waivers were preserved; no code, API, or performance changes are involved.
  • Waivers reference bugs 6525007, 6525008, 6525009, 6525010, 6525011, and 6526186.
  • The entries are consistent with the existing waiver format and limited to the intended B200 test scope. No duplicate or malformed entries were identified.

QA Engineer Review

  • Only tests/integration/test_lists/waives.txt was modified.
  • Added waivers for DeepSeekV3Lite, LagunaXS, Llama3_3_70BInstruct, NemotronV3Ultra, and related B200 accuracy/serving cases; existing VideoMME, DeepSeekV3Lite, and MiniMaxM3 waivers remain.
  • No test-db/ or qa/ files were modified.
  • Verdict: needs follow-up because CBTS coverage data is unavailable.

Bug(s): 6525007, 6525008, 6525009, 6525010, 6525011, 6526186
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@jieli-matrix
jieli-matrix enabled auto-merge (squash) July 28, 2026 11:18
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Only waive tests"

@coderabbitai

coderabbitai Bot commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Walkthrough

The B200 integration waiver block now includes additional SKIP entries for DWDp, DeepSeekV3Lite, LagunaXS, Llama3, and NemotronV3Ultra test cases while retaining existing waivers.

Changes

B200 integration waivers

Layer / File(s) Summary
Expand B200 SKIP entries
tests/integration/test_lists/waives.txt
Adds waivers for additional B200 test variants and preserves the existing VideoMMEEPD, DeepSeekV3Lite, and MiniMaxM3 entries.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Possibly related PRs

Suggested reviewers: bowenfu, brnguyen2, qijune

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description has useful details, but it is missing the required template sections for Description, Test Coverage, and PR Checklist. Add the template sections with a short Description, relevant Test Coverage, and the PR Checklist confirmation before merging.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title is concise and accurately describes the QA CI waiver update.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 141: Add or update the NVIDIA copyright header for the modified entries
in the test list, including the repository-standard 2026 copyright year. Apply
the same header consistently to the ranges identified by the review comment.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 48c1d173-4b98-4c82-9822-63c964af23d9

📥 Commits

Reviewing files that changed from the base of the PR and between 90f7868 and 2226b46.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #62185 [ skip ] triggered by Bot. Commit: 2226b46 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #62185 [ skip ] completed with state SUCCESS. Commit: 2226b46
Skipping testing for commit 2226b46

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants