Skip to content

[None][test] Waive 7 failed cases for main in QA CI - #16982

Merged
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260729-022619
Jul 29, 2026
Merged

[None][test] Waive 7 failed cases for main in QA CI#16982
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260729-022619

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 5929339, 6525059, 6525892, 6525893, 6525896, 6525897, 6525898

Waive entries added

full:GB200/accuracy/test_llm_api_pytorch.py::TestQwen3_30B_A3B::test_nvfp4[dep4_latency_moe_cutlass-torch_compile=True] SKIP (https://nvbugs/5929339)
full:GB200/accuracy/test_llm_api_pytorch.py::TestQwen3_30B_A3B::test_dummy_load_format SKIP (https://nvbugs/6525059)
full:GB200/accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_fp8_prequantized SKIP (https://nvbugs/6525892)
full:GB200/accuracy/test_disaggregated_serving.py::TestLlama3_1_8BInstruct::test_auto_dtype[False-True-True-True] SKIP (https://nvbugs/6525893)
full:GB200/accuracy/test_llm_api_pytorch.py::TestNemotronV3Ultra::test_nvfp4_4gpus_static_eplb[moe_backend=TRTLLM] SKIP (https://nvbugs/6525898)
full:GB200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_bfloat16[mtp_nextn=0-attention_dp=False-cuda_graph=False-overlap_scheduler=False-torch_compile=False-enable_chunked_prefill=False-v2_kv_cache=False] SKIP (https://nvbugs/6525896)
full:GB200/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_cute_dsl_bf16_gemm[cuda_graph=True] SKIP (https://nvbugs/6525897)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Dev Engineer Review

  • Updated tests/integration/test_lists/waives.txt with seven GB200 accuracy-test waivers, each marked SKIP and associated with bugs 5929339, 6525059, 6525892, 6525893, 6525896, 6525897, and 6525898.
  • The change is limited to test waiver configuration; no exported APIs or production code are affected.
  • Waiver format and scope should be verified against repository conventions, including test-path validity, bug associations, and duplicate entries.

QA Engineer Review

  • Only tests/integration/test_lists/waives.txt was modified.
  • Existing GB200 waiver entries were replaced with updated accuracy and accuracy_multimodal cases covering Llama, DeepSeek, MiniMax, Nemotron, Qwen, and Gemma tests.
  • No test code or test-db//qa/ files were changed.
  • Verdict: needs follow-up pending CBTS coverage data.

Bug(s): 5929339, 6525059, 6525892, 6525893, 6525896, 6525897, 6525898
Requested by: qa@nvidia.com

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Only waive tests"

@coderabbitai

coderabbitai Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Walkthrough

The GB200 waiver list replaces several existing accuracy skips with updated accuracy and multimodal test waivers across Llama, DeepSeek, MiniMax, Nemotron, Qwen, and Gemma configurations.

Changes

GB200 waiver updates

Layer / File(s) Summary
Refresh GB200 accuracy waivers
tests/integration/test_lists/waives.txt
Removes obsolete GB200 skips and adds updated waivers for model, dtype, EPLB, and multimodal test configurations.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Possibly related PRs

Suggested reviewers: jieli-matrix, bowenfu, brnguyen2, mzweilz

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description doesn't follow the repository template and omits the required Description, Test Coverage, and PR Checklist sections. Add the missing template sections and briefly explain the issue, the waive changes, and the tests or validation used.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title is concise and accurately summarizes the main change: waiving seven QA CI failures on main.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Around line 186-204: Add the repository-standard NVIDIA copyright header at
the beginning of the modified waives.txt file, using the current required
copyright year for modified files; leave the existing waiver entries unchanged.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: fe0a00ae-ca29-4ae7-af08-c667bf19e5bb

📥 Commits

Reviewing files that changed from the base of the PR and between 058bbe3 and f9836e0.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #62375 [ skip ] triggered by Bot. Commit: f9836e0 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #62375 [ skip ] completed with state SUCCESS. Commit: f9836e0
Skipping testing for commit f9836e0

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants