Skip to content

[None][test] Waive 5 failed cases for main in post-merge - #15059

Closed
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260607-093221
Closed

[None][test] Waive 5 failed cases for main in post-merge#15059
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260607-093221

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented Jun 7, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6278377, 6278399, 6278403

Waive entries added

accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy SKIP (https://nvbugs/6278399)
accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy_mode_b_overlap SKIP (https://nvbugs/6278399)
accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy_contention_opt SKIP (https://nvbugs/6278399)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_nvfp4_4gpus[moe_backend=CUTLASS-mtp_nextn=0-pp4-fp8kv=True-attention_dp=True-cuda_graph=True-overlap_scheduler=True-low_precision_combine=False-torch_compile=True] SKIP (https://nvbugs/6278403)
accuracy/test_llm_api_pytorch.py::TestStep3_7::test_auto_dtype[tp_size=8-ep_size=8] SKIP (https://nvbugs/6278377)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added skip waivers for multiple test cases related to model variants and training configurations.

Bug(s): 6278377, 6278399, 6278403
Requested by: qa@nvidia.com

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@coderabbitai

coderabbitai Bot commented Jun 7, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 097d8420-dd11-402d-9a80-4a32dbdeeffa

📥 Commits

Reviewing files that changed from the base of the PR and between bedad85 and 064caed.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

This PR adds five test skip/waiver entries to tests/integration/test_lists/waives.txt for known failing integration tests. Three entries address DeepSeekV3 Lite DWDP accuracy test failures, one addresses a DeepSeekV3 Lite NF4 quantization test with specific backend configuration, and one addresses a Step3.7 tensor parallelism test, each linked to corresponding nvbugs references.

Changes

Test Skip/Waiver Updates

Layer / File(s) Summary
Skip waiver entries for known failing tests
tests/integration/test_lists/waives.txt
Five new waiver entries added: three for TestDwdpDeepSeekV3Lite accuracy test variants linked to nvbugs/6278399, one for TestDeepSeekV3Lite::test_nvfp4_4gpus with moe_backend=CUTLASS and torch_compile=True linked to nvbugs/6278403, and one for TestStep3_7::test_auto_dtype[tp_size=8-ep_size=8] linked to nvbugs/6278377.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#13823: Both PRs modify tests/integration/test_lists/waives.txt by adding new SKIP waiver entries for failing integration tests.
  • NVIDIA/TensorRT-LLM#14854: Both PRs update tests/integration/test_lists/waives.txt with skip waivers for DeepSeekV3 variants, overlapping on TestDeepSeekV3Lite::test_nvfp4_4gpus with torch_compile configurations.
  • NVIDIA/TensorRT-LLM#14789: Both PRs modify tests/integration/test_lists/waives.txt by adding new skip/waiver entries tied to nvbugs/* references.

Suggested reviewers

  • jieli-matrix
  • LarryXFly
  • xinhe-nv
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name Status Explanation Resolution
Description check ❓ Inconclusive The PR description is missing critical sections from the template (Test Coverage and PR Checklist), though it provides adequate technical details about the waive entries and associated bug links. Add Test Coverage section describing how the waived tests are safeguarded, and complete the PR Checklist to confirm compliance with coding guidelines and procedures.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly and specifically identifies the purpose of the PR: waiving 5 failed test cases for the main branch post-merge.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@crazydemo

Copy link
Copy Markdown
Collaborator

close, as moved to #15056

@crazydemo crazydemo closed this Jun 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants