Skip to content

[None][test] Waive 8 failed cases for main in QA CI - #15342

Merged
jieli-matrix merged 7 commits into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260613-221618
Jun 19, 2026
Merged

[None][test] Waive 8 failed cases for main in QA CI#15342
jieli-matrix merged 7 commits into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260613-221618

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented Jun 13, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1536/
Bug(s): 6276923, 6316981, 6316983, 6316985, 6317600, 6317601

Waive entries added

full:GB200/accuracy/test_llm_api_pytorch.py::TestQwen3_5_35B_A3B::test_fp8_moe_dflash SKIP (https://nvbugs/6316985)
full:GB200/accuracy/test_llm_api_pytorch_multimodal.py::TestQwen2_5_VL_7B::test_auto_dtype SKIP (https://nvbugs/6316983)
full:GB200/accuracy/test_llm_api_autodeploy.py::TestNemotronSuperV3::test_mtp[fp8_ws4_80gb-trtllm] SKIP (https://nvbugs/6316981)
full:GB200/accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy_mode_b_overlap SKIP (https://nvbugs/6276923)
full:GB200/accuracy/test_llm_api_pytorch.py::TestQwen3NextThinking::test_auto_dtype[tp4ep4] SKIP (https://nvbugs/6317600)
full:GB200/test_e2e.py::test_openai_chat_harmony_perf_metrics SKIP (https://nvbugs/6317601)
full:GB200/accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy SKIP (https://nvbugs/6276923)
full:GB200/accuracy/test_dwdp_disaggregated_serving.py::TestDwdpDeepSeekV3Lite::test_dwdp_accuracy_contention_opt SKIP (https://nvbugs/6276923)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated GB200 test waivers list with eight additional entries to enhance test coverage.

@jieli-matrix
jieli-matrix marked this pull request as ready for review June 16, 2026 02:48
@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260613-221618 branch from 4e4b7c7 to a6e42cc Compare June 16, 2026 02:48
@jieli-matrix
jieli-matrix enabled auto-merge (squash) June 16, 2026 02:48
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai

coderabbitai Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7b7f24c0-e06d-4f94-a1b8-176d6775ccee

📥 Commits

Reviewing files that changed from the base of the PR and between f49d09f and a6e42cc.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Eight new SKIP waiver entries are appended to tests/integration/test_lists/waives.txt for GB200 tests covering dwdp disaggregated serving accuracy and LLM API autodeploy scenarios, each annotated with an nvbugs issue link. No existing lines are modified or removed.

Changes

GB200 Test Waivers

Layer / File(s) Summary
GB200 SKIP waiver entries
tests/integration/test_lists/waives.txt
Appends eight SKIP waiver lines for GB200 dwdp disaggregated serving accuracy and LLM API autodeploy tests, each referencing a corresponding nvbugs issue.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#15326: Modifies the same waives.txt file by adding new SKIP waiver entries without altering existing lines.
  • NVIDIA/TensorRT-LLM#15315: Adds SKIP waiver entries to the same file for GB200/B200 disaggregated test failures including test_disaggregated_stress_test.
  • NVIDIA/TensorRT-LLM#15250: Adds SKIP entries to the same waives.txt for GB200 disaggregated perf scenarios including DeepSeek variants.

Suggested reviewers

  • crazydemo
  • jieli-matrix
  • LarryXFly
  • StanleySun639
  • xinhe-nv
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly describes the main change—waiving 8 failed test cases for the main branch in QA CI—which directly matches the changeset's addition of 8 waiver entries.
Description check ✅ Passed The description provides essential information including creation context, target branch, Jenkins build link, affected bugs, and detailed waive entries, though it does not follow the repository's standard template structure.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54434 [ run ] triggered by Bot. Commit: a6e42cc Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54434 [ run ] completed with state FAILURE. Commit: a6e42cc
/LLM/main/L0_MergeRequest_PR pipeline #43498 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260613-221618 branch from a6e42cc to 8e62c63 Compare June 16, 2026 06:31
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54509 [ reuse-pipeline ] triggered by Bot. Commit: 8e62c63 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54509 [ reuse-pipeline ] completed with state SUCCESS. Commit: 8e62c63
Can't reuse PR_Github #54434 (Partly Tested) with status: FAILED

Link to invocation

Bug(s): 6276923, 6316981, 6316983, 6316985, 6317600, 6317601
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1536/

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260613-221618 branch from 8e62c63 to 59fbd00 Compare June 17, 2026 02:24
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54714 [ run ] triggered by Bot. Commit: 59fbd00 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54714 [ run ] completed with state FAILURE. Commit: 59fbd00
/LLM/main/L0_MergeRequest_PR pipeline #43741 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54920 [ run ] triggered by Bot. Commit: 0e400a2 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54920 [ run ] completed with state SUCCESS. Commit: 0e400a2
/LLM/main/L0_MergeRequest_PR pipeline #43922 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54964 [ run ] triggered by Bot. Commit: cb0fac3 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54964 [ run ] completed with state SUCCESS. Commit: cb0fac3
/LLM/main/L0_MergeRequest_PR pipeline #43964 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Only waive tests"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54972 [ skip ] triggered by Bot. Commit: 6e82ed8 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54972 [ skip ] completed with state SUCCESS. Commit: 6e82ed8
Skipping testing for commit 6e82ed8

Link to invocation

@jieli-matrix
jieli-matrix merged commit 5e1a28f into NVIDIA:main Jun 19, 2026
7 checks passed
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 23, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 24, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants