[None][test] Waive 2 failed cases for main in QA CI by tensorrt-cicd · Pull Request #15341 · NVIDIA/TensorRT-LLM

tensorrt-cicd · 2026-06-13T18:05:30Z

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1535/
Bug(s): 6316983, 6317074

Waive entries added

full:B200/accuracy/test_llm_api_pytorch_multimodal.py::TestQwen2_5_VL_7B::test_auto_dtype SKIP (https://nvbugs/6316983)
full:B200/accuracy/test_llm_api_pytorch.py::TestNemotronV3Ultra::test_nvfp4_4gpus_block_reuse[TEP4] SKIP (https://nvbugs/6317074)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

Tests
- Added test waivers for specific B200 target test cases to address known issues and prevent blocking builds.

Bug(s): 6316983, 6317074 Requested by: qa@nvidia.com Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1535/ Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

coderabbitai · 2026-06-16T02:09:05Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: b2ac8755-dd6e-47b6-b145-6a7d91ee87cb

📥 Commits

Reviewing files that changed from the base of the PR and between 2ef2ea5 and 1887ebb.

📒 Files selected for processing (1)

tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Two SKIP waiver entries are added to the integration test waiver list for B200 targets: TestNemotronV3Ultra::test_nvfp4_4gpus_block_reuse[TEP4] (nvbugs 6317074) and TestQwen2_5_VL_7B::test_auto_dtype (nvbugs 6316983).

Changes

B200 Test Waiver Additions

Layer / File(s)	Summary
B200 skip entries for NemotronV3Ultra and Qwen2.5 VL 7B `tests/integration/test_lists/waives.txt`	Adds two full:B200 SKIP waiver lines for `TestNemotronV3Ultra::test_nvfp4_4gpus_block_reuse[TEP4]` and `TestQwen2_5_VL_7B::test_auto_dtype`, each referencing their respective nvbugs tracking numbers.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

NVIDIA/TensorRT-LLM#14783: Adds SKIP waivers to the same waives.txt file for TestNemotron-related test_auto_dtype cases, directly overlapping in both mechanism and model family.
NVIDIA/TensorRT-LLM#15358: Modifies the same waives.txt file by adding new SKIP entries for specific failing tests with nvbugs references.
NVIDIA/TensorRT-LLM#15315: Adds new B200-related SKIP waiver entries to the same waives.txt file for CI test failures.

Suggested reviewers

crazydemo
jieli-matrix
LarryXFly
StanleySun639
xinhe-nv

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title accurately summarizes the PR's main objective: waiving 2 failed test cases for the main branch in QA CI.
Description check	✅ Passed	The PR description provides essential context (auto-generated waive PR, bug references, Jenkins build link, waive entries), though it deviates from the template structure which expects manual description sections.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

jieli-matrix · 2026-06-16T02:11:04Z

/bot run --stage-list ""

tensorrt-cicd · 2026-06-16T02:17:03Z

PR_Github #54417 [ run ] triggered by Bot. Commit: 1887ebb Link to invocation

tensorrt-cicd · 2026-06-16T04:02:14Z

PR_Github #54417 [ run ] completed with state FAILURE. Commit: 1887ebb
/LLM/main/L0_MergeRequest_PR pipeline #43488 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

jieli-matrix · 2026-06-16T06:32:35Z

/bot run --stage-list ""

tensorrt-cicd · 2026-06-16T06:39:23Z

PR_Github #54510 [ run ] triggered by Bot. Commit: e809eb4 Link to invocation

tensorrt-cicd · 2026-06-16T12:59:38Z

PR_Github #54510 [ run ] completed with state SUCCESS. Commit: e809eb4
/LLM/main/L0_MergeRequest_PR pipeline #43575 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

jieli-matrix · 2026-06-17T02:25:02Z

/bot run --stage-list ""

tensorrt-cicd · 2026-06-17T02:31:33Z

PR_Github #54715 [ run ] triggered by Bot. Commit: 423505d Link to invocation

tensorrt-cicd · 2026-06-17T02:49:20Z

PR_Github #54715 [ run ] completed with state FAILURE. Commit: 423505d
/LLM/main/L0_MergeRequest_PR pipeline #43746 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Signed-off-by: Jie Li <lijie@nvidia.com>

jieli-matrix · 2026-06-18T07:02:11Z

/bot run --stage-list ""

tensorrt-cicd · 2026-06-18T07:08:20Z

PR_Github #54916 [ run ] triggered by Bot. Commit: 35ed4e6 Link to invocation

tensorrt-cicd · 2026-06-18T11:45:18Z

PR_Github #54916 [ run ] completed with state SUCCESS. Commit: 35ed4e6
/LLM/main/L0_MergeRequest_PR pipeline #43921 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

Signed-off-by: Jie Li <lijie@nvidia.com>

jieli-matrix · 2026-06-19T07:47:50Z

/bot run --stage-list ""

tensorrt-cicd · 2026-06-19T07:53:57Z

PR_Github #54968 [ run ] triggered by Bot. Commit: 2c5c2d2 Link to invocation

tensorrt-cicd · 2026-06-19T12:29:56Z

PR_Github #54968 [ run ] completed with state SUCCESS. Commit: 2c5c2d2
/LLM/main/L0_MergeRequest_PR pipeline #43968 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

jieli-matrix · 2026-06-20T04:38:47Z

/bot skip --comment "Only waive tests"

tensorrt-cicd · 2026-06-20T04:45:14Z

PR_Github #54977 [ skip ] triggered by Bot. Commit: 59a50b1 Link to invocation

tensorrt-cicd · 2026-06-20T04:59:04Z

PR_Github #54977 [ skip ] completed with state SUCCESS. Commit: 59a50b1
Skipping testing for commit 59a50b1

Link to invocation

jieli-matrix · 2026-06-20T13:52:42Z

/bot reuse-pipeline

tensorrt-cicd · 2026-06-20T13:58:14Z

PR_Github #54986 [ reuse-pipeline ] triggered by Bot. Commit: f09d7bd Link to invocation

tensorrt-cicd · 2026-06-20T14:02:32Z

PR_Github #54986 [ reuse-pipeline ] completed with state SUCCESS. Commit: f09d7bd
Can't reuse PR_Github #54968 (Partly Tested) with status: FAILED

Link to invocation

jieli-matrix · 2026-06-22T05:18:08Z

/bot skip --comment "Only waive tests"

tensorrt-cicd · 2026-06-22T05:24:37Z

PR_Github #55017 [ skip ] triggered by Bot. Commit: eae6287 Link to invocation

tensorrt-cicd · 2026-06-22T05:33:48Z

PR_Github #55017 [ skip ] completed with state SUCCESS. Commit: eae6287
Skipping testing for commit eae6287

Link to invocation

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com> Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com> Co-authored-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com> Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com> Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com> Co-authored-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

[None][test] Waive 2 failed cases for main in QA CI

96df615

Bug(s): 6316983, 6317074 Requested by: qa@nvidia.com Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1535/ Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>

tensorrt-cicd requested review from LarryXFly, StanleySun639, crazydemo, jieli-matrix and xinhe-nv June 13, 2026 18:05

github-actions Bot assigned tensorrt-cicd Jun 13, 2026

jieli-matrix approved these changes Jun 16, 2026

View reviewed changes

jieli-matrix marked this pull request as ready for review June 16, 2026 02:08

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

1887ebb

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

jieli-matrix enabled auto-merge (squash) June 16, 2026 02:08

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

e809eb4

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

423505d

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

jieli-matrix and others added 3 commits June 17, 2026 11:01

[None][infra] Fix waives.txt ordering to satisfy release check

371462f

Signed-off-by: Jie Li <lijie@nvidia.com>

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

9c8c9ad

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

35ed4e6

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

72b9dcf

Signed-off-by: Jie Li <76780849+jieli-matrix@users.noreply.github.com>

jieli-matrix and others added 2 commits June 19, 2026 14:32

[None][infra] Fix waives.txt ordering to satisfy release check

938f333

Signed-off-by: Jie Li <lijie@nvidia.com>

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

2c5c2d2

jieli-matrix added 2 commits June 19, 2026 20:49

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

7aedc85

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

59a50b1

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

d97e596

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

f09d7bd

jieli-matrix added 2 commits June 22, 2026 13:14

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

f1b56b2

Merge branch 'main' into trtllm-ci-report/waive-20260613-180527

eae6287

jieli-matrix merged commit 416bdb2 into NVIDIA:main Jun 22, 2026
7 checks passed

This was referenced Jun 23, 2026

[None][test] Waive 3 failed cases for main in QA CI #15509

Merged

[None][test] Waive 11 failed cases for main in QA CI #15506

Merged

Uh oh!

Conversation

tensorrt-cicd commented Jun 13, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Auto-generated Waive PR

Waive entries added

Summary by CodeRabbit

Uh oh!

coderabbitai Bot commented Jun 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Estimated code review effort

Possibly related PRs

Suggested reviewers

Uh oh!

jieli-matrix commented Jun 16, 2026

Uh oh!

tensorrt-cicd commented Jun 16, 2026

Uh oh!

tensorrt-cicd commented Jun 16, 2026

Uh oh!

jieli-matrix commented Jun 16, 2026

Uh oh!

tensorrt-cicd commented Jun 16, 2026

Uh oh!

tensorrt-cicd commented Jun 16, 2026

Uh oh!

jieli-matrix commented Jun 17, 2026

Uh oh!

tensorrt-cicd commented Jun 17, 2026

Uh oh!

tensorrt-cicd commented Jun 17, 2026

Uh oh!

jieli-matrix commented Jun 18, 2026

Uh oh!

tensorrt-cicd commented Jun 18, 2026

Uh oh!

tensorrt-cicd commented Jun 18, 2026

Uh oh!

jieli-matrix commented Jun 19, 2026

Uh oh!

tensorrt-cicd commented Jun 19, 2026

Uh oh!

tensorrt-cicd commented Jun 19, 2026

Uh oh!

jieli-matrix commented Jun 20, 2026

Uh oh!

tensorrt-cicd commented Jun 20, 2026

Uh oh!

tensorrt-cicd commented Jun 20, 2026

Uh oh!

jieli-matrix commented Jun 20, 2026

Uh oh!

tensorrt-cicd commented Jun 20, 2026

Uh oh!

tensorrt-cicd commented Jun 20, 2026

Uh oh!

jieli-matrix commented Jun 22, 2026

Uh oh!

tensorrt-cicd commented Jun 22, 2026

Uh oh!

tensorrt-cicd commented Jun 22, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

tensorrt-cicd commented Jun 13, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Jun 16, 2026 •

edited

Loading