Skip to content

[None][test] Waive 1 failed cases for main in QA CI - #14259

Merged
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260518-115311
May 19, 2026
Merged

[None][test] Waive 1 failed cases for main in QA CI#14259
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260518-115311

Conversation

@xinhe-nv

@xinhe-nv xinhe-nv commented May 18, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6187185

Waive entries added

accuracy/test_llm_api_autodeploy.py::TestNemotronV2::test_auto_dtype[False] SKIP (https://nvbugs/6187185)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

This pull request contains only internal test infrastructure updates with no user-visible changes. No release notes are needed for end-users.

Review Change Stack

@crazydemo
crazydemo enabled auto-merge (squash) May 18, 2026 11:53
@coderabbitai

coderabbitai Bot commented May 18, 2026

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

A single SKIP entry is added to the test waivers list for accuracy/test_llm_api_autodeploy.py::TestNemotronV2::test_auto_dtype[False], referencing an NVBug tracking link.

Changes

Test Waiver List Update

Layer / File(s) Summary
Nemotron V2 autodeploy dtype test waiver
tests/integration/test_lists/waives.txt
SKIP waiver entry added for the Nemotron V2 autodeploy dtype test with the [False] parameter variant.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14204: Both PRs modify tests/integration/test_lists/waives.txt by adding a new skipped test case entry to the same waiver file.
  • NVIDIA/TensorRT-LLM#14086: Both PRs add a new SKIP entry to tests/integration/test_lists/waives.txt for skipped test cases by extending the waivers list.
  • NVIDIA/TensorRT-LLM#14169: Both PRs directly modify tests/integration/test_lists/waives.txt by adding waiver entries for accuracy/test_llm_api_* test cases.

Suggested reviewers

  • jieli-matrix
  • ZhanruiSunCh
  • EmmaQiaoCh
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The PR description is incomplete relative to the template. While it provides auto-generated context about the waive entry and bug reference, it lacks the required Description and Test Coverage sections from the template. Add Description section explaining why the test is being waived and add Test Coverage section documenting how the waive entry was validated.
✅ Passed checks (4 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title clearly and specifically describes the main change: adding a waive for a failed test case in the QA CI pipeline for the main branch.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@crazydemo
crazydemo force-pushed the trtllm-ci-report/waive-20260518-115311 branch from 9e11a5c to 20291cb Compare May 18, 2026 11:55
@crazydemo

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48901 [ run ] triggered by Bot. Commit: 20291cb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48901 [ run ] completed with state SUCCESS. Commit: 20291cb
/LLM/main/L0_MergeRequest_PR pipeline #38650 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@crazydemo

Copy link
Copy Markdown
Collaborator

/bot skip --comment "only waive cases and check test list has been passes "

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49052 [ skip ] triggered by Bot. Commit: 20291cb Link to invocation

@crazydemo
crazydemo disabled auto-merge May 19, 2026 02:59
@crazydemo
crazydemo enabled auto-merge (squash) May 19, 2026 03:02
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49052 [ skip ] completed with state SUCCESS. Commit: 20291cb
Skipping testing for commit 20291cb

Link to invocation

@crazydemo crazydemo changed the title [None][infra] Waive 1 failed cases for main in post-merge [None][test] Waive 1 failed cases for main in QA CI May 19, 2026
Bug(s): 6187185
Requested by: qa@nvidia.com

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@crazydemo
crazydemo force-pushed the trtllm-ci-report/waive-20260518-115311 branch from 7a1f0fe to 3b051a6 Compare May 19, 2026 03:18
@crazydemo

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49067 [ run ] triggered by Bot. Commit: 3b051a6 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49067 [ run ] completed with state SUCCESS. Commit: 3b051a6
/LLM/main/L0_MergeRequest_PR pipeline #38796 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@crazydemo

Copy link
Copy Markdown
Collaborator

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49112 [ reuse-pipeline ] triggered by Bot. Commit: 3b051a6 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49112 [ reuse-pipeline ] completed with state SUCCESS. Commit: 3b051a6
Reusing PR_Github #49067 (Partly Tested) for commit 3b051a6

Link to invocation

@crazydemo
crazydemo merged commit 13413e9 into NVIDIA:main May 19, 2026
7 checks passed
KleinBlueC pushed a commit to KleinBlueC/TensorRT-LLM that referenced this pull request May 19, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
xxi-nv pushed a commit to xxi-nv/TensorRT-LLM that referenced this pull request May 22, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260518-115311 branch May 27, 2026 13:31
bmarimuthu-nv pushed a commit to nv-auto-deploy/TensorRT-LLM that referenced this pull request May 28, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Co-authored-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants