Skip to content

[None][test] Waive 1 failed cases for main in post-merge - #14720

Closed
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260529-024702
Closed

[None][test] Waive 1 failed cases for main in post-merge#14720
tensorrt-cicd wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260529-024702

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented May 29, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6239554

Waive entries added

accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_auto_dtype SKIP (https://nvbugs/6239554)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Chores
    • Updated test infrastructure with a waiver entry for a specific test case.

Note: This release contains no user-facing changes. It includes internal testing and infrastructure updates only.

Review Change Stack

Bug(s): 6239554
Requested by: qa@nvidia.com

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@jieli-matrix
jieli-matrix enabled auto-merge (squash) May 29, 2026 02:47
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai

coderabbitai Bot commented May 29, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: bcff932a-fbc0-4628-98fa-2899ad3970d8

📥 Commits

Reviewing files that changed from the base of the PR and between fed47f1 and cfefc2b.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

A single waiver entry is added to the test skip list for the Qwen3.5-35B architecture's multimodal auto_dtype accuracy test case, referencing an NV bug ticket.

Changes

Test Waiver Addition

Layer / File(s) Summary
Qwen3.5-35B MultiModal auto_dtype test waiver
tests/integration/test_lists/waives.txt
Added a SKIP waiver for accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_auto_dtype with bug reference https://nvbugs/6239554.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14504: Both PRs update tests/integration/test_lists/waives.txt to add a waiver for the same accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_auto_dtype test case (with different NV bug variants).
  • NVIDIA/TensorRT-LLM#14503: Both PRs update tests/integration/test_lists/waives.txt by adding single SKIP waiver entries for different failing tests.
  • NVIDIA/TensorRT-LLM#14260: Both PRs modify tests/integration/test_lists/waives.txt by adding pytest test-case skip waivers for accuracy/test_llm_api_*::Test*::test_auto_dtype entries.

Suggested reviewers

  • crazydemo
  • StanleySun639
  • jieli-matrix
  • LarryXFly
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description is incomplete; it lacks the required sections like 'Description', 'Test Coverage', and PR Checklist items specified in the repository template. Add the missing sections from the template: expand the 'Description' section with rationale, include 'Test Coverage' section, and complete the PR Checklist items.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly follows the required template format and accurately describes the PR's purpose: waiving one failed test case for the main branch post-merge.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #50940 [ run ] triggered by Bot. Commit: cfefc2b Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #50940 [ run ] completed with state FAILURE. Commit: cfefc2b
/LLM/main/L0_MergeRequest_PR pipeline #40398 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix

Copy link
Copy Markdown
Collaborator

Close the PR since the test case already removed.

auto-merge was automatically disabled May 29, 2026 03:15

Pull request was closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants