[None][test] Waive 7 failed cases for main in QA CI

[xinhe-nv]

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_TEST/2188/
Bug(s): 6206179, 6209806, 6209807, 6211189, 6212250, 6212252

Waive entries added

accuracy/test_llm_api_pytorch.py::TestKanana_Instruct::test_auto_dtype SKIP (https://nvbugs/6209806)
accuracy/test_llm_api_pytorch.py::TestQwen3_5_9B::test_bf16[mtp_on] SKIP (https://nvbugs/6212250)
accuracy/test_llm_api_pytorch.py::TestQwen3_5_9B::test_bf16[mtp_off] SKIP (https://nvbugs/6212250)
accuracy/test_llm_api_pytorch.py::TestQwen3_5_35B_A3B::test_fp8[enable_block_reuse=False] SKIP (https://nvbugs/6212252)
accuracy/test_llm_api_pytorch_multimodal.py::TestExaone4_5_33B::test_auto_dtype[full_budget] SKIP (https://nvbugs/6211189)
accuracy/test_llm_api_pytorch_multimodal.py::TestExaone4_5_33B::test_auto_dtype[forced_chunked_prefill] SKIP (https://nvbugs/6211189)
accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_auto_dtype SKIP (https://nvbugs/6209807)

Already waived (skipped)

• accuracy/test_llm_api_pytorch.py::TestQwen3_5_35B_A3B::test_bf16_mtp[mtp_on]

---

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

• Tests
  • Updated test waivers to reflect current test coverage status for multiple model variants and configurations.

[jieli-matrix]

/bot run --stage-list ""

[coderabbitai]

📝 Walkthrough

Walkthrough

The test waiver list is updated to mark additional accuracy test cases as skipped in CI. A new Kanana Instruct auto dtype test waiver is added with an nvbugs reference, and multiple Qwen3 and multimodal test cases are added to the waiver block, covering new model variants and parameter configurations.

Changes

Test Waiver List Updates

Layer / File(s)	Summary
Kanana Instruct test waiver tests/integration/test_lists/waives.txt	A new SKIP waiver entry is added for accuracy/test_llm_api_pytorch.py::TestKanana_Instruct::test_auto_dtype with NV bug reference 6209806.
Qwen3 and multimodal test waivers expansion tests/integration/test_lists/waives.txt	The waiver block is updated with additional SKIP entries for Qwen3 5.35B A3B fp8 (enable_block_reuse=False), Qwen3 5.9B bf16 (mtp variants), Qwen3 8B configurations, and multimodal test cases for Qwen3 5.35B A3B VL auto dtype.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~5 minutes

Possibly related PRs

• NVIDIA/TensorRT-LLM#14450: Both PRs modify the same integration test-waiver file by adding/replacing waived test entries as part of the same waiver-list workflow.

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name	Status	Explanation	Resolution
Description check	⚠️ Warning	The description is largely incomplete relative to the template; it lacks a proper Description section, Test Coverage section, and PR Checklist confirmation.	Add Description and Test Coverage sections, and check the PR Checklist items. However, for auto-generated CI waivers, a simplified format may be acceptable with approver review.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly and specifically describes the main purpose of the PR: waiving 7 failed test cases for the main branch in QA CI.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[coderabbitai]

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 158: Remove the stale waiver entry for the non-existent test class by
deleting the line containing
"accuracy/test_llm_api_pytorch_multimodal.py::TestQwen3_5_35B_A3B_VL::test_auto_dtype"
from tests/integration/test_lists/waives.txt (the waiver at line with that exact
string); this removes the invalid skip entry so pre-commit validation no longer
fails.

🪄 Autofix (Beta)

❌ Autofix failed (check again to retry)

Fix all unresolved CodeRabbit comments on this PR:

• Push a commit to this branch (recommended)
• Create a new PR with the fixes

---

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7a3e85a3-855e-4861-b110-7fdad355ce94

📥 Commits

Reviewing files that changed from the base of the PR and between 5712b9a and c386954.

📒 Files selected for processing (1)

• tests/integration/test_lists/waives.txt

[coderabbitai]

Note

Autofix is a beta feature. Expect some limitations and changes as we gather feedback and continue to improve it.

An unexpected error occurred while generating fixes: Not Found - https://docs.github.com/rest/git/refs#get-a-reference

[jieli-matrix]

/bot run --stage-list ""

[tensorrt-cicd]

PR_Github #50131 [ run ] triggered by Bot. Commit: 3fd2d45 Link to invocation

[tensorrt-cicd]

PR_Github #50131 [ run ] completed with state SUCCESS. Commit: 3fd2d45
/LLM/main/L0_MergeRequest_PR pipeline #39683 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

[jieli-matrix]

/bot reuse-pipeline

[tensorrt-cicd]

PR_Github #50149 [ reuse-pipeline ] triggered by Bot. Commit: 144bbae Link to invocation

[tensorrt-cicd]

PR_Github #50149 [ reuse-pipeline ] completed with state SUCCESS. Commit: 144bbae
Reusing PR_Github #50131 (Partly Tested) for commit 144bbae

Link to invocation