[None][test] Waive 4 failed cases for main in QA CI

[tensorrt-cicd]

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1552/
Bug(s): 5970614, 6331421, 6344107, 6344612

Waive entries added

full:B200/accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[v1_kv_cache-dp4-trtllm-fp8] SKIP (https://nvbugs/6344612)
full:B200/accuracy/test_llm_api_pytorch_multimodal.py::TestQwen2_5_VL_7B::test_auto_dtype SKIP (https://nvbugs/6331421)
full:B200/disaggregated/test_disaggregated.py::test_disaggregated_overlap_gen_first[ctx_pp4-TinyLlama-1.1B-Chat-v1.0] SKIP (https://nvbugs/6344107)
full:B200/accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_nvfp4_multi_gpus[throughput_pp4_mtp] SKIP (https://nvbugs/5970614)

---

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

• Tests
  • Updated test waiver configurations for specific hardware and model deployment scenarios.

[xinhe-nv]

/bot --skip comments "only waive tests"

[github-actions]

GitHub Bot Help

/bot [-h] ['run', 'kill', 'skip', 'reuse-pipeline'] ...

Provide a user friendly way for developers to interact with a Jenkins server.

Run /bot [-h|--help] to print this help message.

See details below for each supported subcommand.

Details

run [--reuse-test (optional)pipeline-id --disable-fail-fast --skip-test --stage-list "A10-PyTorch-1, xxx" --gpu-type "A30, H100_PCIe" --test-backend "pytorch, cpp" --add-multi-gpu-test --only-multi-gpu-test --disable-multi-gpu-test --post-merge --extra-stage "H100_PCIe-TensorRT-Post-Merge-1, xxx" --detailed-log --debug(experimental) --high-priority]

Launch build/test pipelines. All previously running jobs will be killed.

--reuse-test (optional)pipeline-id (OPTIONAL) : Allow the new pipeline to reuse build artifacts and skip successful test stages from a specified pipeline or the last pipeline if no pipeline-id is indicated. If the Git commit ID has changed, this option will be always ignored. The DEFAULT behavior of the bot is to reuse build artifacts and successful test results from the last pipeline.

--disable-reuse-test (OPTIONAL) : Explicitly prevent the pipeline from reusing build artifacts and skipping successful test stages from a previous pipeline. Ensure that all builds and tests are run regardless of previous successes.

--disable-fail-fast (OPTIONAL) : Disable fail fast on build/tests/infra failures.

--skip-test (OPTIONAL) : Skip all test stages, but still run build stages, package stages and sanity check stages. Note: Does NOT update GitHub check status.

--stage-list "A10-PyTorch-1, xxx" (OPTIONAL) : Only run the specified test stages. Supports wildcard * for pattern matching (e.g., "*PerfSanity*" matches all stages containing PerfSanity). Examples: "A10-PyTorch-1, xxx", "PerfSanity". Note: Does NOT update GitHub check status.

--gpu-type "A30, H100_PCIe" (OPTIONAL) : Only run the test stages on the specified GPU types. Examples: "A30, H100_PCIe". Note: Does NOT update GitHub check status.

--test-backend "pytorch, cpp" (OPTIONAL) : Skip test stages which don't match the specified backends. Only support [pytorch, cpp, tensorrt, triton]. Examples: "pytorch, cpp" (does not run test stages with tensorrt or triton backend). Note: Does NOT update GitHub pipeline status.

--only-multi-gpu-test (OPTIONAL) : Only run the multi-GPU tests. Note: Does NOT update GitHub check status.

--disable-multi-gpu-test (OPTIONAL) : Disable the multi-GPU tests. Note: Does NOT update GitHub check status.

--add-multi-gpu-test (OPTIONAL) : Force run the multi-GPU tests in addition to running L0 pre-merge pipeline.

--post-merge (OPTIONAL) : Run the L0 post-merge pipeline instead of the ordinary L0 pre-merge pipeline.

--extra-stage "H100_PCIe-TensorRT-Post-Merge-1, xxx" (OPTIONAL) : Run the ordinary L0 pre-merge pipeline and specified test stages. Supports wildcard * for pattern matching. Examples: --extra-stage "H100_PCIe-TensorRT-Post-Merge-1, xxx", --extra-stage "Post-Merge".

--detailed-log (OPTIONAL) : Enable flushing out all logs to the Jenkins console. This will significantly increase the log volume and may slow down the job.

--debug (OPTIONAL) : Experimental feature. Enable access to the CI container for debugging purpose. Note: Specify exactly one stage in the stage-list parameter to access the appropriate container environment. Note: Does NOT update GitHub check status.

--high-priority (OPTIONAL) : Run the pipeline with high priority. This option is restricted to authorized users only and will route the job to a high-priority queue.

kill

kill

Kill all running builds associated with pull request.

skip

skip --comment COMMENT

Skip testing for latest commit on pull request. --comment "Reason for skipping build/test" is required. IMPORTANT NOTE: This is dangerous since lack of user care and validation can cause top of tree to break.

reuse-pipeline

reuse-pipeline

Reuse a previous pipeline to validate current commit. This action will also kill all currently running builds associated with the pull request. IMPORTANT NOTE: This is dangerous since lack of user care and validation can cause top of tree to break.

[xinhe-nv]

/bot skip --comment "Only waive tests"

[coderabbitai]

📝 Walkthrough

Walkthrough

Three new SKIP entries are added to the full:B200 section of tests/integration/test_lists/waives.txt, waiving a DeepSeekR1 nvfp4 multi-GPU throughput pipeline-parallel test, a GPTOSS w4 4-GPU fp8 KV cache test, and a disaggregated overlap generation test for TinyLlama.

Changes

B200 Integration Test Waivers

Layer / File(s)	Summary
B200 waiver additions tests/integration/test_lists/waives.txt	Appends three new SKIP entries to the full:B200 block: DeepSeekR1::test_nvfp4_multi_gpus[throughput_pp4_mtp], TestGPTOSS::test_w4_4gpus[v1_kv_cache-dp4-trtllm-fp8], and test_disaggregated_overlap_gen_first[ctx_pp4-TinyLlama-1.1B-Chat-v1.0], while retaining all pre-existing B200 waivers.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

• NVIDIA/TensorRT-LLM#13504: Adds SKIP entries for disaggregated/overlap TinyLlama-1.1B-Chat cases in the same waives.txt file.
• NVIDIA/TensorRT-LLM#15337: Modifies waives.txt to add/adjust SKIP entries for GPTOSS w4_4gpus test configurations, directly overlapping with one of the new waivers here.
• NVIDIA/TensorRT-LLM#15056: Expands waivers for DeepSeekR1 nvfp4 multi-GPU and other B200-related scenarios in the same waiver list.

Suggested reviewers

• crazydemo
• jieli-matrix
• StanleySun639
• LarryXFly
• xinhe-nv

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name	Status	Explanation	Resolution
Description check	❓ Inconclusive	The description is auto-generated and includes key details (bug IDs, waive entries, Jenkins build link), but does not follow the repository's PR description template with required sections.	Provide Description and Test Coverage sections following the template format, though auto-generated PRs may have different requirements—clarify expectations with team.

✅ Passed checks (4 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly and specifically identifies the purpose as waiving 4 failed test cases for the main branch in QA CI, which matches the changeset content.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}

[coderabbitai]

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Around line 175-181: The TestQwen2_5_VL_7B test_auto_dtype entry on line 180
in waives.txt does not match the PR objectives. The line currently references
bug 6316983 but the PR objectives specify it should reference bug 6331421.
Either update line 180 to change the bug number from 6316983 to 6331421 to align
with the stated PR objectives, or provide clarification that this discrepancy
between the objectives and actual changes is intentional. Ensure all four
promised test waivers from the PR objectives are correctly represented in the
final diff.

🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

• Push a commit to this branch (recommended)
• Create a new PR with the fixes

---

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 2126718f-a522-4382-893a-b03b47e3755d

📥 Commits

Reviewing files that changed from the base of the PR and between 2ce56a3 and 29b1181.

📒 Files selected for processing (1)

• tests/integration/test_lists/waives.txt

[tensorrt-cicd]

PR_Github #55155 [ skip ] triggered by Bot. Commit: 29b1181 Link to invocation

[tensorrt-cicd]

PR_Github #55155 [ skip ] completed with state SUCCESS. Commit: 29b1181
Skipping testing for commit 29b1181

Link to invocation