[None][infra] Waive 16 failed cases for main in post-merge 2824

[trtllm-agent]

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @mzweilz)
Target branch: main
Bug(s): 6422294, 6422299, 6422315, 6422337, 6422339

Waive entries added

accuracy/test_epd_disagg_multimodal.py::TestVideoMMEEPD::test_disaggregated_videomme[qwen3vl_2b_instruct] SKIP (https://nvbugs/6422294)
accuracy/test_llm_api_autodeploy.py::TestNemotronSuperV3::test_mtp[bf16_ws4_180gb-trtllm] SKIP (https://nvbugs/6422315)
accuracy/test_llm_api_pytorch.py::TestLlama3_1_8BInstruct::test_bfloat16_4gpus[tp2pp2-attn_backend=FLASHINFER-torch_compile=True] SKIP (https://nvbugs/6422337)
examples/visual_gen/test_visual_gen.py::test_cosmos3_nano_t2v_lpips_against_golden SKIP (https://nvbugs/6422299)
perf/test_perf_sanity.py::test_e2e[aggr_upload-k25_thinking_fp4_2_nodes_grace_blackwell-k25_thinking_fp4_tep8_32k8k] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-e2e-gb200_qwen3-235b-fp4_8k1k_con1024_ctx1_tp1_gen1_dep8_eplb0_mtp0_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_128k8k_con64_ctx1_pp8_gen1_dep32_eplb0_mtp3_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_1k1k_con1024_ctx1_dep4_gen1_dep32_eplb0_mtp3_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_1k1k_con1024_ctx1_dep4_gen1_dep8_eplb0_mtp0_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_1k1k_con2048_ctx2_dep4_gen1_dep16_eplb0_mtp3_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_1k1k_con2048_ctx2_dep4_gen1_dep16_eplb288_mtp3_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-r1-fp4_1k1k_con3072_ctx1_dep4_gen1_dep4_eplb0_mtp1_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb200_deepseek-v32-fp4_8k1k_con4096_ctx1_dep4_gen1_dep32_eplb256_mtp0_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb300_deepseek-r1-fp4_1k1k_con3072_ctx1_dep4_gen1_dep4_eplb0_mtp1_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_perf_sanity.py::test_e2e[disagg_upload-gen_only-gb300_glm-5-fp4_1k1k_con4096_ctx1_dep2_gen1_dep8_eplb256_mtp1_ccb-NIXL] SKIP (https://nvbugs/6422339)
perf/test_visual_gen_perf_sanity.py::test_visual_gen_e2e[vg_upload-wan22_i2v_a14b_blackwell-wan22_i2v_a14b_nvfp4_trtllm_cfg2_ulysses4] SKIP (https://nvbugs/6422339)

---

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

• Tests
  • Updated the test waiver list to account for several newly identified failing cases across accuracy, examples, and performance sanity checks.
  • Adjusted existing performance waivers and added coverage for additional model/configuration combinations.
  • No user-facing features or behavior changes.

[mzweilz]

/bot skip --comment "waive only"

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: b3009ad2-b778-4757-a034-f8cd7a403ddc

📥 Commits

Reviewing files that changed from the base of the PR and between 211482b and 440fdcd.

📒 Files selected for processing (1)

• tests/integration/test_lists/waives.txt

---

📝 Walkthrough

Walkthrough

This PR updates the test waiver list by adding new SKIP entries for failing accuracy tests (EPD disagg multimodal, NemotronSuperV3, Llama3_1_8BInstruct) and a visual-gen golden test, and replaces a block of perf sanity waivers with updated aggr_upload/disagg_upload and visual-gen perf sanity entries.

Changes

Test Waiver List Updates

Layer / File(s)	Summary
New accuracy and visual-gen waive entries tests/integration/test_lists/waives.txt	Adds SKIP entries for test_disaggregated_videomme, TestNemotronSuperV3::test_mtp, TestLlama3_1_8BInstruct::test_bfloat16_4gpus, and test_cosmos3_nano_t2v_lpips_against_golden.
Perf sanity waive block replacement tests/integration/test_lists/waives.txt	Replaces the perf/test_perf_sanity.py waive block with new aggr_upload/disagg_upload entries and updates a perf/test_visual_gen_perf_sanity.py waive.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Possibly related PRs

• NVIDIA/TensorRT-LLM#15986: Both PRs modify tests/integration/test_lists/waives.txt by adding SKIP entries for accuracy/test_llm_api_pytorch.py::TestLlama3_1_8BInstruct test cases.
• NVIDIA/TensorRT-LLM#15949: Both PRs add SKIP entries for accuracy/test_llm_api_autodeploy.py test variants in the same waiver file.
• NVIDIA/TensorRT-LLM#15967: Both PRs update perf/test_perf_sanity.py waive entries using aggr_upload/disagg_upload variants in the same file.

Suggested reviewers: dongxuy04, pcastonguay, yuxianq

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title matches the change: an infra waive PR for 16 failed cases in post-merge 2824.
Description check	✅ Passed	The description explains the waive PR and lists bugs and affected tests, but it omits the template’s Test Coverage and PR Checklist sections.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}

[tensorrt-cicd]

PR_Github #57913 [ skip ] triggered by Bot. Commit: 440fdcd Link to invocation

[tensorrt-cicd]

PR_Github #57913 [ skip ] completed with state SUCCESS. Commit: 440fdcd
Skipping testing for commit 440fdcd

Link to invocation