Skip to content

[None][infra] Waive 10 failed cases for main in post-merge 2733 - #14514

Merged
mzweilz merged 2 commits into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260525-054658
May 25, 2026
Merged

[None][infra] Waive 10 failed cases for main in post-merge 2733#14514
mzweilz merged 2 commits into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260525-054658

Conversation

@ZhanruiSunCh

@ZhanruiSunCh ZhanruiSunCh commented May 25, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @mzweilz)
Target branch: main
Bug(s): 6215678, 6215684, 6215688, 6215690, 6215702

Waive entries added

accuracy/test_llm_api_autodeploy.py::TestNemotronUltraV3::test_accuracy[nvfp4-8] SKIP (https://nvbugs/6215690)
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_eagle3_4gpus[v2_kv_cache-trtllm-one_model-overlap_scheduler] SKIP (https://nvbugs/6215702)
examples/test_visual_gen.py::test_flux1_lpips_against_golden SKIP (https://nvbugs/6215688)
examples/test_visual_gen.py::test_flux2_lpips_against_golden SKIP (https://nvbugs/6215688)
examples/test_visual_gen.py::test_ltx2_lpips_against_golden SKIP (https://nvbugs/6215688)
examples/test_visual_gen.py::test_wan21_t2v_lpips_against_golden SKIP (https://nvbugs/6215688)
examples/test_visual_gen.py::test_wan22_t2v_lpips_against_golden SKIP (https://nvbugs/6215688)
stress_test/stress_test.py::test_run_stress_test[llama-v3-8b-instruct-hf_tp1-stress_time_300s_timeout_450s-GUARANTEED_NO_EVICT-pytorch-stress-test] SKIP (https://nvbugs/6215678)
stress_test/stress_test.py::test_run_stress_test[llama-v3-8b-instruct-hf_tp1-stress_time_300s_timeout_450s-MAX_UTILIZATION-pytorch-stress-test] SKIP (https://nvbugs/6215678)
test_doc.py::test_url_validity SKIP (https://nvbugs/6215684)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test waivers for accuracy validation, image generation, and stress testing scenarios.

Review Change Stack

Bug(s): 6215678, 6215684, 6215688, 6215690, 6215702
Requested by: @mzweilz

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
@mzweilz

mzweilz commented May 25, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Post merge waive PR created via CI report, skip testing"

@mzweilz
mzweilz enabled auto-merge (squash) May 25, 2026 05:48
@coderabbitai

coderabbitai Bot commented May 25, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 753002a2-440d-4a90-9135-ced6c7367761

📥 Commits

Reviewing files that changed from the base of the PR and between bdc8b64 and a18dbd3.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

This PR adds ten new test case waivers to the centralized test waiver configuration file, skipping specific failing test cases across accuracy, visual generation, and stress test suites while documenting their associated bug tracking IDs.

Changes

Test Waiver Updates

Layer / File(s) Summary
Test waivers across multiple test suites
tests/integration/test_lists/waives.txt
Added waivers for Nemotron accuracy test (nvfp4-8), GPT-OSS eagle3 test with v2 KV cache and TRT-LLM overlap scheduler, five visual generation LPIPS-against-golden tests (flux1, flux2, ltx2, wan21, wan22 linked to nvbugs/6215688), two stress test configurations for llama-v3-8b-instruct-hf_tp1 (GUARANTEED_NO_EVICT and MAX_UTILIZATION), and URL validity test.

Possibly related PRs

Suggested reviewers

  • mzweilz

🎯 1 (Trivial) | ⏱️ ~3 minutes

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title '[None][infra] Waive 10 failed cases for main in post-merge 2733' clearly and concisely summarizes the PR's main objective: adding waive entries for 10 failed test cases.
Description check ✅ Passed The PR description adequately explains the purpose (auto-generated waive PR), lists all 10 waive entries with their associated bug IDs, and includes appropriate context about the CI report.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50151 [ skip ] triggered by Bot. Commit: a18dbd3 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50151 [ skip ] completed with state SUCCESS. Commit: a18dbd3
Skipping testing for commit a18dbd3

Link to invocation

Signed-off-by: Abby Wei <18545893+mzweilz@users.noreply.github.com>
@mzweilz

mzweilz commented May 25, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Post merge waive PR created via CI report, skip testing"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50154 [ skip ] triggered by Bot. Commit: 78e4824 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50154 [ skip ] completed with state SUCCESS. Commit: 78e4824
Skipping testing for commit 78e4824

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants