Skip to content

[None][infra] Waive 2 failed cases for main in post-merge 2734 - #14526

Merged
mzweilz merged 3 commits into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260525-090733
May 26, 2026
Merged

[None][infra] Waive 2 failed cases for main in post-merge 2734#14526
mzweilz merged 3 commits into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260525-090733

Conversation

@ZhanruiSunCh

@ZhanruiSunCh ZhanruiSunCh commented May 25, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @mzweilz)
Target branch: main
Bug(s): 6215684, 6215688

Waive entries added

test_doc.py::test_url_validity SKIP (https://nvbugs/6215684)
test_wan_t2v_example SKIP (https://nvbugs/6215688)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test configuration to skip two test cases pending resolution of known issues.

Review Change Stack

Bug(s): 6215684, 6215688
Requested by: @mzweilz

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
@mzweilz

mzweilz commented May 25, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Post merge waive PR created via CI report, skip testing."

@mzweilz
mzweilz enabled auto-merge (squash) May 25, 2026 09:09
@coderabbitai

coderabbitai Bot commented May 25, 2026

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

This PR adds two new test waiver entries to the integration test skip list: test_doc.py::test_url_validity and test_wan_t2v_example, each marked with SKIP status and associated nvbug references for tracking purposes.

Changes

Test Waivers

Layer / File(s) Summary
Add test waiver entries
tests/integration/test_lists/waives.txt
Two new test waiver entries are added to skip test_doc.py::test_url_validity and test_wan_t2v_example with nvbug references.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#13502: Modifies tests/integration/test_lists/waives.txt by adding new SKIP/waive entries for specific integration tests.
  • NVIDIA/TensorRT-LLM#13973: Modifies tests/integration/test_lists/waives.txt by adding SKIP/waive entries for specific failing integration test cases.
  • NVIDIA/TensorRT-LLM#14007: Modifies the same file to add new SKIP waiver entries for failing tests including test_moe_backend.

Suggested reviewers

  • mzweilz
  • jieli-matrix
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The PR description is largely incomplete, missing required sections like Description and Test Coverage per the repository template, though it does provide essential waive entry details. Add the missing 'Description' and 'Test Coverage' sections and complete the PR Checklist as specified in the repository template.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: waiving 2 failed test cases for the main branch post-merge, which matches the changeset of adding two skip entries to the waives.txt file.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
tests/integration/test_lists/waives.txt (1)

354-354: QA test list updates are not required for these waivers.

Both waived tests appear to be narrow-scope tests (documentation URL validation and visual generation example) rather than core integration tests under tests/integration/defs/ that would require entries in tests/integration/test_lists/qa/. These waivers appropriately skip already-defined tests without impacting QA scheduled test coverage.

Based on learnings: In tests/integration/test_lists/waives.txt, both entries correctly use the short nvbug URL format (https://nvbugs/XXXX) for consistency.

Also applies to: 370-370

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@tests/integration/test_lists/waives.txt` at line 354, Update the waivers file
so no QA test list entries are added: keep the skip entries as short nvbug URLs
and ensure both waived tests use that short format; specifically verify and, if
needed, change the entries referencing test_doc.py::test_url_validity (line
shown) and the other waived visual-generation example (also noted) inside
tests/integration/test_lists/waives.txt so they use the https://nvbugs/XXXX
short URL style and do not create entries under
tests/integration/test_lists/qa/.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 370: Update the pytest node-id in waives.txt so the waiver matches the
actual test; replace the standalone "test_wan_t2v_example SKIP
(https://nvbugs/6215688)" entry with the fully-qualified node id
"examples/test_visual_gen.py::test_wan_t2v_example SKIP
(https://nvbugs/6215688)" so it matches the test referenced in test-db and will
be skipped correctly.

---

Nitpick comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 354: Update the waivers file so no QA test list entries are added: keep
the skip entries as short nvbug URLs and ensure both waived tests use that short
format; specifically verify and, if needed, change the entries referencing
test_doc.py::test_url_validity (line shown) and the other waived
visual-generation example (also noted) inside
tests/integration/test_lists/waives.txt so they use the https://nvbugs/XXXX
short URL style and do not create entries under
tests/integration/test_lists/qa/.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 1ad41ab4-358d-4cdd-930b-86d133c1bda3

📥 Commits

Reviewing files that changed from the base of the PR and between 2e3a75c and 1159c0b.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt Outdated
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50193 [ skip ] triggered by Bot. Commit: 1159c0b Link to invocation

@mzweilz

mzweilz commented May 25, 2026

Copy link
Copy Markdown
Collaborator

/bot run --stage-list "A10-Build_Docs"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50193 [ skip ] completed with state SUCCESS. Commit: 1159c0b
Skipping testing for commit 1159c0b

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50194 [ run ] triggered by Bot. Commit: 1159c0b Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50194 [ run ] completed with state FAILURE. Commit: 1159c0b
/LLM/main/L0_MergeRequest_PR pipeline #39734 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@mzweilz

mzweilz commented May 25, 2026

Copy link
Copy Markdown
Collaborator

/bot run --stage-list "A10-Build_Docs"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50203 [ run ] triggered by Bot. Commit: 1159c0b Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50203 [ run ] completed with state FAILURE. Commit: 1159c0b
/LLM/main/L0_MergeRequest_PR pipeline #39742 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Signed-off-by: Abby Wei <18545893+mzweilz@users.noreply.github.com>
@mzweilz

mzweilz commented May 26, 2026

Copy link
Copy Markdown
Collaborator

/bot run --stage-list "A10-Build_Docs"

Signed-off-by: Abby Wei <18545893+mzweilz@users.noreply.github.com>
@mzweilz

mzweilz commented May 26, 2026

Copy link
Copy Markdown
Collaborator

/bot run --stage-list "A10-Build_Docs"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50256 [ run ] triggered by Bot. Commit: d25be1a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50258 [ run ] triggered by Bot. Commit: d25be1a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50256 [ run ] completed with state ABORTED. Commit: d25be1a

Link to invocation

@mzweilz

mzweilz commented May 26, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Check Test List passed, skip other testing."

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50258 [ run ] completed with state SUCCESS. Commit: d25be1a
/LLM/main/L0_MergeRequest_PR pipeline #39792 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50265 [ skip ] triggered by Bot. Commit: d25be1a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #50265 [ skip ] completed with state SUCCESS. Commit: d25be1a
Skipping testing for commit d25be1a

Link to invocation

@mzweilz
mzweilz merged commit b1d23c7 into NVIDIA:main May 26, 2026
7 checks passed
bmarimuthu-nv pushed a commit to nv-auto-deploy/TensorRT-LLM that referenced this pull request May 28, 2026
…A#14526)

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants