Skip to content

[None][infra] Waive 3 failed cases for main in post-merge 2836 - #16356

Merged
mzweilz merged 2 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260714-042739
Jul 14, 2026
Merged

[None][infra] Waive 3 failed cases for main in post-merge 2836#16356
mzweilz merged 2 commits into
NVIDIA:mainfrom
trtllm-agent:trtllm-ci-report/waive-20260714-042739

Conversation

@trtllm-agent

@trtllm-agent trtllm-agent commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @mzweilz)
Target branch: main
Bug(s): 6450333, 6450338, 6450341

Waive entries added

accuracy/test_llm_api_autodeploy.py::TestNemotronSuperV3::test_mtp[nvfp4_ws8_80gb-trtllm] SKIP (https://nvbugs/6450341)
accuracy/test_llm_api_pytorch.py::TestDeepSeekV4Flash::test_auto_dtype SKIP (https://nvbugs/6450333)
accuracy/test_llm_api_pytorch.py::TestGPTOSS::test_w4_4gpus[v1_kv_cache-ep4-trtllm-fp8] SKIP (https://nvbugs/6450338)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added waivers for several known failing or blocked accuracy and deployment test cases.
    • Expanded existing waivers to cover an additional model configuration and test variant.

Bug(s): 6450333, 6450338, 6450341
Requested by: @mzweilz

Signed-off-by: trtllm-agent <296075020+trtllm-agent@users.noreply.github.com>
@mzweilz
mzweilz enabled auto-merge (squash) July 14, 2026 04:28
@mzweilz

mzweilz commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive only"

@coderabbitai

coderabbitai Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

The integration waiver list adds SKIP entries for one Nemotron MTP configuration, DeepSeek auto-dtype testing, and an additional GPTOSS four-GPU variant.

Changes

Accuracy test waiver updates

Layer / File(s) Summary
Add accuracy test waivers
tests/integration/test_lists/waives.txt
Adds SKIP entries for the Nemotron MTP, DeepSeek auto-dtype, and GPTOSS v1_kv_cache-ep4-trtllm-fp8 configurations.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

Suggested reviewers: dongxuy04, pcastonguay, yuxianq

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description lists the waived cases, but it omits the template's required Description, Test Coverage, and PR Checklist sections. Add the missing template sections with a brief issue summary, test coverage details, and the PR checklist item.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: waiving three failed post-merge test cases on main.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/test_lists/waives.txt`:
- Line 28: Add the repository-required NVIDIA copyright header at the top of
tests/integration/test_lists/waives.txt and update its copyright year as
required. Preserve the existing waiver entries unchanged.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 738a25d5-9506-49de-9a82-395c46581435

📥 Commits

Reviewing files that changed from the base of the PR and between 7d7c364 and 5dccf35.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

Comment thread tests/integration/test_lists/waives.txt
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59098 [ skip ] triggered by Bot. Commit: 5dccf35 Link to invocation

… test files

Signed-off-by: Yanchao Lu <yanchaol@nvidia.com>
@chzblych
chzblych requested review from a team as code owners July 14, 2026 04:38
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59098 [ skip ] completed with state SUCCESS. Commit: 5dccf35
Skipping testing for commit 5dccf35

Link to invocation

@mzweilz

mzweilz commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "waive only"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59100 [ skip ] triggered by Bot. Commit: 2804638 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59100 [ skip ] completed with state SUCCESS. Commit: 2804638
Skipping testing for commit 2804638

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants