Skip to content

[None][test] Waive 1 failed cases for main in QA CI#14332

Merged
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260520-044102
May 20, 2026
Merged

[None][test] Waive 1 failed cases for main in QA CI#14332
crazydemo merged 1 commit into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260520-044102

Conversation

@xinhe-nv

@xinhe-nv xinhe-nv commented May 20, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6193778

Waive entries added

accuracy/test_llm_api_pytorch.py::TestDeepSeekR1LongBenchV2::test_fp8_8gpus SKIP (https://nvbugs/6193778)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test configuration to skip a specific performance test pending issue resolution.

Review Change Stack

Bug(s): 6193778
Requested by: qa@nvidia.com

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@crazydemo crazydemo changed the title [None][infra] Waive 1 failed cases for main in post-merge [None][test] Waive 1 failed cases for main in QA CI May 20, 2026
@crazydemo

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai

coderabbitai Bot commented May 20, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 94f45042-e3e0-41b3-994d-8b933c904cc5

📥 Commits

Reviewing files that changed from the base of the PR and between fb06a2f and f31224f.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

A single-line waiver entry is added to the integration test waiver list for the TestDeepSeekR1LongBenchV2::test_fp8_8gpus test case, marking it as skipped and associating it with nvbugs/6193778.

Changes

Test Waiver Addition

Layer / File(s) Summary
Add test waiver for DeepSeekR1 FP8 test
tests/integration/test_lists/waives.txt
A SKIP waiver entry is added for TestDeepSeekR1LongBenchV2::test_fp8_8gpus with reference to nvbugs/6193778.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~1 minute

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14283: Adds a waiver entry for accuracy/test_llm_api_pytorch.py::TestDeepSeekR1LongBenchV2::test_fp8_8gpus to the same waiver file.
  • NVIDIA/TensorRT-LLM#14221: Modifies tests/integration/test_lists/waives.txt with new SKIP entries for failing DeepSeek-related tests.
  • NVIDIA/TensorRT-LLM#13335: Adds skipped test waiver entries for accuracy/test_llm_api_pytorch.py cases to the same waiver file.

Suggested reviewers

  • jieli-matrix
  • StanleySun639
  • crazydemo
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly summarizes the main change: adding a waiver for a failed test case in the main branch CI, which matches the changeset that adds one waive entry to the test_lists/waives.txt file.
Description check ✅ Passed The PR description is auto-generated with clear structure, listing the bug reference and specific waive entry, but lacks sections from the template like explicit 'Description' and 'Test Coverage' sections, though the content covers the essential information for this auto-generated waive PR.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49332 [ run ] triggered by Bot. Commit: f31224f Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49332 [ run ] completed with state SUCCESS. Commit: f31224f
/LLM/main/L0_MergeRequest_PR pipeline #38989 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@crazydemo
crazydemo enabled auto-merge (squash) May 20, 2026 07:05
@crazydemo

Copy link
Copy Markdown
Collaborator

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49383 [ reuse-pipeline ] triggered by Bot. Commit: f31224f Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #49383 [ reuse-pipeline ] completed with state SUCCESS. Commit: f31224f
Reusing PR_Github #49332 (Partly Tested) for commit f31224f

Link to invocation

@crazydemo
crazydemo merged commit c72d43d into NVIDIA:main May 20, 2026
15 checks passed
xxi-nv pushed a commit to xxi-nv/TensorRT-LLM that referenced this pull request May 22, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260520-044102 branch May 27, 2026 13:32
bmarimuthu-nv pushed a commit to nv-auto-deploy/TensorRT-LLM that referenced this pull request May 28, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants