Skip to content

[None][test] unwaive cases for main in QA CI - #13991

Merged
xinhe-nv merged 13 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260511-091954
May 12, 2026
Merged

[None][test] unwaive cases for main in QA CI#13991
xinhe-nv merged 13 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260511-091954

Conversation

@xinhe-nv

@xinhe-nv xinhe-nv commented May 11, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_TEST/2162/
Bug(s): 6162122

Waive entries added

accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_guided_decoding_4gpus[xgrammar-mtp_nextn=0] SKIP (https://nvbugs/6162122)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added test waiver for a guided decoding test scenario.

Review Change Stack

Bug(s): 6162122
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_TEST/2162/

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
xinhe-nv added 2 commits May 12, 2026 13:24
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
xinhe-nv marked this pull request as ready for review May 12, 2026 05:27
@xinhe-nv
xinhe-nv enabled auto-merge (squash) May 12, 2026 05:27
@coderabbitai

coderabbitai Bot commented May 12, 2026

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

A single waiver entry was added to the test skip list for a DeepSeekV3Lite guided decoding test case executing on 4 GPUs with xgrammar-mtp_nextn=0 parameter, referencing an NVBug issue.

Changes

Test Waiver Configuration

Layer / File(s) Summary
DeepSeekV3Lite Guided Decoding Waiver
tests/integration/test_lists/waives.txt
SKIP waiver added for TestDeepSeekV3Lite::test_guided_decoding_4gpus[xgrammar-mtp_nextn=0] test case with NVBug reference.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

Suggested reviewers

  • jieli-matrix
  • StanleySun639
🚥 Pre-merge checks | ✅ 3 | ❌ 2

❌ Failed checks (1 warning, 1 inconclusive)

Check name Status Explanation Resolution
Title check ⚠️ Warning The PR title states 'unwaive cases' but the changeset actually adds a waiver entry, which contradicts the stated objective. Correct the title to accurately reflect that the PR waives (not unwaives) a failed test case, e.g., '[None][test] Waive 1 failed case for main in QA CI'.
Description check ❓ Inconclusive The description is auto-generated and provides essential context (bug reference, Jenkins build link, waive entries), but lacks the structured sections required by the template (Description, Test Coverage, PR Checklist). While the auto-generated format differs from the template, clarify whether auto-generated waive PRs should follow the standard template or if this format is acceptable for this PR type.
✅ Passed checks (3 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot run --skip-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47889 [ run ] triggered by Bot. Commit: 5c033d8 Link to invocation

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot run --skip-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47903 [ run ] triggered by Bot. Commit: 0f4bd79 Link to invocation

Removed skipped test cases related to fp8 configurations.

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv xinhe-nv changed the title [None][test] Waive 1 failed cases for main in QA CI [None][test] unwaive cases for main in QA CI May 12, 2026
@xinhe-nv
xinhe-nv requested a review from dominicshanshan May 12, 2026 06:23
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47903 [ run ] completed with state SUCCESS. Commit: 0f4bd79
/LLM/main/L0_MergeRequest_PR pipeline #37753 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

xinhe-nv added 2 commits May 12, 2026 16:24
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47944 [ reuse-pipeline ] triggered by Bot. Commit: 3f0d6c6 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47945 [ reuse-pipeline ] triggered by Bot. Commit: 3f0d6c6 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47944 [ reuse-pipeline ] completed with state ABORTED. Commit: 3f0d6c6
Can't reuse PR_Github #0 with status: UNKNOWN

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47945 [ reuse-pipeline ] completed with state SUCCESS. Commit: 3f0d6c6
Reusing PR_Github #47903 (Partly Tested) for commit 3f0d6c6

Link to invocation

@xinhe-nv
xinhe-nv merged commit 27c143d into NVIDIA:main May 12, 2026
6 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260511-091954 branch May 12, 2026 08:53
yufeiwu-nv pushed a commit to yufeiwu-nv/TensorRT-LLM that referenced this pull request May 19, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants