Skip to content

[None][test] Waive 5 failed cases for main in post-merge - #15392

Merged
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260616-031339
Jun 19, 2026
Merged

[None][test] Waive 5 failed cases for main in post-merge#15392
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260616-031339

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented Jun 16, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Bug(s): 6274932, 6329216

Waive entries added

full:H100/accuracy/test_llm_api_pytorch.py::TestQwen3_5_35B_A3B::test_bf16_mtp[mtp_off] SKIP (https://nvbugs/6329216)
full:H100/accuracy/test_llm_api_pytorch_multimodal.py::TestStep3_7::test_fp8_block_scales[mtp_nextn=0] SKIP (https://nvbugs/6274932)
full:H100/accuracy/test_llm_api_pytorch.py::TestStep3_7::test_fp8_block_scales[tp_size=4-ep_size=4-mtp_nextn=0] SKIP (https://nvbugs/6274932)
full:H100/accuracy/test_llm_api_pytorch_multimodal.py::TestStep3_7::test_fp8_block_scales[mtp_nextn=3] SKIP (https://nvbugs/6274932)
full:H100/accuracy/test_llm_api_pytorch.py::TestStep3_7::test_fp8_block_scales[tp_size=4-ep_size=4-mtp_nextn=3] SKIP (https://nvbugs/6274932)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test waiver configurations to accommodate new test scenarios and parameter combinations.

@jieli-matrix
jieli-matrix enabled auto-merge (squash) June 16, 2026 03:14
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai

coderabbitai Bot commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: be8a8c0a-4ceb-484c-908a-c61aeb91ee51

📥 Commits

Reviewing files that changed from the base of the PR and between f49d09f and b6bebed.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

The H100 waivers section in tests/integration/test_lists/waives.txt is updated: the existing TestQwen3_6_27B::test_fp8 waiver is removed, and five new H100 waiver entries are added covering TestQwen3_5_35B_A3B::test_bf16_mtp[mtp_off] and several TestStep3_7/TestStep3_7 multimodal test_fp8_block_scales configurations with specific tp_size, ep_size, and mtp_nextn parameter variants.

Changes

H100 Waiver List Update

Layer / File(s) Summary
H100 waiver entry replacement
tests/integration/test_lists/waives.txt
Removes the TestQwen3_6_27B::test_fp8 H100 waiver and adds new waivers for TestQwen3_5_35B_A3B::test_bf16_mtp[mtp_off] and multiple TestStep3_7/TestStep3_7 multimodal test_fp8_block_scales variants across specified tp_size/ep_size and mtp_nextn combinations.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

Suggested reviewers

  • crazydemo
  • jieli-matrix
  • StanleySun639
  • LarryXFly
  • xinhe-nv
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description lacks required sections from the template (Description, Test Coverage, PR Checklist) and does not clearly explain the issue/solution, though it does document the auto-generated waiver entries. Add Description and Test Coverage sections explaining why these tests are being waived, and complete the PR Checklist confirming review of relevant criteria.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly describes the PR's purpose: waiving 5 failed test cases for the main branch in post-merge.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54445 [ run ] triggered by Bot. Commit: b6bebed Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54445 [ run ] completed with state FAILURE. Commit: b6bebed
/LLM/main/L0_MergeRequest_PR pipeline #43508 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260616-031339 branch from b6bebed to 69aaac0 Compare June 16, 2026 06:28
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54503 [ run ] triggered by Bot. Commit: 69aaac0 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54503 [ run ] completed with state SUCCESS. Commit: 69aaac0
/LLM/main/L0_MergeRequest_PR pipeline #43563 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260616-031339 branch from 69aaac0 to a3e31fe Compare June 17, 2026 02:23
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54712 [ run ] triggered by Bot. Commit: a3e31fe Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54712 [ run ] completed with state FAILURE. Commit: a3e31fe
/LLM/main/L0_MergeRequest_PR pipeline #43739 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260616-031339 branch from a3e31fe to fdfd641 Compare June 18, 2026 07:01
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54913 [ run ] triggered by Bot. Commit: fdfd641 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54913 [ run ] completed with state SUCCESS. Commit: fdfd641
/LLM/main/L0_MergeRequest_PR pipeline #43916 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54965 [ run ] triggered by Bot. Commit: a9f30a2 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54965 [ run ] completed with state SUCCESS. Commit: a9f30a2
/LLM/main/L0_MergeRequest_PR pipeline #43965 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

Bug(s): 6274932, 6329216
Requested by: qa@nvidia.com

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260616-031339 branch from a9f30a2 to 881544e Compare June 19, 2026 12:47
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Only waive tests"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54969 [ skip ] triggered by Bot. Commit: 881544e Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54969 [ skip ] completed with state SUCCESS. Commit: 881544e
Skipping testing for commit 881544e

Link to invocation

@jieli-matrix
jieli-matrix merged commit 30c40dc into NVIDIA:main Jun 19, 2026
7 checks passed
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 23, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 24, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants