Skip to content

[None][test] Waive 2 failed cases for main in QA CI on H100 - #14001

Merged
xinhe-nv merged 7 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260511-145911
May 12, 2026
Merged

[None][test] Waive 2 failed cases for main in QA CI on H100#14001
xinhe-nv merged 7 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260511-145911

Conversation

@xinhe-nv

@xinhe-nv xinhe-nv commented May 11, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1415/
Bug(s): 6162326, 6162618, 6164924

Waive entries added

accuracy/test_disaggregated_serving.py::TestLlama3_1_8BInstruct::test_ctx_pp_gen_tp_asymmetric[GSM8K-gen_tp=2-ctx_pp=2] SKIP (https://nvbugs/6162326)
accuracy/test_llm_api_pytorch.py::TestEXAONE4::test_auto_dtype SKIP (https://nvbugs/6164924)

Already waived (skipped)

  • accuracy/test_llm_api_pytorch.py::TestMiniMaxM2::test_4gpus[attention_dp=False-cuda_graph=True-overlap_scheduler=True-tp_size=4-ep_size=4]

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test waiver list to manage specific test scenario expectations across model evaluation modules.

Review Change Stack

Bug(s): 6162326, 6162618, 6164924
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1415/

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Xin He (SW-GPU) <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
xinhe-nv marked this pull request as ready for review May 12, 2026 06:16
@xinhe-nv
xinhe-nv enabled auto-merge (squash) May 12, 2026 06:16
@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot run --skip-test

@coderabbitai

coderabbitai Bot commented May 12, 2026

Copy link
Copy Markdown
Contributor
📝 Walkthrough

Walkthrough

This PR adds two test skip waivers to the integration test configuration. Two previously failing test cases are marked as SKIP: one in disaggregated serving tests and one in LLM API PyTorch tests, each with associated NV bug references.

Changes

Test Skip Waivers

Layer / File(s) Summary
Test Skip Waivers
tests/integration/test_lists/waives.txt
Two new SKIP waiver entries are added: accuracy/test_disaggregated_serving.py::TestLlama3_1_8BInstruct::test_ctx_pp_gen_tp_asymmetric[...] and accuracy/test_llm_api_pytorch.py::TestEXAONE4::test_auto_dtype, each with associated NV bug documentation links.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

Suggested reviewers

  • jieli-matrix
  • StanleySun639
  • crazydemo
  • LarryXFly
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 inconclusive)

Check name Status Explanation Resolution
Description check ❓ Inconclusive The description does not follow the required template structure with sections like Description, Test Coverage, and PR Checklist, but it provides essential auto-generated context with bug IDs, waive entries, and the Jenkins build link. While the auto-generated content is informative, consider adding a brief Description section explaining the purpose of waivers and a PR Checklist confirmation to fully align with the repository template.
✅ Passed checks (4 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title '[None][test] Waive 2 failed cases for main in QA CI on H100' accurately and specifically summarizes the main change: adding 2 test waivers to the waives.txt file for the main branch QA CI.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47906 [ run ] triggered by Bot. Commit: 47a476d Link to invocation

Signed-off-by: Xin He (SW-GPU) <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
xinhe-nv force-pushed the trtllm-ci-report/waive-20260511-145911 branch from 4ff6c2e to 6cbec88 Compare May 12, 2026 06:34
xinhe-nv added 2 commits May 12, 2026 14:35
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv xinhe-nv changed the title [None][test] Waive 2 failed cases for main in QA CI [None][test] Waive 2 failed cases for main in QA CI on H100 May 12, 2026
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47906 [ run ] completed with state SUCCESS. Commit: 47a476d
/LLM/main/L0_MergeRequest_PR pipeline #37754 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47942 [ reuse-pipeline ] triggered by Bot. Commit: db3c0db Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47946 [ reuse-pipeline ] triggered by Bot. Commit: db3c0db Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47942 [ reuse-pipeline ] completed with state ABORTED. Commit: db3c0db
Can't reuse PR_Github #0 with status: UNKNOWN

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #47946 [ reuse-pipeline ] completed with state SUCCESS. Commit: db3c0db
Reusing PR_Github #47906 (Partly Tested) for commit db3c0db

Link to invocation

@xinhe-nv
xinhe-nv merged commit 971eacb into NVIDIA:main May 12, 2026
6 checks passed
@xinhe-nv
xinhe-nv deleted the trtllm-ci-report/waive-20260511-145911 branch May 12, 2026 08:52
yufeiwu-nv pushed a commit to yufeiwu-nv/TensorRT-LLM that referenced this pull request May 19, 2026
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Xin He (SW-GPU) <200704525+xinhe-nv@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants