Skip to content

[None][test] Waive 5 failed cases for main in QA CI#15360

Merged
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260615-032134
Jun 19, 2026
Merged

[None][test] Waive 5 failed cases for main in QA CI#15360
jieli-matrix merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260615-032134

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1537/
Bug(s): 6322071, 6322073, 6322076

Waive entries added

full:B300/accuracy/test_disaggregated_serving.py::TestLlama3_1_8BInstruct::test_auto_dtype[False-False-False-False] SKIP (https://nvbugs/6322071)
full:B300/disaggregated/test_disaggregated.py::test_disaggregated_ctxpp2_genpp2[TinyLlama-1.1B-Chat-v1.0] SKIP (https://nvbugs/6322073)
full:B300/accuracy/test_llm_api_pytorch.py::TestKimiK25::test_nvfp4[ep8] SKIP (https://nvbugs/6322076)
full:B300/accuracy/test_disaggregated_serving.py::TestDeepSeekV3Lite::test_auto_dtype_with_helix[fifo_v1-cudagraph:with_padding-pp1dp2cp2] SKIP (https://nvbugs/6322076)
full:B300/accuracy/test_llm_api_pytorch.py::TestDeepSeekV3Lite::test_fp8_block_scales_4gpus[tp2pp2-mtp_nextn=0-fp8kv=False-attention_dp=False-cuda_graph=True-overlap_scheduler=False-torch_compile=False-sampler_async_worker=False] SKIP (https://nvbugs/6322076)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Added waivers for five accuracy and performance evaluation test cases addressing identified technical issues. These tests are temporarily inactive pending resolution of tracked issues.

@jieli-matrix
jieli-matrix marked this pull request as ready for review June 15, 2026 09:01
@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from fd6a707 to f1bf71b Compare June 15, 2026 09:01
@jieli-matrix
jieli-matrix enabled auto-merge (squash) June 15, 2026 09:02
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@coderabbitai

coderabbitai Bot commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 28fe0bdb-31b2-4a8c-b13c-2f99da22e9ae

📥 Commits

Reviewing files that changed from the base of the PR and between 870f9b5 and f1bf71b.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Five new SKIP waiver entries are appended to tests/integration/test_lists/waives.txt, targeting full:B300/... accuracy and disaggregated test cases for DeepSeekV3Lite (auto dtype, fp8 block scales), KimiK25 (nvfp4), and TinyLlama (ctxpp2/genpp2 disaggregated). Each entry references a corresponding nvbugs ID.

Changes

B300 Test Waivers

Layer / File(s) Summary
New B300 SKIP waiver entries
tests/integration/test_lists/waives.txt
Appends five full:B300/... SKIP waiver lines for DeepSeekV3Lite auto dtype, DeepSeekV3Lite fp8 block scales, KimiK25 nvfp4, and TinyLlama ctxpp2/genpp2 disaggregated tests, each tied to an nvbugs reference.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#15269: Modifies the same waives.txt file with SKIP/waive entries for full:B300/... disaggregated cases.
  • NVIDIA/TensorRT-LLM#15358: Adds new SKIP waiver entries to waives.txt tied to nvbugs references, directly parallel to this PR.
  • NVIDIA/TensorRT-LLM#15326: Adds SKIP waiver entries to waives.txt for failing accuracy tests including DeepSeekV3Lite cases.

Suggested reviewers

  • crazydemo
  • jieli-matrix
  • StanleySun639
  • LarryXFly
  • xinhe-nv
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title '[None][test] Waive 5 failed cases for main in QA CI' clearly and concisely describes the main change: adding waived test entries for failed QA CI cases.
Description check ✅ Passed The PR description is comprehensive and well-structured, clearly explaining the auto-generated waive entries with associated bug references, Jenkins build link, and specific test cases being waived.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54272 [ run ] triggered by Bot. Commit: f1bf71b Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54272 [ run ] completed with state SUCCESS. Commit: f1bf71b
/LLM/main/L0_MergeRequest_PR pipeline #43345 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from f1bf71b to 80ad35a Compare June 16, 2026 01:48
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54408 [ run ] triggered by Bot. Commit: 80ad35a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54408 [ run ] completed with state FAILURE. Commit: 80ad35a
/LLM/main/L0_MergeRequest_PR pipeline #43474 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from 80ad35a to 6b6538c Compare June 16, 2026 06:31
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54508 [ run ] triggered by Bot. Commit: 6b6538c Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54508 [ run ] completed with state SUCCESS. Commit: 6b6538c
/LLM/main/L0_MergeRequest_PR pipeline #43567 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from 6b6538c to b231777 Compare June 17, 2026 02:23
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54713 [ run ] triggered by Bot. Commit: b231777 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54713 [ run ] completed with state FAILURE. Commit: b231777
/LLM/main/L0_MergeRequest_PR pipeline #43740 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from b231777 to c0d5d60 Compare June 18, 2026 07:00
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54912 [ run ] triggered by Bot. Commit: c0d5d60 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54912 [ run ] completed with state SUCCESS. Commit: c0d5d60
/LLM/main/L0_MergeRequest_PR pipeline #43915 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from c0d5d60 to 26a8a67 Compare June 19, 2026 06:25
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot run --stage-list ""

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54963 [ run ] triggered by Bot. Commit: 26a8a67 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54963 [ run ] completed with state SUCCESS. Commit: 26a8a67
/LLM/main/L0_MergeRequest_PR pipeline #43963 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from 26a8a67 to 7cd953c Compare June 19, 2026 12:47
Bug(s): 6322071, 6322073, 6322076
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_CLUSTER_TEST/1537/

Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
@jieli-matrix
jieli-matrix force-pushed the trtllm-ci-report/waive-20260615-032134 branch from 7cd953c to d7338ef Compare June 19, 2026 13:57
@jieli-matrix

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Only waive tests"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54971 [ skip ] triggered by Bot. Commit: d7338ef Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #54971 [ skip ] completed with state SUCCESS. Commit: d7338ef
Skipping testing for commit d7338ef

Link to invocation

@jieli-matrix
jieli-matrix merged commit b9b132b into NVIDIA:main Jun 19, 2026
7 checks passed
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 23, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 24, 2026
Signed-off-by: tensorrt-cicd <90828364+tensorrt-cicd@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants