Skip to content

[None][test] Waive 15 failed cases for main in QA CI - #15056

Merged
crazydemo merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260607-092105
Jun 8, 2026
Merged

[None][test] Waive 15 failed cases for main in QA CI#15056
crazydemo merged 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:trtllm-ci-report/waive-20260607-092105

Conversation

@tensorrt-cicd

@tensorrt-cicd tensorrt-cicd commented Jun 7, 2026

Copy link
Copy Markdown
Collaborator

Summary by CodeRabbit

  • Tests
    • Updated test waivers for accuracy and deployment testing scenarios.

@coderabbitai

coderabbitai Bot commented Jun 7, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

Updated the test waiver list to add SKIP entries for three additional failing accuracy test cases: expanded autodeploy test waivers for new model variants and added specific waivers for DeepSeek and Step test parameterizations.

Changes

Test waiver list expansion

Layer / File(s) Summary
Test waiver entries for accuracy tests
tests/integration/test_lists/waives.txt
Added SKIP waiver entries: expanded accuracy/test_llm_api_autodeploy.py waivers block with additional model-registry/deployment and accuracy scenarios (including deepseek-ai_DeepSeek-R1-0528 and Nemotron variants); added waiver for TestDeepSeekV32::test_nvfp4_multi_gpus_chunked_prefill[latency]; added waiver for TestStep3_7::test_auto_dtype[tp_size=8-ep_size=8].

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#14896: Updates the same waives.txt file with additional SKIP entries for accuracy/test_llm_api_pytorch.py test cases.
  • NVIDIA/TensorRT-LLM#14259: Modifies waives.txt by adding SKIP entries for failing accuracy/test_llm_api_autodeploy.py test cases.
  • NVIDIA/TensorRT-LLM#14854: Updates waives.txt to add waivers for DeepSeek and model/parameter-specific test scenarios.

Suggested reviewers

  • crazydemo
  • jieli-matrix
  • StanleySun639
  • xinhe-nv
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning No pull request description was provided by the author; the PR relies on auto-generated content and lacks manual documentation of the changes and rationale. Add a pull request description explaining the purpose of the waive entries, the associated bug IDs, and why these test cases need to be waived. Reference the PR template guidelines.
✅ Passed checks (4 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title accurately reflects the main change: adding waive entries for failed test cases, though the number in the title (5) appears to differ from the file changes which indicate more entries.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@crazydemo crazydemo changed the title [None][test] Waive 5 failed cases for main in post-merge [None][test] Waive 5 failed cases for main in QA CI Jun 8, 2026
Signed-off-by: Ivy Zhang <25222398+crazydemo@users.noreply.github.com>
@crazydemo
crazydemo force-pushed the trtllm-ci-report/waive-20260607-092105 branch from 7c0462c to 4d6d26e Compare June 8, 2026 07:14
@crazydemo crazydemo changed the title [None][test] Waive 5 failed cases for main in QA CI [None][test] Waive 15 failed cases for main in QA CI Jun 8, 2026
@crazydemo
crazydemo enabled auto-merge (squash) June 8, 2026 07:15
@crazydemo

Copy link
Copy Markdown
Collaborator

/bot run --skip-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #52699 [ run ] triggered by Bot. Commit: 4d6d26e Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #52699 [ run ] completed with state FAILURE. Commit: 4d6d26e
/LLM/main/L0_MergeRequest_PR pipeline #41963 (Partly Tested) completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@crazydemo

Copy link
Copy Markdown
Collaborator

/bot skip --comment "skip CI as check test list has passed"

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #52718 [ skip ] triggered by Bot. Commit: 4d6d26e Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator Author

PR_Github #52718 [ skip ] completed with state SUCCESS. Commit: 4d6d26e
Skipping testing for commit 4d6d26e

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants