Skip to content

[None][test] Waive 2 failed cases for main in QA CI - #14086

Merged
xinhe-nv merged 6 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260513-081124
May 14, 2026
Merged

[None][test] Waive 2 failed cases for main in QA CI#14086
xinhe-nv merged 6 commits into
NVIDIA:mainfrom
xinhe-nv:trtllm-ci-report/waive-20260513-081124

Conversation

@xinhe-nv

@xinhe-nv xinhe-nv commented May 13, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by qa@nvidia.com)
Target branch: main
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_TEST/2166/
Bug(s): 6162120, 6171743

Waive entries added

accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_nvfp4_multi_gpus_sm120[throughput_tp8] SKIP (https://nvbugs/6171743)
accuracy/test_llm_api_pytorch.py::TestLlama3_1_8BInstruct::test_guided_decoding_4gpus[xgrammar] SKIP (https://nvbugs/6162120)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

Release Notes

  • Tests
    • Updated internal test waiver configurations.

Note: This release contains only internal infrastructure updates with no user-facing changes.

Review Change Stack

@xinhe-nv
xinhe-nv marked this pull request as ready for review May 13, 2026 08:22
@xinhe-nv
xinhe-nv enabled auto-merge (squash) May 13, 2026 08:22
@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot run --skip-test

@coderabbitai

coderabbitai Bot commented May 13, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 02604a64-1479-4f91-ac65-02d3679c74c1

📥 Commits

Reviewing files that changed from the base of the PR and between 7ced42a and 7d7f622.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

Two failing integration tests are added to the test waiver list: one for DeepSeekR1 multi-GPU throughput testing with tensor parallelism, and one for Llama 3.1 guided decoding with xgrammar, each with an associated NVBUG tracker reference.

Changes

Test Waiver Updates

Layer / File(s) Summary
Add waived test cases
tests/integration/test_lists/waives.txt
Two new SKIP entries added for TestDeepSeekR1::test_nvfp4_multi_gpus_sm120[throughput_tp8] and TestLlama3_1_8BInstruct::test_guided_decoding_4gpus[xgrammar], each with an NVBUG link for tracking the underlying issue.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

Suggested reviewers

  • crazydemo
  • jieli-matrix
  • StanleySun639
  • LarryXFly
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning Description lacks required sections from template (Description and Test Coverage) and PR Checklist, though it provides waive details. Add the Description and Test Coverage sections explaining the waives, and include the PR Checklist as required by the template.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title accurately describes the main change: waiving 2 failed test cases for CI.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

  • Generate code and open pull requests
  • Plan features and break down work
  • Investigate incidents and troubleshoot customer tickets together
  • Automate recurring tasks and respond to alerts with triggers
  • Summarize progress and report instantly

Built for teams:

  • Shared memory across your entire org—no repeating context
  • Per-thread sandboxes to safely plan and execute work
  • Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started


Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48150 [ run ] triggered by Bot. Commit: 7d7f622 Link to invocation

xinhe-nv added 3 commits May 13, 2026 17:07
Bug(s): 6162120, 6171743
Requested by: qa@nvidia.com
Jenkins build: https://prod.blsm.nvidia.com/swqa-tensorrt-qa-test/job/LLM_FUNCTION_TEST/2166/

Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: xinhe-nv <200704525+xinhe-nv@users.noreply.github.com>
Signed-off-by: Xin He (SW-GPU) <200704525+xinhe-nv@users.noreply.github.com>
@xinhe-nv
xinhe-nv force-pushed the trtllm-ci-report/waive-20260513-081124 branch from ddc47bd to dd9eca9 Compare May 13, 2026 09:07
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48150 [ run ] completed with state SUCCESS. Commit: 7d7f622
/LLM/main/L0_MergeRequest_PR pipeline #37972 (Partly Tested) completed with status: 'SUCCESS'

CI Report

Link to invocation

@xinhe-nv

Copy link
Copy Markdown
Collaborator Author

/bot reuse-pipeline

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48265 [ reuse-pipeline ] triggered by Bot. Commit: 5d5341b Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #48265 [ reuse-pipeline ] completed with state SUCCESS. Commit: 5d5341b
Reusing PR_Github #48150 (Partly Tested) for commit 5d5341b

Link to invocation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants