Skip to content

[None][infra] Waive 18 failed cases for main in pre-merge 43878 - #15469

Merged
2ez4bz merged 1 commit into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260618-004342
Jun 18, 2026
Merged

[None][infra] Waive 18 failed cases for main in pre-merge 43878#15469
2ez4bz merged 1 commit into
NVIDIA:mainfrom
ZhanruiSunCh:trtllm-ci-report/waive-20260618-004342

Conversation

@ZhanruiSunCh

@ZhanruiSunCh ZhanruiSunCh commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator

Auto-generated Waive PR

Created by: TensorRT LLM CI Report (requested by @2ez4bz)
Target branch: main
Bug(s): 6340115

Waive entries added

llmapi/test_llm_api_pytorch_bart.py::test_bart_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-beam2-bart-large-cnn] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_bart.py::test_bart_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-greedy-bart-large-cnn] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_bart.py::test_bart_pytorch_generate_encoder_decoder_end_to_end[fp16-kv-v1-cuda-graph-off-greedy-bart-large-cnn] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_bart.py::test_bart_pytorch_generate_encoder_decoder_mixed_encoder_lengths_batch[bf16-kv-v2-cuda-graph-off-greedy-batch2-bart-large-cnn] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-beam2-flan-t5-xl] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-beam2-t5-base] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-beam2-t5-small0] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-off-greedy-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v2-cuda-graph-off-greedy-flan-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v2-cuda-graph-off-greedy-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[fp16-kv-v1-cuda-graph-off-beam2-flan-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[fp16-kv-v2-cuda-graph-off-greedy-flan-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[fp32-kv-v1-cuda-graph-off-beam2-flan-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[fp32-kv-v1-cuda-graph-off-beam2-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_end_to_end[fp32-kv-v2-cuda-graph-off-greedy-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_mixed_encoder_lengths_batch[bf16-kv-v1-cuda-graph-off-beam2-batch2-flan-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_mixed_encoder_lengths_batch[bf16-kv-v1-cuda-graph-off-beam2-batch2-t5-small] SKIP (https://nvbugs/6340115)
llmapi/test_llm_api_pytorch_t5.py::test_t5_pytorch_generate_encoder_decoder_mixed_encoder_lengths_batch[bf16-kv-v2-cuda-graph-off-greedy-batch2-t5-small] SKIP (https://nvbugs/6340115)

This PR was auto-generated by TensorRT LLM CI Report. Please review the waive entries before merging.

Summary by CodeRabbit

  • Tests
    • Updated test waivers for BART and T5 model encoder-decoder end-to-end tests.

Bug(s): 6340115
Requested by: @2ez4bz

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
@2ez4bz
2ez4bz enabled auto-merge (squash) June 18, 2026 00:44
@2ez4bz

2ez4bz commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator

/bot skip --comment "Broken test on main"

@coderabbitai

coderabbitai Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: a271e3a3-1564-4bac-afb6-706918c06789

📥 Commits

Reviewing files that changed from the base of the PR and between 9e69568 and 1e2bc22.

📒 Files selected for processing (1)
  • tests/integration/test_lists/waives.txt

📝 Walkthrough

Walkthrough

18 new SKIP waiver entries are added to tests/integration/test_lists/waives.txt for BART and T5 PyTorch encoder-decoder end-to-end integration tests, including beam/greedy decoding and mixed encoder length variants. All entries reference nvbugs/6340115.

Changes

BART/T5 Encoder-Decoder Test Waivers

Layer / File(s) Summary
SKIP waivers for BART/T5 encoder-decoder tests
tests/integration/test_lists/waives.txt
Adds 18 SKIP waiver lines for BART and T5 PyTorch encoder-decoder generation tests (beam/greedy decoding, mixed encoder lengths variants), all citing nvbugs/6340115.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

  • NVIDIA/TensorRT-LLM#15377: Adds SKIP waiver entries for BART/T5 PyTorch end-to-end tests in the same waives file, directly overlapping in scope with this PR.
  • NVIDIA/TensorRT-LLM#15450: Modifies the same waives.txt file by adding additional SKIP entries for failing integration tests.
  • NVIDIA/TensorRT-LLM#15395: Also adds new SKIP/waiver entries to waives.txt to suppress failing CI integration test cases.

Suggested reviewers

  • 2ez4bz
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Title check ✅ Passed The title '[None][infra] Waive 18 failed cases for main in pre-merge 43878' is specific and clearly describes the main change: adding test waivers for 18 failed test cases in a specific pre-merge run.
Description check ✅ Passed The description provides clear context about the auto-generated waive PR, lists all 18 waived test entries, identifies the associated bug (6340115), and explains the PR objective without following the optional template sections.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54890 [ skip ] triggered by Bot. Commit: 1e2bc22 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54890 [ skip ] completed with state SUCCESS. Commit: 1e2bc22
Skipping testing for commit 1e2bc22

Link to invocation

@2ez4bz
2ez4bz merged commit 79ea125 into NVIDIA:main Jun 18, 2026
12 checks passed
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 23, 2026
…IA#15469)

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 24, 2026
…IA#15469)

Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants