[https://nvbugs/6273850][test] used to debug v2c bot

[xinhe-nv]

Summary by CodeRabbit

• Chores
  • Updated test configuration by removing test skip waivers for specific GPU configurations. This enables previously disabled performance quantization tests to be evaluated in the test suite.

Description

Test Coverage

PR Checklist

Please review the following before submitting your PR:

• PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.

• PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.

• Test cases are provided for new code paths (see test instructions)

• If PR introduces API changes, an appropriate PR label is added - either api-compatible or api-breaking. For api-breaking, include BREAKING in the PR title.

• Any new dependencies have been scanned for license and vulnerabilities

• CODEOWNERS updated if ownership changes

• Documentation updated as needed

• Update tava architecture diagram if there is a significant design change in PR.

• The reviewers assigned automatically/manually are appropriate for the PR.

• Please check this after reviewing the above items as appropriate for this PR.

GitHub Bot Help

To see a list of available CI bot commands, please comment /bot help.

[coderabbitai]

📝 Walkthrough

Walkthrough

This PR removes test skip waivers for RTX, RTXPro6000D, and RTX_PRO_6000_Blackwell_Server_Edition test configurations from the waives.txt test list file. The removal reactivates these previously skipped test cases.

Changes

RTX GPU Test Waivers Cleanup

Layer / File(s)	Summary
Remove RTX GPU test skip entries tests/integration/test_lists/waives.txt	Deleted waiver entries that skipped multiple RTX and RTX_PRO_6000_Blackwell_Server_Edition test/perf quant configurations, removing their associated nvbugs references.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

• NVIDIA/TensorRT-LLM#14946: Modifies tests/integration/test_lists/waives.txt by changing waived/skipped entries and their NVBug references.
• NVIDIA/TensorRT-LLM#14839: Changes waiver entries in tests/integration/test_lists/waives.txt by adding/removing SKIP entries for specific test cases.
• NVIDIA/TensorRT-LLM#15058: Edits tests/integration/test_lists/waives.txt to remove/adjust waiver entries, re-enabling specific tests.

Suggested reviewers

• LarryXFly
• crazydemo

🚥 Pre-merge checks | ✅ 3 | ❌ 2

❌ Failed checks (2 warnings)

Check name	Status	Explanation	Resolution
Description check	⚠️ Warning	The PR description is entirely composed of the template structure with no actual content filled in for Description or Test Coverage sections.	Complete the Description section explaining why these waive entries were removed and the Test Coverage section identifying relevant tests affected by this change.
Title check	⚠️ Warning	The title references debugging a v2c bot with an nvbugs ticket, but the actual changeset only removes waiver entries from a test configuration file with no apparent connection to v2c bot debugging.	Update the title to accurately reflect the actual change, such as '[test] Remove RTX waiver entries from test configuration' or similar, to match the content of the changeset.

✅ Passed checks (3 passed)

Check name	Status	Explanation
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

_{Comment @coderabbitai help to get the list of available commands.}

[xinhe-nv]

/bot run --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

[tensorrt-cicd]

PR_Github #52628 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

Link to invocation

[tensorrt-cicd]

PR_Github #92 [ run ] triggered by Bot. Commit: 0df404d Link to invocation

[tensorrt-cicd]

PR_Github #92 [ run ] completed with state FAILURE. Commit: 0df404d

Link to invocation

[xinhe-nv]

/bot run --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

[tensorrt-cicd]

PR_Github #52633 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

Link to invocation

[tensorrt-cicd]

PR_Github #93 [ run ] triggered by Bot. Commit: 0df404d Link to invocation

[tensorrt-cicd]

PR_Github #93 [ run ] completed with state FAILURE. Commit: 0df404d

Link to invocation

[xinhe-nv]

/bot run --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

[tensorrt-cicd]

PR_Github #52686 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --qa-verify-only test accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False]

Link to invocation

[tensorrt-cicd]

PR_Github #95 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #95 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #96 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #96 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #97 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #97 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #98 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #98 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #99 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #99 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #100 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #100 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #101 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #101 [ run ] completed with state FAILURE. Commit: 6108772

Link to invocation

[tensorrt-cicd]

PR_Github #102 [ run ] triggered by Bot. Commit: 6108772 Link to invocation

[tensorrt-cicd]

PR_Github #102 [ run ] completed with state SUCCESS. Commit: 6108772
LLM_FUNCTION_AUTO_V2C #189 completed with status: 'SUCCESS'
QA verify-only test: accuracy/test_llm_api_pytorch.py::TestLlama3_3_70BInstruct::test_fp4_tp2pp2[torch_compile=True-enable_gemm_allreduce_fusion=False] (NVBug 6262407, branch debug-v2c, fork xinhe-nv, dry_run_close=true)

Link to invocation

[xinhe-nv]

/bot reuse-pipeline

[tensorrt-cicd]

PR_Github #53021 [ reuse-pipeline ] triggered by Bot. Commit: 3608c39 Link to invocation

[tensorrt-cicd]

PR_Github #113 [ run ] completed with state FAILURE. Commit: 722d4b3
/LLM/PipelineMonitor/L0_MergeRequest_PR pipeline #89 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

• Please check the failed tests and fix your PR
• If you cannot view the failures, ask the CI triggerer to share details
• Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

[xinhe-nv]

/bot run --verify-only

[tensorrt-cicd]

PR_Github #53842 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --verify-only

Link to invocation

[tensorrt-cicd]

PR_Github #114 [ run ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #114 [ run ] completed with state SUCCESS. Commit: 722d4b3
LLM_FUNCTION_AUTO_V2C #201 completed with status: 'SUCCESS'
QA verify (empty customized_test_list) (NVBug 6280721, branch debug-v2c, fork xinhe-nv, dry_run_close=true)

Link to invocation

[xinhe-nv]

/bot reuse-pipeline

[tensorrt-cicd]

PR_Github #115 [ reuse-pipeline ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #53844 [ reuse-pipeline ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #115 [ reuse-pipeline ] completed with state SUCCESS. Commit: 722d4b3
Can't reuse PR_Github #113 with status: FAILED

Link to invocation

[tensorrt-cicd]

PR_Github #53844 [ reuse-pipeline ] completed with state SUCCESS. Commit: 722d4b3
Can't reuse PR_Github #0 with status: UNKNOWN

Link to invocation

[xinhe-nv]

/bot run --with-verify

[tensorrt-cicd]

PR_Github #116 [ run ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #116 [ run ] completed with state SUCCESS. Commit: 722d4b3
/LLM/PipelineMonitor/L0_MergeRequest_PR pipeline #90 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

• Please check the failed tests and fix your PR
• If you cannot view the failures, ask the CI triggerer to share details
• Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

[xinhe-nv]

/bot run --verify-only

[tensorrt-cicd]

PR_Github #55214 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --verify-only

Link to invocation

[tensorrt-cicd]

PR_Github #123 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --verify-only

Link to invocation

[xinhe-nv]

/bot run --verify-only

[tensorrt-cicd]

PR_Github #55217 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --verify-only

Link to invocation

[tensorrt-cicd]

PR_Github #124 [ run ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #124 [ run ] completed with state SUCCESS. Commit: 722d4b3

Link to invocation

[xinhe-nv]

/bot run --verify-only test accuracy/test_llm_api_pytorch.py::TestQwen3_5_4B::test_fp8

[tensorrt-cicd]

PR_Github #55220 Bot args parsing error: usage: /bot [-h]
{run,kill,skip,submit,reviewers,reuse-pipeline,reuse-review} ...
/bot: error: unrecognized arguments: --verify-only test accuracy/test_llm_api_pytorch.py::TestQwen3_5_4B::test_fp8

Link to invocation

[tensorrt-cicd]

PR_Github #125 [ run ] triggered by Bot. Commit: 722d4b3 Link to invocation

[tensorrt-cicd]

PR_Github #125 [ run ] completed with state FAILURE. Commit: 722d4b3
LLM_FUNCTION_AUTO_V2C #216 completed with status: 'UNSTABLE'
QA verify test: accuracy/test_llm_api_pytorch.py::TestQwen3_5_4B::test_fp8 (NVBug 6273850, branch debug-v2c, fork xinhe-nv, dry_run_close=true)

Link to invocation