Skip to content

[None][test] fix Cosmos3 tests after VisualGen config split - #15170

Merged
bobboli merged 2 commits into
NVIDIA:mainfrom
bobboli:bli/fix-cosmos3-config-tests
Jun 24, 2026
Merged

[None][test] fix Cosmos3 tests after VisualGen config split#15170
bobboli merged 2 commits into
NVIDIA:mainfrom
bobboli:bli/fix-cosmos3-config-tests

Conversation

@bobboli

@bobboli bobboli commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • update Cosmos3 tests to build model config through DiffusionPipelineConfig after the VisualGen config split
  • check quant config through the loaded transformer model config instead of the removed pipeline.model_config alias

Testing

  • pre-commit hooks on commit
  • python3 -m py_compile tests/unittest/_torch/visual_gen/test_cosmos3_transformer.py tests/unittest/_torch/visual_gen/test_cosmos3_pipeline.py
  • pytest not run locally: pytest is not installed in this shell

Summary by CodeRabbit

  • Tests
    • Updated FP8 quantization configuration validation tests for visual generation to ensure proper verification of quantization settings within the pipeline architecture.

@bobboli
bobboli requested a review from a team as a code owner June 9, 2026 16:08
@bobboli

bobboli commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run

@bobboli
bobboli enabled auto-merge (squash) June 9, 2026 16:13
@coderabbitai

coderabbitai Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: d8bf53e1-67fc-454a-8133-b8433aa3a8f4

📥 Commits

Reviewing files that changed from the base of the PR and between f0ba8c7 and 86c5519.

📒 Files selected for processing (2)
  • tests/unittest/_torch/visual_gen/test_cosmos3_pipeline.py
  • tests/unittest/_torch/visual_gen/test_cosmos3_transformer.py

📝 Walkthrough

Walkthrough

Two Cosmos3 visual generation test files are refactored to access model configuration through the transformer sub-object. The test helper is updated to load configuration via DiffusionPipelineConfig.from_pretrained().primary_model_config, and FP8 assertions in both test files are redirected from pipeline.model_config to pipeline.transformer.model_config.

Changes

Cosmos3 Test Configuration Access Path Refactoring

Layer / File(s) Summary
Configuration loading and imports
tests/unittest/_torch/visual_gen/test_cosmos3_transformer.py
Import block is expanded to include DiffusionPipelineConfig and VisualGenArgs, and _load_model_config helper now derives model configuration via DiffusionPipelineConfig.from_pretrained(...).primary_model_config instead of calling DiffusionModelConfig.from_pretrained(...) directly.
FP8 assertion path updates
tests/unittest/_torch/visual_gen/test_cosmos3_transformer.py, tests/unittest/_torch/visual_gen/test_cosmos3_pipeline.py
FP8 quantization algorithm assertions in both transformer and pipeline tests are updated to read quant_algo from pipeline.transformer.model_config.quant_config instead of pipeline.model_config.quant_config.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~3 minutes

Suggested reviewers

  • kaiyux
  • chang-l
🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Docstring Coverage ⚠️ Warning Docstring coverage is 25.00% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies a test fix related to Cosmos3 tests after a VisualGen config split, matching the actual changes in the pull request.
Description check ✅ Passed The description covers the main changes (VisualGen config split, model config construction, quant config access) and testing approach, but lacks detail on the specific issue and the Test Coverage section is incomplete.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53096 [ run ] triggered by Bot. Commit: 86c5519 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53096 [ run ] completed with state FAILURE. Commit: 86c5519
/LLM/main/L0_MergeRequest_PR pipeline #42304 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@NVShreyas

Copy link
Copy Markdown
Collaborator

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53157 [ run ] triggered by Bot. Commit: 86c5519 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53157 [ run ] completed with state FAILURE. Commit: 86c5519
/LLM/main/L0_MergeRequest_PR pipeline #42360 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli
bobboli force-pushed the bli/fix-cosmos3-config-tests branch 2 times, most recently from 807fdf2 to 5cc2df9 Compare June 10, 2026 04:22
@bobboli

bobboli commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53227 [ run ] triggered by Bot. Commit: cd5e3fb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53227 [ run ] completed with state SUCCESS. Commit: cd5e3fb
/LLM/main/L0_MergeRequest_PR pipeline #42422 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli

bobboli commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53296 [ run ] triggered by Bot. Commit: cd5e3fb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53296 [ run ] completed with state SUCCESS. Commit: cd5e3fb
/LLM/main/L0_MergeRequest_PR pipeline #42484 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli

bobboli commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53324 [ run ] triggered by Bot. Commit: cd5e3fb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53324 [ run ] completed with state FAILURE. Commit: cd5e3fb
/LLM/main/L0_MergeRequest_PR pipeline #42510 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli

bobboli commented Jun 11, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53462 [ run ] triggered by Bot. Commit: cd5e3fb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53462 [ run ] completed with state SUCCESS. Commit: cd5e3fb
/LLM/main/L0_MergeRequest_PR pipeline #42626 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@NVShreyas

Copy link
Copy Markdown
Collaborator

/bot run --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53587 [ run ] triggered by Bot. Commit: cd5e3fb Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53587 [ run ] completed with state SUCCESS. Commit: cd5e3fb
/LLM/main/L0_MergeRequest_PR pipeline #42733 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53851 [ run ] completed with state SUCCESS. Commit: dfeb636
/LLM/main/L0_MergeRequest_PR pipeline #42959 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@NVShreyas

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53920 [ run ] triggered by Bot. Commit: dfeb636 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53920 [ run ] completed with state SUCCESS. Commit: dfeb636
/LLM/main/L0_MergeRequest_PR pipeline #43015 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@NVShreyas

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53950 [ run ] triggered by Bot. Commit: dfeb636 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #53950 [ run ] completed with state FAILURE. Commit: dfeb636
/LLM/main/L0_MergeRequest_PR pipeline #43041 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli

bobboli commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54289 [ run ] triggered by Bot. Commit: dfeb636 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54289 [ run ] completed with state FAILURE. Commit: dfeb636
/LLM/main/L0_MergeRequest_PR pipeline #43360 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@NVShreyas

Copy link
Copy Markdown
Collaborator

/bot run --disable-fail-fast --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54316 [ run ] triggered by Bot. Commit: dfeb636 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54316 [ run ] completed with state SUCCESS. Commit: dfeb636
/LLM/main/L0_MergeRequest_PR pipeline #43387 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

bobboli added 2 commits June 18, 2026 13:04
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
@bobboli
bobboli force-pushed the bli/fix-cosmos3-config-tests branch from dfeb636 to 920fc36 Compare June 18, 2026 05:05
@bobboli

bobboli commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54906 [ run ] triggered by Bot. Commit: 920fc36 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #54906 [ run ] completed with state SUCCESS. Commit: 920fc36
/LLM/main/L0_MergeRequest_PR pipeline #43910 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bobboli

bobboli commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator Author

/bot run --reuse-test

@chang-l

chang-l commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #55301 [ run ] triggered by Bot. Commit: 920fc36 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #55301 [ run ] completed with state SUCCESS. Commit: 920fc36
/LLM/main/L0_MergeRequest_PR pipeline #44251 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@chang-l

chang-l commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator

/bot run --reuse-test

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #55337 [ run ] triggered by Bot. Commit: 920fc36 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #55337 [ run ] completed with state SUCCESS. Commit: 920fc36
/LLM/main/L0_MergeRequest_PR pipeline #44288 completed with status: 'SUCCESS'

CI Report

Link to invocation

@bobboli
bobboli merged commit aeb169a into NVIDIA:main Jun 24, 2026
7 checks passed
xinhe-nv pushed a commit to tensorrt-cicd/TensorRT-LLM that referenced this pull request Jun 24, 2026
…5170)

Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Signed-off-by: GitLab CI Bot <gitlab-ci@nvidia.com>
BrianLi23 pushed a commit to BrianLi23/TensorRT-LLM that referenced this pull request Jul 9, 2026
…5170)

Signed-off-by: Bo Li <22713281+bobboli@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants