Skip to content

[None][chore] Rename AutoDeploy standalone package to Paragraf#16324

Merged
bmarimuthu-nv merged 2 commits into
NVIDIA:mainfrom
nv-auto-deploy:bala/llmc-paragraf
Jul 15, 2026
Merged

[None][chore] Rename AutoDeploy standalone package to Paragraf#16324
bmarimuthu-nv merged 2 commits into
NVIDIA:mainfrom
nv-auto-deploy:bala/llmc-paragraf

Conversation

@bmarimuthu-nv

@bmarimuthu-nv bmarimuthu-nv commented Jul 13, 2026

Copy link
Copy Markdown
Collaborator

Summary by CodeRabbit

  • New Features

    • Added the standalone Paragraf package generator and documentation.
    • Added Paragraf runtime redirection with support for legacy LLMC imports and environment settings.
    • Added compatibility wrappers for existing standalone tooling and runners.
  • Documentation

    • Updated setup, contribution, usage, and deployment guidance to reference Paragraf.
  • Tests

    • Expanded validation for package generation, imports, redirects, compatibility behavior, and runner integration.

Description

Test Coverage

PR Checklist

Please review the following before submitting your PR:

  • PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.

  • PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.

  • Test cases are provided for new code paths (see test instructions)

  • If PR introduces API changes, an appropriate PR label is added - either api-compatible or api-breaking. For api-breaking, include BREAKING in the PR title.

  • Any new dependencies have been scanned for license and vulnerabilities

  • CODEOWNERS updated if ownership changes

  • Documentation updated as needed

  • Update tava architecture diagram if there is a significant design change in PR.

  • The reviewers assigned automatically/manually are appropriate for the PR.

  • Please check this after reviewing the above items as appropriate for this PR.

GitHub Bot Help

To see a list of available CI bot commands, please comment /bot help.

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

@CodeRabbit review

@coderabbitai

coderabbitai Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

@CodeRabbit summary

@coderabbitai

coderabbitai Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Summary regeneration triggered.

@bmarimuthu-nv
bmarimuthu-nv marked this pull request as ready for review July 13, 2026 10:46
@bmarimuthu-nv
bmarimuthu-nv requested a review from a team as a code owner July 13, 2026 10:46
@bmarimuthu-nv
bmarimuthu-nv requested a review from hnover-nv July 13, 2026 10:46
@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@coderabbitai

coderabbitai Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 0876cedf-019b-4527-b4cd-3321770c3b1e

📥 Commits

Reviewing files that changed from the base of the PR and between 67e8dc9 and 4330778.

📒 Files selected for processing (15)
  • examples/auto_deploy/README.md
  • examples/auto_deploy/llmc/create_standalone_package.py
  • examples/auto_deploy/paragraf/CONTRIBUTING.md
  • examples/auto_deploy/paragraf/README.md
  • examples/auto_deploy/paragraf/_license_data.py
  • examples/auto_deploy/paragraf/create_standalone_package.py
  • scripts/check_auto_deploy_imports.py
  • tensorrt_llm/_torch/auto_deploy/__init__.py
  • tensorrt_llm/_torch/auto_deploy/trtllm_compat.py
  • tensorrt_llm/_torch/auto_deploy/utils/node_utils.py
  • tests/unittest/auto_deploy/_utils_test/_sharding_ir_helpers.py
  • tests/unittest/auto_deploy/multigpu/transformations/library/conftest.py
  • tests/unittest/auto_deploy/standalone/test_standalone_package.py
  • tests/unittest/auto_deploy/standalone/test_standalone_test_export.py
  • tests/unittest/auto_deploy/standalone/test_trtllm_compat.py

📝 Walkthrough

Walkthrough

The standalone AutoDeploy package is renamed from LLMC to Paragraf. Generation, compatibility redirects, legacy aliases, documentation, runner wiring, and validation tests now target Paragraf while preserving LLMC compatibility.

Changes

Paragraf migration

Layer / File(s) Summary
Standalone package generator
examples/auto_deploy/paragraf/create_standalone_package.py, examples/auto_deploy/llmc/create_standalone_package.py
Generates the Paragraf package, rewrites imports and tests, creates runner aliases and metadata, and retains the LLMC generator as a forwarding entrypoint.
Paragraf compatibility redirect
tensorrt_llm/_torch/auto_deploy/__init__.py, tensorrt_llm/_torch/auto_deploy/trtllm_compat.py
Redirects AutoDeploy imports to Paragraf, supports both redirect environment variables, and maps legacy LLMC imports to canonical Paragraf modules.
Standalone generation and export validation
tests/unittest/auto_deploy/standalone/test_standalone_package.py, tests/unittest/auto_deploy/standalone/test_standalone_test_export.py, tests/unittest/auto_deploy/multigpu/...
Validates generated package identity, LLMC symlinks, rewritten imports, runner wrappers, redirect guards, and Paragraf discovery behavior.
Compatibility redirect validation
tests/unittest/auto_deploy/standalone/test_trtllm_compat.py
Tests canonical module identity, legacy aliases, both environment variables, runtime entrypoints, invalid values, and preloaded-module failures.
Paragraf documentation and references
examples/auto_deploy/README.md, examples/auto_deploy/paragraf/*, scripts/check_auto_deploy_imports.py, tensorrt_llm/_torch/auto_deploy/utils/node_utils.py
Updates package naming, generation instructions, import guidance, runner commands, and standalone references to Paragraf.

Estimated code review effort: 4 (Complex) | ~60 minutes

Sequence Diagram(s)

sequenceDiagram
  participant TensorRT-LLM
  participant AutoDeploy
  participant CompatibilityRedirect
  participant Paragraf
  TensorRT-LLM->>AutoDeploy: Import auto_deploy
  AutoDeploy->>CompatibilityRedirect: Install redirect from environment
  CompatibilityRedirect->>Paragraf: Resolve canonical module
  AutoDeploy->>Paragraf: Import AutoDeploy components
Loading

Suggested reviewers: hnover-nv, mzweilz

🚥 Pre-merge checks | ✅ 3 | ❌ 2

❌ Failed checks (2 warnings)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description is largely the template text with no actual Description or Test Coverage details filled in. Add concise Description and Test Coverage sections that explain the change, why it was made, and which tests cover it.
Docstring Coverage ⚠️ Warning Docstring coverage is 35.71% which is insufficient. The required threshold is 80.00%. Write docstrings for the functions missing them to satisfy the coverage threshold.
✅ Passed checks (3 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly matches the PR’s main change: renaming the standalone package to Paragraf.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@tests/integration/defs/test_doc.py`:
- Line 194: Add the `.git`-suffixed NVIDIA Paragraf URL to the skip-list entries
in the test configuration alongside the existing normalized repository URL,
preserving exclusion of both URL forms from generated examples.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 58735b3f-d2af-4e09-97e5-2f8db85ad4e2

📥 Commits

Reviewing files that changed from the base of the PR and between 11a880f and 8e4b09a.

📒 Files selected for processing (15)
  • examples/auto_deploy/README.md
  • examples/auto_deploy/paragraf/CONTRIBUTING.md
  • examples/auto_deploy/paragraf/README.md
  • examples/auto_deploy/paragraf/_license_data.py
  • examples/auto_deploy/paragraf/create_standalone_package.py
  • scripts/check_auto_deploy_imports.py
  • tensorrt_llm/_torch/auto_deploy/__init__.py
  • tensorrt_llm/_torch/auto_deploy/trtllm_compat.py
  • tensorrt_llm/_torch/auto_deploy/utils/node_utils.py
  • tests/integration/defs/test_doc.py
  • tests/unittest/auto_deploy/_utils_test/_sharding_ir_helpers.py
  • tests/unittest/auto_deploy/multigpu/transformations/library/conftest.py
  • tests/unittest/auto_deploy/standalone/test_standalone_package.py
  • tests/unittest/auto_deploy/standalone/test_standalone_test_export.py
  • tests/unittest/auto_deploy/standalone/test_trtllm_compat.py

Comment thread tests/integration/defs/test_doc.py Outdated
@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #58962 [ run ] triggered by Bot. Commit: 8e4b09a Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #58962 [ run ] completed with state SUCCESS. Commit: 8e4b09a
/LLM/main/L0_MergeRequest_PR pipeline #47494 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@suyoggupta suyoggupta changed the title [None][chore] Rename standalone package to Paragraf [None][chore] Rename AutoDeploy standalone package to Paragraf Jul 13, 2026
@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@suyoggupta

Copy link
Copy Markdown
Collaborator

@bmarimuthu-nv : please look for a way to do a dry-run on how llm-c repo will be affected after this PR lands. We shouldn't cause breakages downstream

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59012 [ run ] triggered by Bot. Commit: 8e4b09a Link to invocation

@bmarimuthu-nv

bmarimuthu-nv commented Jul 13, 2026

Copy link
Copy Markdown
Collaborator Author

@suyoggupta yes, I think we need to do something like:

  1. Backwards compatible standalone creation: Create paragraf, still have an llm-c as a package alias in the standalone redirecting llm-c imports to paragraf
  2. Migrate CI infra and other infra to be based on paragraf instead of llm-c
  3. Once migration is done, safely delete llm-c references

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59019 [ run ] triggered by Bot. Commit: 99899fc Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github/16324-8e4b09a #59012 was force-killed by a newer pipeline run.
L0 job information not available (job may not have been triggered yet).

Link to superseding invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59019 [ run ] completed with state SUCCESS. Commit: 99899fc
/LLM/main/L0_MergeRequest_PR pipeline #47546 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Signed-off-by: Balamurugan Marimuthu <246387390+bmarimuthu-nv@users.noreply.github.com>
Signed-off-by: Balamurugan Marimuthu <246387390+bmarimuthu-nv@users.noreply.github.com>
@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

@CodeRabbit summary

@coderabbitai

coderabbitai Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor
✅ Action performed

Summary regeneration triggered.

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59106 [ run ] triggered by Bot. Commit: 4330778 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59106 [ run ] completed with state FAILURE. Commit: 4330778
/LLM/main/L0_MergeRequest_PR pipeline #47618 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59156 [ run ] triggered by Bot. Commit: 4330778 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59156 [ run ] completed with state FAILURE. Commit: 4330778
/LLM/main/L0_MergeRequest_PR pipeline #47663 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run --disable-fail-fast

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59194 [ run ] triggered by Bot. Commit: 4330778 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59194 [ run ] completed with state FAILURE. Commit: 4330778
/LLM/main/L0_MergeRequest_PR pipeline #47693 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

  • Please check the failed tests and fix your PR
  • If you cannot view the failures, ask the CI triggerer to share details
  • Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

@bmarimuthu-nv

Copy link
Copy Markdown
Collaborator Author

/bot run

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59268 [ run ] triggered by Bot. Commit: 4330778 Link to invocation

@tensorrt-cicd

Copy link
Copy Markdown
Collaborator

PR_Github #59268 [ run ] completed with state SUCCESS. Commit: 4330778
/LLM/main/L0_MergeRequest_PR pipeline #47755 completed with status: 'SUCCESS'

CI Report

Link to invocation

@bmarimuthu-nv
bmarimuthu-nv merged commit 5977a19 into NVIDIA:main Jul 15, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants