[None][feat] Upgrade NIXL to v1.0.1 and UCX to 1.21 by chuangz0 · Pull Request #14436 · NVIDIA/TensorRT-LLM

chuangz0 · 2026-05-22T02:58:08Z

Squashed from upstream PR #13841 (NVIDIA/TensorRT-LLM):

Upgrade NIXL to v1.0.1
Upgrade UCX to 1.21
install_ucx.sh: replace pre-existing UCX with symlink
Add lib/ucx into libenv for CI PackageSanityCheck
Update images
Fix transfer bug

Summary by CodeRabbit

Chores
- Updated NIXL dependency to v1.0.1.
- Updated UCX library to v1.21.x.
- Refreshed Docker image tags for LLM builds.
- Improved build pipeline environment setup for library resolution.
Tests
- Adjusted memory management and cache manager test configurations.

Description

Test Coverage

PR Checklist

Please review the following before submitting your PR:

PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.
PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.
Test cases are provided for new code paths (see test instructions)
If PR introduces API changes, an appropriate PR label is added - either api-compatible or api-breaking. For api-breaking, include BREAKING in the PR title.
Any new dependencies have been scanned for license and vulnerabilities
CODEOWNERS updated if ownership changes
Documentation updated as needed
Update tava architecture diagram if there is a significant design change in PR.
The reviewers assigned automatically/manually are appropriate for the PR.
Please check this after reviewing the above items as appropriate for this PR.

GitHub Bot Help

To see a list of available CI bot commands, please comment /bot help.

chuangz0 · 2026-05-22T02:58:50Z

/bot run --stage-list "Build-Docker-Images"

tensorrt-cicd · 2026-05-22T03:05:12Z

PR_Github #49828 [ run ] triggered by Bot. Commit: d2f8edc Link to invocation

chuangz0 · 2026-05-22T07:08:53Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-22T07:16:22Z

PR_Github #49878 [ run ] triggered by Bot. Commit: bc7fa6a Link to invocation

tensorrt-cicd · 2026-05-22T07:19:56Z

PR_Github #49828 [ run ] completed with state ABORTED. Commit: d2f8edc

Link to invocation

chuangz0 · 2026-05-22T11:27:19Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-22T11:32:37Z

PR_Github #49928 [ run ] triggered by Bot. Commit: fe0819d Link to invocation

tensorrt-cicd · 2026-05-22T11:36:46Z

PR_Github #49878 [ run ] completed with state ABORTED. Commit: bc7fa6a

Link to invocation

tensorrt-cicd · 2026-05-23T00:36:13Z

PR_Github #49928 [ run ] completed with state SUCCESS. Commit: fe0819d
/LLM/main/L0_MergeRequest_PR pipeline #39505 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

chuangz0 · 2026-05-25T03:28:53Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-25T03:34:13Z

PR_Github #50134 [ run ] triggered by Bot. Commit: c313620 Link to invocation

chuangz0 · 2026-05-25T08:17:28Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-25T08:23:48Z

PR_Github #50181 [ run ] triggered by Bot. Commit: d349f77 Link to invocation

tensorrt-cicd · 2026-05-25T08:29:05Z

PR_Github #50134 [ run ] completed with state ABORTED. Commit: c313620

Link to invocation

tensorrt-cicd · 2026-05-25T16:39:51Z

PR_Github #50181 [ run ] completed with state SUCCESS. Commit: d349f77
/LLM/main/L0_MergeRequest_PR pipeline #39724 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

chuangz0 · 2026-05-26T05:49:41Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-26T05:54:56Z

PR_Github #50290 [ run ] triggered by Bot. Commit: b99939c Link to invocation

chuangz0 · 2026-05-26T12:32:50Z

/bot kill

chuangz0 · 2026-05-27T01:05:39Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-27T01:12:06Z

PR_Github #50416 [ run ] triggered by Bot. Commit: d86a652 Link to invocation

tensorrt-cicd · 2026-05-27T07:54:00Z

PR_Github #50416 [ run ] completed with state SUCCESS. Commit: d86a652
/LLM/main/L0_MergeRequest_PR pipeline #39940 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

chuangz0 · 2026-05-27T09:12:38Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-27T09:18:12Z

PR_Github #50512 [ run ] triggered by Bot. Commit: e5fd61b Link to invocation

tensorrt-cicd · 2026-05-27T17:11:08Z

PR_Github #50512 [ run ] completed with state FAILURE. Commit: e5fd61b
/LLM/main/L0_MergeRequest_PR pipeline #40020 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

chuangz0 · 2026-05-28T01:22:51Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-28T01:28:10Z

PR_Github #50647 [ run ] triggered by Bot. Commit: 8802bbf Link to invocation

tensorrt-cicd · 2026-05-28T13:37:47Z

PR_Github #50647 [ run ] completed with state FAILURE. Commit: 8802bbf
/LLM/main/L0_MergeRequest_PR pipeline #40138 completed with status: 'FAILURE'

CI Report

⚠️ Action Required:

Please check the failed tests and fix your PR
If you cannot view the failures, ask the CI triggerer to share details
Once fixed, request an NVIDIA team member to trigger CI again

CI Agent Failure Analysis

Link to invocation

Squashed from upstream PR NVIDIA#13841 (NVIDIA/TensorRT-LLM): - Upgrade NIXL to v1.0.1 - Upgrade UCX to 1.21 - install_ucx.sh: replace pre-existing UCX with symlink - Add lib/ucx into libenv for CI PackageSanityCheck - Update images - Fix transfer bug Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

chuangz0 · 2026-05-29T01:06:35Z

/bot run --disable-fail-fast

tensorrt-cicd · 2026-05-29T01:12:52Z

PR_Github #50922 [ run ] triggered by Bot. Commit: 9fec05e Link to invocation

tensorrt-cicd · 2026-05-29T15:00:53Z

PR_Github #50922 [ run ] completed with state SUCCESS. Commit: 9fec05e
/LLM/main/L0_MergeRequest_PR pipeline #40382 completed with status: 'SUCCESS'
Pipeline passed with automatic retried tests. Check the rerun report for details.

CI Report

Link to invocation

yuanjingx87

approved on behalf of trt-llm-oss-compliance

The trtllm dev environment used to install the meta `nixl` package, which provides a top-level `nixl/__init__.py` shim that redirects to `nixl_cu13` / `nixl_cu12`. After NVIDIA#14436 switched the dependency to `nixl-cu13` directly, the meta shim is no longer present, so `from nixl import nixl_agent, ...` in `tensorrt_llm/_torch/disaggregation/nixl/_agent_py.py` raises `ModuleNotFoundError: No module named 'nixl'` at import time, which in turn breaks `test_agent_multi_backends::test_run_with_different_env[1]` during collection of the spawned subprocess pytest. Resolve the symbols from `nixl_cu13` (or `nixl_cu12`) first and fall back to the meta-package only when neither CUDA-specific package is installed. Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>

github-actions Bot assigned chuangz0 May 22, 2026

chuangz0 force-pushed the upgrade_nixl_010 branch from bc7fa6a to fe0819d Compare May 22, 2026 11:27

chuangz0 force-pushed the upgrade_nixl_010 branch from 1e35d2e to c313620 Compare May 25, 2026 03:23

chuangz0 force-pushed the upgrade_nixl_010 branch from 73bf439 to d349f77 Compare May 25, 2026 08:17

chuangz0 force-pushed the upgrade_nixl_010 branch from fd3fd7d to b99939c Compare May 26, 2026 05:49

chuangz0 force-pushed the upgrade_nixl_010 branch from 53f9a8b to 1ac7b73 Compare May 26, 2026 12:32

chuangz0 marked this pull request as ready for review May 26, 2026 12:33

chuangz0 requested a review from a team May 26, 2026 12:33

chuangz0 requested review from a team as code owners May 26, 2026 12:33

chuangz0 requested review from a team and tburt-nv May 26, 2026 12:33

chuangz0 force-pushed the upgrade_nixl_010 branch from d86a652 to e5fd61b Compare May 27, 2026 09:12

chuangz0 force-pushed the upgrade_nixl_010 branch from e5fd61b to 8802bbf Compare May 28, 2026 01:22

chuangz0 added 6 commits May 29, 2026 09:06

update image

6a3b317

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

update image

8c7f9bc

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

fix ld_library_path

fb8b6e9

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

fix pre-commit

7d0e236

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

fix nixl version

9fec05e

Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>

chuangz0 force-pushed the upgrade_nixl_010 branch from 8802bbf to 9fec05e Compare May 29, 2026 01:06

yuanjingx87 approved these changes Jun 1, 2026

View reviewed changes

zackyoray approved these changes Jun 1, 2026

View reviewed changes

Shixiaowei02 approved these changes Jun 1, 2026

View reviewed changes

Shixiaowei02 merged commit 2f9b85a into NVIDIA:main Jun 1, 2026
7 checks passed

Shixiaowei02 deleted the upgrade_nixl_010 branch June 1, 2026 09:52

Uh oh!

Conversation

chuangz0 commented May 22, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary by CodeRabbit

Description

Test Coverage

PR Checklist

GitHub Bot Help

Uh oh!

chuangz0 commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 22, 2026

Uh oh!

chuangz0 commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 22, 2026

Uh oh!

chuangz0 commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 22, 2026

Uh oh!

tensorrt-cicd commented May 23, 2026

Uh oh!

chuangz0 commented May 25, 2026

Uh oh!

tensorrt-cicd commented May 25, 2026

Uh oh!

chuangz0 commented May 25, 2026

Uh oh!

tensorrt-cicd commented May 25, 2026

Uh oh!

tensorrt-cicd commented May 25, 2026

Uh oh!

tensorrt-cicd commented May 25, 2026

Uh oh!

chuangz0 commented May 26, 2026

Uh oh!

tensorrt-cicd commented May 26, 2026

Uh oh!

chuangz0 commented May 26, 2026

Uh oh!

chuangz0 commented May 27, 2026

Uh oh!

tensorrt-cicd commented May 27, 2026

Uh oh!

tensorrt-cicd commented May 27, 2026

Uh oh!

chuangz0 commented May 27, 2026

Uh oh!

tensorrt-cicd commented May 27, 2026

Uh oh!

tensorrt-cicd commented May 27, 2026

Uh oh!

chuangz0 commented May 28, 2026

Uh oh!

tensorrt-cicd commented May 28, 2026

Uh oh!

tensorrt-cicd commented May 28, 2026

Uh oh!

chuangz0 commented May 29, 2026

Uh oh!

tensorrt-cicd commented May 29, 2026

Uh oh!

tensorrt-cicd commented May 29, 2026

Uh oh!

yuanjingx87 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

chuangz0 commented May 22, 2026 •

edited by coderabbitai Bot

Loading