Skip to content

Exclude cudnn 8 DLLs from manylinux package - #21746

Merged
Tianlei Wu (tianleiwu) merged 1 commit into
mainfrom
tlwu/add_cudnn_8_dll_dependencies_in_setup
Aug 15, 2024
Merged

Exclude cudnn 8 DLLs from manylinux package#21746
Tianlei Wu (tianleiwu) merged 1 commit into
mainfrom
tlwu/add_cudnn_8_dll_dependencies_in_setup

Conversation

@tianleiwu

Copy link
Copy Markdown
Contributor

Description

It is a follow up of #21738 to exclude cudnn 8 DLLs since some python packaging pipelines (like training package) are still using cudnn 8.9 and cuda 11.8.

Motivation and Context

Size of python package for training pipeline increases a lot due to some DLLs are added to package:
image

Comment thread setup.py
"libcudnn_heuristic.so.9",
"libcudnn_ops.so.9",
"libnvJitLink.so.12",
"libnvrtc.so.11",

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For some reason, libnvrtc.so.11 and libnvrtc-builtins.so.11 are still in package. Size is about 20MB per whl file.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, we need to solve this problem.

@tianleiwu
Tianlei Wu (tianleiwu) merged commit b9f3a5d into main Aug 15, 2024
@tianleiwu
Tianlei Wu (tianleiwu) deleted the tlwu/add_cudnn_8_dll_dependencies_in_setup branch August 15, 2024 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants