Skip to content

Remove manylinux build scripts from python packaging pipeline - #20786

Merged
snnn merged 29 commits into
mainfrom
snnn/new_docker
May 24, 2024
Merged

Remove manylinux build scripts from python packaging pipeline#20786
snnn merged 29 commits into
mainfrom
snnn/new_docker

Conversation

@snnn

@snnn snnn commented May 23, 2024

Copy link
Copy Markdown
Contributor

Description

Use a common set of prebuilt manylinux base images to build the packages, to avoid building the manylinux part again and again. The base images can be used in GenAI and other projects too.
This PR also updates the GCC version for inference python CUDA11/CUDA12 builds from 8 to 11. Later on I will update all other CUDA pipelines to use GCC 11, to avoid the issue described in onnx/onnx#6047 and microsoft/onnxruntime-genai#257 .

Motivation and Context

  1. To extract the common part as a reusable build infra among different ONNX Runtime projects.
  2. Avoid hitting docker hub's limit: 429 Too Many Requests - Server message: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

@snnn
snnn requested a review from a team May 23, 2024 15:15
@snnn snnn mentioned this pull request May 24, 2024
4 tasks
@mszhanyi

Copy link
Copy Markdown
Contributor

Should it be merged after #20741

@snnn
snnn merged commit 535a030 into main May 24, 2024
@snnn
snnn deleted the snnn/new_docker branch May 24, 2024 15:18
snnn pushed a commit that referenced this pull request May 31, 2024
### Description
Similar to #20786 . The last PR was able to update all pipelines and all
docker files. This is a follow-up to that PR.

### Motivation and Context
1. To extract the common part as a reusable build infra among different
ONNX Runtime projects.
2. Avoid hitting docker hub's limit: 429 Too Many Requests - Server
message: toomanyrequests: You have reached your pull rate limit. You may
increase the limit by authenticating and upgrading:
https://www.docker.com/increase-rate-limit
@sophies927 sophies927 added triage:approved Approved for cherrypicks for release release:1.18.1 labels Jun 12, 2024
yf711 pushed a commit that referenced this pull request Jun 18, 2024
### Description
Use a common set of prebuilt manylinux base images to build the
packages, to avoid building the manylinux part again and again. The base
images can be used in GenAI and other projects too.
This PR also updates the GCC version for inference python CUDA11/CUDA12
builds from 8 to 11. Later on I will update all other CUDA pipelines to
use GCC 11, to avoid the issue described in
onnx/onnx#6047 and
microsoft/onnxruntime-genai#257 .

### Motivation and Context
To extract the common part as a reusable build infra among different
ONNX Runtime projects.
yf711 pushed a commit that referenced this pull request Jun 18, 2024
### Description
Similar to #20786 . The last PR was able to update all pipelines and all
docker files. This is a follow-up to that PR.

### Motivation and Context
1. To extract the common part as a reusable build infra among different
ONNX Runtime projects.
2. Avoid hitting docker hub's limit: 429 Too Many Requests - Server
message: toomanyrequests: You have reached your pull rate limit. You may
increase the limit by authenticating and upgrading:
https://www.docker.com/increase-rate-limit
baijumeswani pushed a commit that referenced this pull request Jun 20, 2024
Use a common set of prebuilt manylinux base images to build the
packages, to avoid building the manylinux part again and again. The base
images can be used in GenAI and other projects too.
This PR also updates the GCC version for inference python CUDA11/CUDA12
builds from 8 to 11. Later on I will update all other CUDA pipelines to
use GCC 11, to avoid the issue described in
onnx/onnx#6047 and
microsoft/onnxruntime-genai#257 .

To extract the common part as a reusable build infra among different
ONNX Runtime projects.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release:1.18.1 triage:approved Approved for cherrypicks for release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants