Skip to content

feat: multi-Python worker images with startup version check (AE-2827) #89

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
deanq merged 2 commits into from
Apr 28, 2026
+277 −46
Merged

feat: multi-Python worker images with startup version check (AE-2827) #89

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
161eb22
feat: multi-Python worker images with startup version check (AE-2827)
deanq Apr 21, 2026
0dee75c
fix(dockerfile): bootstrap pip via get-pip.py for non-3.12 GPU builds
deanq Apr 23, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
fix(dockerfile): bootstrap pip via get-pip.py for non-3.12 GPU builds 
Ubuntu 22.04's system python3.10 has ensurepip disabled by Debian
policy, which broke the side-by-side torch install for 3.10 GPU images
(CI: docker-test-gpu (3.10), docker-test-lb (3.10)). python3.11 is a
separate interpreter without the disable, so only 3.10 was affected.

Use urllib+get-pip.py instead of ensurepip — works for any interpreter
regardless of distro patching, and urllib is stdlib so no curl dep.

Also corrects the outdated deadsnakes comment on both Dockerfiles: the
runpod/pytorch base image layers alt-Python 3.11/3.12 on top of the
system 3.10, not via deadsnakes.
  • Loading branch information
@deanq
deanq committed Apr 27, 2026
commit 0dee75c9c27f39035b2ec50e0bd24d1cdfe9cfd7
17 changes: 12 additions & 5 deletions Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
# Base image provides Python 3.9-3.13 via deadsnakes; only 3.12 has torch
# pre-installed. For 3.10 and 3.11 we reinstall torch from the CUDA 12.8
# wheel index (~7 GB overhead) and repoint /usr/local/bin/python so the
# worker CMD picks up the correct interpreter.
# Base image (runpod/pytorch:ubuntu2204) ships Ubuntu 22.04 system python3.10
# plus alt-Python interpreters for 3.11/3.12 with torch pre-installed on 3.12.
# For non-3.12 targets we reinstall torch from the CUDA 12.8 wheel index
# (~7 GB overhead) and repoint /usr/local/bin/python so the worker CMD picks
# up the correct interpreter.
FROM runpod/pytorch:1.0.3-cu1281-torch291-ubuntu2204

# Target Python version for the worker runtime.
Expand All @@ -17,9 +18,15 @@ ENV FLASH_PYTHON_VERSION=${PYTHON_VERSION}
# /usr/local/bin/python and python3 so downstream `python` invocations use it.
# For 3.12 we keep the base image's python/torch untouched to avoid the
# ~7 GB reinstall cost.
#
# pip bootstrap: Ubuntu 22.04's system python3.10 has ensurepip disabled by
# Debian policy, so we install pip via get-pip.py (works for any interpreter
# regardless of distro patching). urllib is stdlib, avoiding a curl dependency.
RUN python${PYTHON_VERSION} --version \
&& if [ "${PYTHON_VERSION}" != "3.12" ]; then \
python${PYTHON_VERSION} -m ensurepip --upgrade \
python${PYTHON_VERSION} -c "import urllib.request; urllib.request.urlretrieve('https://bootstrap.pypa.io/get-pip.py', '/tmp/get-pip.py')" \
&& python${PYTHON_VERSION} /tmp/get-pip.py --no-cache-dir \
&& rm -f /tmp/get-pip.py \
&& python${PYTHON_VERSION} -m pip install --no-cache-dir \
--index-url ${TORCH_INDEX_URL} \
"torch==${TORCH_VERSION}" \
Expand Down
17 changes: 12 additions & 5 deletions Dockerfile-lb
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
# Base image provides Python 3.9-3.13 via deadsnakes; only 3.12 has torch
# pre-installed. For 3.10 and 3.11 we reinstall torch from the CUDA 12.8
# wheel index (~7 GB overhead) and repoint /usr/local/bin/python so the
# worker CMD picks up the correct interpreter.
# Base image (runpod/pytorch:ubuntu2204) ships Ubuntu 22.04 system python3.10
# plus alt-Python interpreters for 3.11/3.12 with torch pre-installed on 3.12.
# For non-3.12 targets we reinstall torch from the CUDA 12.8 wheel index
# (~7 GB overhead) and repoint /usr/local/bin/python so the worker CMD picks
# up the correct interpreter.
FROM runpod/pytorch:1.0.3-cu1281-torch291-ubuntu2204

# Target Python version for the worker runtime.
Expand All @@ -17,9 +18,15 @@ ENV FLASH_PYTHON_VERSION=${PYTHON_VERSION}
# /usr/local/bin/python and python3 so downstream `python` invocations use it.
# For 3.12 we keep the base image's python/torch untouched to avoid the
# ~7 GB reinstall cost.
#
# pip bootstrap: Ubuntu 22.04's system python3.10 has ensurepip disabled by
# Debian policy, so we install pip via get-pip.py (works for any interpreter
# regardless of distro patching). urllib is stdlib, avoiding a curl dependency.
RUN python${PYTHON_VERSION} --version \
&& if [ "${PYTHON_VERSION}" != "3.12" ]; then \
python${PYTHON_VERSION} -m ensurepip --upgrade \
python${PYTHON_VERSION} -c "import urllib.request; urllib.request.urlretrieve('https://bootstrap.pypa.io/get-pip.py', '/tmp/get-pip.py')" \
&& python${PYTHON_VERSION} /tmp/get-pip.py --no-cache-dir \
&& rm -f /tmp/get-pip.py \
&& python${PYTHON_VERSION} -m pip install --no-cache-dir \
--index-url ${TORCH_INDEX_URL} \
"torch==${TORCH_VERSION}" \
Expand Down
Loading