feat(e2e): add CPU E2E test suite with provisioner and rolling release tests#326
Open
runpod-Henrik wants to merge 2 commits intomainfrom
Open
feat(e2e): add CPU E2E test suite with provisioner and rolling release tests#326runpod-Henrik wants to merge 2 commits intomainfrom
runpod-Henrik wants to merge 2 commits intomainfrom
Conversation
…e tests Adds the full E2E test infrastructure built and validated during v1.14.0 QA: - provisioner.py: session-scoped endpoint pool with parallel provisioning - test_cpu_smoke.py: updated deploy → invoke → undeploy smoke test - test_cpu_suite.py: QB function (smoke, empty string, unicode, concurrent), deps (numpy/pandas), class, and LB endpoint tests (9 pass, 1 xfail AE-2744) - test_rolling_release.py: no-spurious-release and config-change-triggers-drift - test_redeploy.py: scale-to-zero and multi-worker (scale-to-zero + always-on) recycle tests; single-slot always-on failures split to test_redeploy_always_on.py - e2e.yml: enable push/PR CI triggers; inject FLASH_SDK_GIT_REF All 15 CPU tests confirmed passing locally (v1.14.0). GPU smoke included; may timeout in CI when GPU inventory is constrained. Excluded from this PR (tracked separately): - test_redeploy_always_on.py: single-slot always-on recycle (AE-2940/2941/2942) - test_source_fingerprint.py: needs assertion update - test_concurrency_modifier.py: inconclusive — needs redesign Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
runpod-Henrik
force-pushed
the
Henrik/e2e-cpu-smoke
branch
from
3e448ac to
810c5cb
Compare
Keep workflow_dispatch-only trigger; schedule can be added back once the E2E account quota and test batching are sorted out. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds the full E2E test infrastructure built and validated during v1.14.0 QA. All 15 CPU tests confirmed passing locally.
AE-2168
New files:
e2e/provisioner.py— session-scoped endpoint pool with parallel provisioninge2e/test_cpu_suite.py— QB function (smoke, empty string, unicode, concurrent), deps (numpy/pandas), class, LB endpoint (9 pass, 1 xfail AE-2744)e2e/test_rolling_release.py— no-spurious-release and config-change-triggers-drifte2e/test_redeploy.py— scale-to-zero and multi-worker recycle tests (3 pass)e2e/test_gpu_smoke.py— GPU deploy → invoke → undeployUpdated:
e2e/conftest.py— better error messages, sys.path fix, sweep prefix filtere2e/test_cpu_smoke.py— updated for provisioner.github/workflows/e2e.yml— injectFLASH_SDK_GIT_REFNote on GPU smoke:
test_gpu_smoke.pywill timeout in CI when GPU inventory is constrained.Test plan
🤖 Generated with Claude Code