Skip to content

docs(release): spike downloadable server binary matrix - #129

Merged
localai-bot merged 14 commits into
mainfrom
row/ENG-RELEASE-BINARIES
Aug 8, 2026
Merged

docs(release): spike downloadable server binary matrix#129
localai-bot merged 14 commits into
mainfrom
row/ENG-RELEASE-BINARIES

Conversation

@localai-bot

@localai-bot localai-bot commented Aug 7, 2026

Copy link
Copy Markdown
Collaborator

Claim

Claims ENG-RELEASE-BINARIES for the accepted records/spec-only release spike. Tracks #117. Row remains SPIKE; no archive or implementation is claimed.

User-reviewed primary artifact contract

  • one primary adaptive CPU binary per OS+host ABI, built to a conservative baseline and runtime-dispatching only to compiled, exactly probed ISA tiers
  • x86_64 baseline works without AVX2; current F16C/AVX2/AVX-512 tiers are inventoried, while VNNI/AMX or later tiers are named only where real kernels and CPU+OS-state gates exist
  • aarch64 baseline is portable/NEON with independent HWCAP/sysctl-gated DotProd/i8mm and future real-kernel tiers
  • no global -march=native; forced-tier mutation gates execute feature-poor and feature-rich paths/emulation, and the manifest lists compiled tiers and required OS state
  • one primary fat CUDA binary per OS+host ABI; at least separate Linux x86_64 and Linux aarch64 ELF artifacts
  • each fat CUDA artifact covers all supported SMs: 80, 86, 87, 89, 90a, 100a, 103a, 110, 120a, 121a
  • cross-family per-source gencode must land first; fast-path TUs compile only for compatible SMs and portable TUs cover the full list
  • Triton AOT packaging/runtime dispatch embeds and exact-SM-selects every available tree (80/86/89/90a/100a/121a); 87/103a/110/120a retain portable fallbacks
  • optional single-SM archives are diagnostic/performance variants, not primary downloads
  • build/runtime/correctness/performance evidence remains independent per SM/tier; build-only paths stay preview

Package and supply-chain contract

  • staged archive help/health/model smoke plus dependency and RPATH/install-name audits
  • SHA256, SPDX SBOM, provenance, licenses, version and independent evidence booleans
  • least-privilege plan/build/verify/attest/publish stages for dry runs and tags
  • ffmpeg and accelerator drivers remain explicit external runtime boundaries
  • experimental literal-static musl CPU lane remains preview; ROCm remains blocked

Work order

W1 per-source CUDA gencode -> W2 multi-SM AOT dispatch -> W3/W4 x86_64/aarch64 ISA audits -> manifest/install/archive/workflow -> primary CPU and fat-CUDA bundles -> optional per-SM diagnostics.

Scope

Documentation and canonical records only. No CMake, workflow, source, test, build, GPU, download, service or artifact implementation.

Verification

  • scripts/agent-preflight.sh --staged -> EXIT=0, all gates green
  • pre-push scripts/agent-preflight.sh && git push -> EXIT=0
  • head: 88c21f0e40e0d982423e3047c6234286feec04e7

FOLLOWING_AGENTS_PROTOCOL

mudler added 4 commits August 7, 2026 21:45
Inventory the downloadable server-bundle capability and materialize the records-only helper claim.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Define the stable/runtime-gated and preview/build-only artifact matrix, per-SM CUDA and AOT contract, staged archive gates, supply-chain evidence, and helper-sized implementation sequence.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Make host-ABI fat CUDA and adaptive CPU binaries the primary downloads, move cross-family gencode, multi-SM AOT dispatch, and CPU ISA audits ahead of packaging, and retain per-target evidence plus optional per-SM diagnostics.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Merge current origin/main while taking keyed records from main wholesale and reapplying only the approved fat-CUDA/adaptive-CPU release spike delta.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
@localai-bot

Copy link
Copy Markdown
Collaborator Author

Integration blocker found after reconciling with current main: CI job device-leakage fails at the PR merge ref because origin/main f161bcc0 itself has two new DeviceType::kCUDA references in src/vllm/multimodal/minimax_h3_video.cpp while the ratchet baseline remains zero. Reproduced directly on origin/main; #129 does not touch this code/checker and remains spec-only. A fresh helper is preparing the red-first fix on the owning H3/surface row. After that fix lands, #129 will be reconciled again, rerun, mutation-reviewed, and only then readied/merged.

mudler added 10 commits August 7, 2026 22:59
Pin the user-approved fat-CUDA and adaptive-CPU artifact shapes, exact ten-SM set, W1-W13 dependency graph, and every canonical release anchor in a fail-closed checker wired into preflight and CI.

Red-first evidence: test_check_release_binary_contract.py failed with 38 mutation subtest failures before the checker, contract block, and Deps column existed. The focused suite now passes 11/11 test methods, including every SM, work edge, and record-anchor deletion.

The row remains SPIKE; archive and runtime evidence remain pending.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Keep the public release state fail-closed at SPIKED/PENDING, bind W10 fat-CUDA and optional W12 diagnostics to the human work table, pin the adaptive-CPU/no-AVX2 prose, and require the exact 15-method mutation inventory by AST name and count.

Reviewer mutations that previously stayed green now fail for their named reasons. The row remains SPIKE; no archive, runtime, correctness, or performance evidence is claimed.

FOLLOWING_AGENTS_PROTOCOL
Assisted-by: Codex:gpt-5 [Codex]
Pin independently-authored literal mutation datasets for all ten CUDA SMs, the W1-W13 dependency graph, record anchors, public pending states, W10/W12 policy, and the primary fat-CUDA/adaptive-CPU no-AVX2 prose. AST checks now require each named test to consume its corresponding inventory, so retained-but-empty mutation loops fail closed.

Red: removing 121a from the SM loop and changing W2 dependencies to empty each left the checker and all 15 tests green. Green: all ten reviewer mutations fail for their named reason, the checker passes, and 18/18 tests plus full and staged preflight pass. The row remains SPIKE/PENDING; no release artifact or runtime evidence is claimed.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Parse the release row lifecycle and no-artifact honesty contract on the engine, roadmap, coordination, and state surfaces. Pin the exact mutation dataset and its consumer so the four formerly escaping DONE mutations cannot be silently removed or bypassed.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Keep the checker guard-map keysets independent from the mutable maps they validate. Exercise every guarded entry through delete and rename mutations, plus additions and an enforcement-bypass case, and pin the expanded 20-test public inventory.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Validate human W1-W13 row identity before dictionary normalization, and pin the five remaining exact machine fields through independent mutation inventories and consumers. Reconcile origin/main b44ad33 while preserving its Kimi and #135 device-seam work.

Row: ENG-RELEASE-BINARIES

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Pin every inventory consumer body, independently reject unknown machine fields, and mirror the complete human W1-W13 dependency table. Expand the mutation contract to 25 named methods and retain honest pending release claims.

Row: ENG-RELEASE-BINARIES

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Restore origin/main's full NOW guidance and OpenAI endpoint inventory, then reapply only the release SPIKE clauses. Keep NOW and STATUS within their existing size ratchets through concise release wording and one semantics-preserving NOW compaction.

Reconciled-main: b44ad33

Row: ENG-RELEASE-BINARIES

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Reconcile row ENG-RELEASE-BINARIES with origin/main 48a5414 after PR #139. Keyed records take main wholesale with only the accepted release clauses reapplied; append-only state preserves both histories.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:GPT-5 [Codex]
Pin ENG-RELEASE-BINARIES backend policy, active CI/preflight wiring, and the compact pending public status without replacing the OpenAI endpoint record.

Row: ENG-RELEASE-BINARIES
PR: #129

FOLLOWING_AGENTS_PROTOCOL
Assisted-by: Codex:gpt-5 [Codex]
@localai-bot
localai-bot marked this pull request as ready for review August 8, 2026 06:07
@localai-bot
localai-bot merged commit b38f78a into main Aug 8, 2026
11 checks passed
mudler added a commit that referenced this pull request Aug 8, 2026
Materialize CLAIM-ENG-RELEASE-BINARIES-W5 after merged PR #129. No W5 implementation or artifact evidence is included in this checkpoint.

FOLLOWING_AGENTS_PROTOCOL

Assisted-by: Codex:gpt-5 [Codex]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants