Skip to content

chore(server/cuda): bump pinned llama.cpp digest to 7b3d7834 - #141

Merged
dvcdsys merged 1 commit into
developfrom
chore/bump-llama-cuda-digest
Jul 13, 2026
Merged

chore(server/cuda): bump pinned llama.cpp digest to 7b3d7834#141
dvcdsys merged 1 commit into
developfrom
chore/bump-llama-cuda-digest

Conversation

@dvcdsys

@dvcdsys dvcdsys commented Jul 13, 2026

Copy link
Copy Markdown
Owner

What

Bumps the pinned ghcr.io/ggml-org/llama.cpp:server-cuda digest in server/Dockerfile.cuda:

digest
old sha256:d0cd0c4563e046f6ad0c8c27fe78280376d0d645cc3fef7a1ab87c75de08377b
new sha256:7b3d7834fc7307cb54f24f8869b67bfff276404c416452a48d11321bc36a81be (llama.cpp b9982, 99f3dc322)

Closes #140. Closes #136 (older digest, superseded by this one).

Verification (done before this PR, on the prod RTX 3090 box)

  • Build: image builds clean from this Dockerfile (native amd64 build on the GPU server).
  • Shared-lib layout (the reason the pin exists): /app/llama-server --version runs → all .sos resolve; --list-devices reports CUDA0: NVIDIA GeForce RTX 3090.
  • CVE scan (trivy, HIGH/CRITICAL, diffed against v0.12.1-cu128): no new findings. The cix-server binary is now clean — the fresh Go toolchain dropped CVE-2026-39822; the cloudflared/ngrok findings are pre-existing and byte-identical between both images. (docker scout was unavailable — Docker Desktop is gone from the dev machine — trivy used as the scanner.)
  • Prod E2E via Portainer: the cix stack was temporarily switched to the test image — container healthy, /app/llama-server resident with ~514 MiB VRAM in nvidia-smi compute-apps (explicit GPU verification, no CPU fallback), semantic search returned ranked results (query embedding exercised end-to-end). Stack restored to v0.12.1-cu128 afterwards.

The digest reaches prod with the next server/v* release; develop-cu128 picks it up as soon as this merges.

🤖 Generated with Claude Code

Upstream ghcr.io/ggml-org/llama.cpp:server-cuda moved past the pinned
digest. New pin is llama.cpp build 9982 (99f3dc322).

Verified on the prod RTX 3090 box before commit:
- image builds; /app/llama-server resolves all shared libs (--version OK)
- trivy HIGH/CRITICAL diff vs v0.12.1-cu128: no new findings; the
  cix-server binary is now clean (fresh Go toolchain dropped
  CVE-2026-39822); the cloudflared/ngrok findings are pre-existing and
  identical in both images
- deployed to the cix stack and exercised end-to-end (health + GPU
  offload + embedding smoke), then restored

Closes #140. Closes #136 (superseded by the same bump).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@dvcdsys
dvcdsys merged commit 3512bc3 into develop Jul 13, 2026
1 check passed
@dvcdsys
dvcdsys deleted the chore/bump-llama-cuda-digest branch July 13, 2026 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant