chore: bump llama.cpp to b10255 - #28
Merged
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
Updates the pinned llama.cpp release tag used by llama-web-bridge builds/CI to the next upstream version, so the bridge compiles and ships against the newer llama.cpp codebase.
Changes:
- Bump the pinned
llama.cpptag fromb10236tob10255.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
llama.cpp update
b10236b10255Upstream changelog
Release notes for b10255
Details
Extended SYCL oneDNN SDPA to non-FP16 KV caches (Q4_0–Q8_0 and FP32) (#25874)
Extends the oneDNN SDPA path (PR #25222) to handle non-F16 KV caches by
dequantizing or converting K/V to dense FP16 on-device before feeding
them into the SDPA graph. The fused systolic kernel then runs identically
to the native FP16 path.
Supported KV types:
Gate: non-F16 requires K >= 1024 and Q >= 32 (prefill only).
F16 KV runs at any length (existing behavior).
Also includes the stream sync fix (stream->wait_and_throw() unconditional,
PR #25741 by @malsbat) and removal of V_is_K_view aliasing (K and V are
always dequantized to separate buffers).
Co-Authored-By: Claude noreply@anthropic.com
Co-Authored-By: Claude noreply@anthropic.com
Co-authored-by: Claude noreply@anthropic.com
Website:
macOS/iOS:
Linux:
Android:
Windows:
openEuler:
UI:
Commit range
Commits from b10236 to b10255 (first 80)
2b63e06)4ed2b13)f2b52a8)0b14b87)9bd4c09)96278e3)563dec8)67d5978)c50b34a)39eab74)dbadb68)e8e06f7)99111b1)ee0445c)57c0921)fe2adf0)94bc47f)0ef6e55)66fa168)Web bridge review focus
Please pay extra attention to upstream changes touching:
Validation
Automation behavior
This PR is managed from the stable branch
automation/bump-llama-cpp. If another llama.cpp release appears before merge, the scheduled workflow updates this same PR instead of opening a duplicate. The workflow skips if a non-automation PR already changesllama_cpp.version.