chore: ⬆️ Update mudler/vllm.cpp to a42b8187caff02c570c28e19e4dc2b1d7f55ed14 - #11174
Conversation
f4363a0 to
2ff1496
Compare
e0b233df137adc15ca258093e617e28c0235420bf83c8065a7bc42e263e0fb4c301b3108a722c25d
2ff1496 to
568f7ec
Compare
f83c8065a7bc42e263e0fb4c301b3108a722c25d8a5edc3f5d885e1a8a96045cbfadddb70bb72d97
568f7ec to
fd8a068
Compare
8a5edc3f5d885e1a8a96045cbfadddb70bb72d97a10bd42855268251c3b6c2d4c0675382edde2e4e
|
@localai-org-maint-bot update the PR and bump the vllm.cpp pin, fix CI issues |
fd8a068 to
4d6b458
Compare
|
Updated and pushed at |
a10bd42855268251c3b6c2d4c0675382edde2e4e74d7bc803c51f2b7b8ea91a7e57f8b2745b3d9e9
f31ee52 to
502b84f
Compare
74d7bc803c51f2b7b8ea91a7e57f8b2745b3d9e9ca5c7adcb594beed9de2ffbe46667b3baed53c83
|
Resumed after the dependency bot advanced the branch to |
502b84f to
615bbe8
Compare
|
Resumed and fixed the actual Darwin failure. The two Local verification: vllm.cpp device-leakage suite 25/25, DSR baseline unchanged at 32, checkpoint/agent-record checks green; LocalAI vllm-cpp suite 21 passed / 12 real-model specs skipped, packaging shell syntax and Metal/CUDA Make dry-runs pass. Fresh Darwin CI is now the binding AppleClang verification. |
|
Resumed after the completed Darwin log exposed the remaining root cause. The two Fresh verification: the upstream regression passed red/green, the Voxtral translation unit passes GCC |
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
5c3478c to
b36e002
Compare
ca5c7adcb594beed9de2ffbe46667b3baed53c83a42b8187caff02c570c28e19e4dc2b1d7f55ed14
…#11386) The Go bindings mirror vllm.h by hand and refuse a library whose vllm_abi_version differs from what they were written against. Two automated pin bumps (#11174, #11352) moved VLLM_CPP_VERSION onto engines declaring ABI v10 while govllmcpp.go still mirrored v5, so every vllm-cpp image built since then panics at startup on every platform: panic: vllm-cpp: ABI mismatch: library reports v10, backend built against v5 Grow both PODs to the v10 layout: vllm_model_params gains speculative_config, enable_prefix_caching, max_num_batched_tokens, scheduling_policy, kv_transfer_config and enable_jump_forward (88 bytes), vllm_sampling_params gains the v8 logits-processor pair (136 bytes). The offsets in the specs come from offsetof() against the pinned header. All of the new fields are inert when zeroed, so the engine behaves exactly as it did under v5; the backend sets none of them. Nothing cross-checked the two files, which is why a blind pin bump could ship a backend that cannot load. The library build now runs abi-check first: it compares VLLM_ABI_VERSION in the fetched header against abiVersion in govllmcpp.go and fails the build naming both, instead of leaving the mismatch for a user's runtime. Fixes #11379 Assisted-by: Claude:claude-fable-5 golangci-lint Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
Changes: https://github.com/mudler/vllm.cpp/compare/9e1c9025ae61167a3335454d7cc0de6093c21845..a42b8187caff02c570c28e19e4dc2b1d7f55ed14