feat(backend): add turboquant llama.cpp-fork backend - #9355

Merged

mudler merged 7 commits into

feat/turboquant-plus

Apr 14, 2026

Commits on Apr 14, 2026

feat(backend): add turboquant llama.cpp-fork backend
mudler
committed
60aca8f
feat(turboquant): carry upstream patches against fork API drift
mudler
committed
76d821d
docs: add turboquant backend section + clarify cache_type_k/v
mudler
committed
34cb648
feat(turboquant): patch ggml-rpc GGML_OP_COUNT assertion
mudler
committed
505be12
feat(turboquant): allow turbo* KV-cache types and exercise them in e2e
mudler
committed
9a76eca
fix(turboquant): rewrite patch-grpc-server.sh in awk, not python3
mudler
committed
bf041ad
Apply suggestion from @mudler
mudler
authored
505d627