Combine Qwen hybrid prompt-cache fixes on current upstream - #3

Closed

Regrad wants to merge 73 commits into

fix/qwen-hybrid-cache-radical

Commits on Jun 2, 2026

Commits on Jun 3, 2026

arg : removed unecesary mmproj download when users pass --no-mmproj (#23425)
ryan-mangeno
authored
e366626
ci : disable ccache for msvc windows release jobs (#23911)
ggerganov
authored
4da6370
update BoringSSL to 0.20260526.0 (#23794)
cabelo
authored
d545a2a
tests : add support for qwen3 SSM archs (#24031)
ggerganov
authored
06938ac
cuda: reserve space for quantize kv-cache at startup (#23907)

am17an
and
JohannesGaessler
authored
f8f0a47
ggml-cpu: use runtime SVE width in FWHT (#24059)
chaxu01
authored
3571fa5
Avoid PDL race conditions by disabling __restrict__ when PDL is used (#24030)

aendk
and
ORippler
authored
9e58d4d
ui: Mermaid Diagrams in chat + interactive preview (#24032)
allozaur
authored
ee4cf70
mtmd, model: allow skip build_vit() (#24077)
ngxson
authored
a731805
mtmd: enable non-causal vision for gemma 4 unified (#24082)
ngxson
authored
c8d6a00
qwen35: use post-norm hidden state for MTP (#24025)
am17an
authored
166fe29
mtmd: fix Gemma 4 unified FPE (#24088)
abetlen
authored
94a220c

Commits on Jun 4, 2026

Commits on Jun 5, 2026

sycl : port multi-column MMVQ from CUDA backend (#21845)
masonmilby
authored
7fe2ae4
ci : build-msys job slimming [no ci] (#24157)
danbev
authored
46fa662
CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)
ORippler
authored
2154a0f
kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)
chaxu01
authored
3ecfb15
hparams : refactor `hparams.n_layer` (#24060)

ggerganov
and
CISC
authored
7acb4e8
minor : fix lint issues (#24165)
ggerganov
authored
59917d3
docs: Update quantization readme (#24133)

pcuenca
and
CISC
authored
ad1b88c
ui: add ignore-scripts=true to npmrc (#24149)
ngxson
authored
cc7bef3
Fix link to available UI settings (#24169)
wariuccio
authored
9c955c4
ui: run npm install when package-lock.json is newer than node_modules (#24171)
ServeurpersoCom
authored
2016bf2
model : fix llama_model::n_gpu_layers() (#24188)
ggerganov
authored
96fbe00
cli: fix model params not propagated (#23893)
therealkenc
authored
86591c7
TP: round up granularity to 128 (#24180)
JohannesGaessler
authored
6effcec
model, mtmd: Granite4 Vision (#23545)
gabe-l-hart
authored
64086f2
model: fix build failed (#24193)
ngxson
authored
c4a278d
vulkan: add fwht support for Intel with shmem reduction (#23964)
0cc4m
authored
e82beaa
common/chat : unify and fix LFM2/LFM2.5 tool parser (#24178)
tdakhran
authored
da87e9b
opencl: improve get_rows, cpy, concat and q6_k flat gemv (#24160)
lhez
authored
308f61c

Commits on Jun 6, 2026

Commits on Jun 7, 2026

docker : bump cuda13 to 13.3.0 (#24228)
CISC
authored
3f7c79d
convert : fix Gemma4 with no audio encoder (#24242)
CISC
authored
f71af35
arg: Skip mmproj download when user supplied mmproj (#24239)
konradmb
authored
465b1f0
spec : fix vocab compatibility check (#24256)
CISC
authored
8a091c4
llama : add Gemma4 MTP (#23398)
am17an
authored
04eb4c4
Merge current upstream master into Qwen hybrid cache work branch
Regrad
authored
cc7cb01
Merge prompt-cache no-consume fix
Regrad
authored
027026d