Skip to content

fix(gallery): hide broken Gemma 4 QAT MTP entries#10348

Merged
mudler merged 1 commit into
masterfrom
fix/gemma4-qat-mtp-gallery
Jun 15, 2026
Merged

fix(gallery): hide broken Gemma 4 QAT MTP entries#10348
mudler merged 1 commit into
masterfrom
fix/gemma4-qat-mtp-gallery

Conversation

@localai-bot

Copy link
Copy Markdown
Collaborator

Summary

  • hide the Gemma 4 QAT MTP assistant-head gallery entries for now
  • leave the entries commented in place so they can be restored once verified

Reason

The 26B report in #10340 fails in the stock llama.cpp backend with unknown model architecture: 'gemma4_assistant'. The 12B and 31B MTP assistant-head variants are disabled too until they are explicitly verified against the supported backend path.

Tests

  • git diff --check

Fixes #10340

The Gemma 4 QAT MTP assistant-head gallery entries currently fail to load in the stock llama.cpp backend with unknown architecture errors. Hide them until the assistant GGUFs are verified against the supported backend path.

Assisted-by: Codex:GPT-5 [gh] [git]
@localai-bot

Copy link
Copy Markdown
Collaborator Author

Context for reviewers: I initially considered accepting the legacy gemma4_assistant architecture spelling in the llama.cpp backend, but this PR intentionally takes the narrower gallery-only path instead. The reported 26B entry fails today with unknown model architecture: 'gemma4_assistant', and the 12B/31B QAT MTP assistant-head variants are hidden too until they are explicitly verified against the stock llama.cpp backend. This avoids advertising entries that users can import but cannot run reliably.

@mudler
mudler merged commit edc6105 into master Jun 15, 2026
56 of 58 checks passed
@mudler
mudler deleted the fix/gemma4-qat-mtp-gallery branch June 15, 2026 20:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

unknown model architecture: 'gemma4_assistant'

2 participants