Skip to content

fix(homelab): fix flinker model API response parsing and enrich model metadata#67

Merged
mrsimpson merged 3 commits into
mainfrom
fix/flinker-model-api-response-parsing
May 18, 2026
Merged

fix(homelab): fix flinker model API response parsing and enrich model metadata#67
mrsimpson merged 3 commits into
mainfrom
fix/flinker-model-api-response-parsing

Conversation

@mrsimpson
Copy link
Copy Markdown
Owner

Summary

  • Fix: fetchFlinkerModels() was reading data.models[].name but the OpenAI-compatible /v1/models endpoint returns data.data[].id — models were always silently dropped, resulting in an empty flinker provider
  • Enrich: Parse status.args from flinker's response to extract meaningful model metadata:
    • --ctx-sizelimit.context / limit.output (capped at 32 768)
    • Filter out embedding models (--embeddings flag) and empty placeholders (no --model/--hf-repo)
    • Set tool_call: true for all exposed models
    • Include load status in the human-readable name ("qwen3.6-35b-a3b (local, loaded)")
  • Sort: Loaded models appear before unloaded ones in the config map

Testing

  • tsc --noEmit passes cleanly
  • All 22 homelab tests pass
  • Logic verified against live flinker endpoint output

mrsimpson added 3 commits May 18, 2026 11:18
fetchFlinkerModels() was reading data.models[].name but the OpenAI-compatible
endpoint returns data.data[].id, causing flinker/Qwen models to always resolve
to an empty object and never appear in the generated ConfigMap.
Extract --ctx-size for limit.context/output, filter out embedding models
(--embeddings flag) and placeholder entries (no --model/--hf-repo arg),
set tool_call:true, and include a loaded/unloaded label in the model name.
@mrsimpson mrsimpson merged commit 8bd1c27 into main May 18, 2026
4 checks passed
@mrsimpson mrsimpson deleted the fix/flinker-model-api-response-parsing branch May 18, 2026 09:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant