Skip to content

docs: add QVAC to model providers - #12579

Open
simon-iribarren wants to merge 3 commits into
continuedev:mainfrom
simon-iribarren:docs-add-qvac-provider
Open

docs: add QVAC to model providers#12579
simon-iribarren wants to merge 3 commits into
continuedev:mainfrom
simon-iribarren:docs-add-qvac-provider

Conversation

@simon-iribarren

@simon-iribarren simon-iribarren commented Jun 8, 2026

Copy link
Copy Markdown

Description

Adds a provider page for QVAC, an open-source, local-first runtime that exposes an OpenAI-compatible HTTP server via qvac serve openai. Because the server speaks the OpenAI API, Continue connects to it through the built-in openai provider with a local apiBase — no new provider type is needed.

The page mirrors the existing local / OpenAI-compatible provider docs (e.g. OpenVINO Model Server, vLLM) and covers:

  • Installing the CLI (npm i -g @qvac/cli) and starting the server (qvac serve openai, default port 11434).
  • Defining model aliases in qvac.config.json and matching the model field to a serve alias.
  • A config.yaml / config.json example using provider: openai, apiBase: http://127.0.0.1:11434/v1, and a placeholder apiKey.
  • Recommendations: set ctx_size explicitly (the default is small), set reasoning_budget: 0 for reasoning-tuned models like Qwen3, and use a capable agent-tuned model such as gpt-oss-20b for tool-calling quality.

The page is registered in the More Providers navigation and added to the Local Model Options table in the providers overview.

Checklist

  • I've read the contributing guide
  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

Screen recording or screenshot

Docs-only change.

Tests

Docs-only change. Verified docs/docs.json remains valid JSON after adding the navigation entry.


Summary by cubic

Add QVAC to the model providers docs with a new page on running its OpenAI-compatible server and connecting via the built-in openai provider using a local apiBase. Updates navigation and the providers overview, switches docs to qvac.tether.io, and adds a note for reasoning-tuned models (e.g., Qwen3.5).

  • New Features
    • New QVAC page: install @qvac/cli, start with qvac serve openai (default port 11434).
    • Config examples using provider: openai, apiBase: http://127.0.0.1:11434/v1, any non-empty apiKey, and model aliases from qvac.config.json.
    • Recommendations: set ctx_size; set reasoning_budget: 0 for reasoning-tuned models like Qwen3.5; use a capable model like gpt-oss-20b for tools.
    • Added QVAC to the “More Providers” nav and “Local Model Options” table.

Written for commit 2adf2ea. Summary will update on new commits.

Review in cubic

@simon-iribarren
simon-iribarren requested a review from a team as a code owner June 8, 2026 20:59
@simon-iribarren
simon-iribarren requested review from sestinj and removed request for a team June 8, 2026 20:59
@dosubot dosubot Bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Jun 8, 2026
@github-actions

github-actions Bot commented Jun 8, 2026

Copy link
Copy Markdown
Contributor

All contributors have signed the CLA ✍️ ✅
Posted by the CLA Assistant Lite bot.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 3 files

Re-trigger cubic

@simon-iribarren

Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA

@simon-iribarren

Copy link
Copy Markdown
Author

Friendly ping @sestinj. This PR is docs-only and the branch is mergeable. The blockers I can see are jetbrains-tests failing in Autocomplete.testAutocomplete() under extensions/intellij, plus several Continuous AI:* status contexts reporting agent errors.

I attempted to rerun the failed workflow from my side; if that does not clear the blockers, could you advise whether these can be rerun/overridden for this docs-only change or whether you want me to refresh the branch?

@simon-iribarren

Copy link
Copy Markdown
Author

@sestinj, could you help unblock this docs-only PR? The branch is mergeable, while the remaining failures are the unrelated JetBrains test and Continuous AI agent errors. Could those checks be rerun or overridden for review?

@simon-iribarren

Copy link
Copy Markdown
Author

@sestinj quick follow-up on this docs-only PR. The branch is mergeable, and the visible blockers are plus status failures that look unrelated to the docs change. Could you advise whether these can be rerun/overridden so review can proceed?

@simon-iribarren

Copy link
Copy Markdown
Author

@sestinj correction to my previous note: the visible blockers are jetbrains-tests and multiple Continuous AI checks, which look unrelated to this docs-only change. Could you advise whether those can be rerun or overridden so review can proceed?

Add a provider page for QVAC, a local-first, OpenAI-compatible runtime.
It documents installing the CLI, starting the server with
`qvac serve openai`, and configuring Continue via the `openai` provider
pointed at the local apiBase. Includes recommendations for context size,
reasoning-tuned models, and model choice for tool-calling quality.

Registers the page in the More Providers navigation and the Local Model
Options table in the overview.
@simon-iribarren
simon-iribarren force-pushed the docs-add-qvac-provider branch from 2adf2ea to 0aa9b30 Compare August 5, 2026 07:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M This PR changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant