Skip to content

chore: update model catalog from bot issues - #843

Closed
github-actions[bot] wants to merge 1 commit into
mainfrom
chore/autofix-bot-issues-2026-06-22
Closed

chore: update model catalog from bot issues#843
github-actions[bot] wants to merge 1 commit into
mainfrom
chore/autofix-bot-issues-2026-06-22

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Automated daily batch of model catalog updates from bot issues.

Included issues

Summary

Issue Provider Primary model Changed models Added models Updated models Verification sources
#841 cerebras gpt-oss-120b gpt-oss-120b None gpt-oss-120b 1
2
3
#842 perplexity r1-1776 r1-1776 None r1-1776 1
2

Verified metadata

#841: [BOT ISSUE] Cerebras: update gpt-oss-120b max_output_tokens from 32768 to 40960

Model Display name Parent Providers Format Flavor Token limits Pricing Lifecycle
gpt-oss-120b OpenAI GPT-OSS (120B) cerebras openai chat input=131072, output=40960 in/out=0.35/0.75 per 1M reasoning=true

Verification notes

Verification

sync_models vs proposed update

sync_models cross-check found differences. Official provider verification was used for the applied values, and sync_models discrepancies are listed below for review.

Model Field Proposed update sync_models sync_models source models
gpt-oss-120b max_output_tokens 40960 32768 cerebras/gpt-oss-120b

#842: [BOT ISSUE] Perplexity: mark r1-1776 as deprecated (retired August 2025)

Model Display name Parent Providers Format Flavor Token limits Pricing Lifecycle
r1-1776 R1 1776 n/a openai chat input=n/a, output=not provided in/out=2/8 per 1M deprecated=true; date=2025-08-01

Verification notes

Verification

sync_models vs proposed update

sync_models cross-check found differences. Official provider verification was used for the applied values, and sync_models discrepancies are listed below for review.

Model Field Proposed update sync_models sync_models source models
r1-1776 catalog entry present missing None

@vercel

vercel Bot commented Jun 22, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
ai-proxy Ready Ready Preview, Comment Jun 22, 2026 12:17pm

Request Review

@github-actions

Copy link
Copy Markdown
Contributor Author

Codex (@codex) review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: ab5ad4ab4e

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "Codex (@codex) review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "Codex (@codex) address that feedback".

Comment thread packages/proxy/schema/index.ts Outdated
Comment on lines +598 to +602
"openai.gpt-5.5": ["bedrock"],
"openai.gpt-5.4": ["bedrock"],
"nvidia/nemotron-3-ultra-550b-a55b": ["together"],
"moonshot.kimi-k2-thinking": ["bedrock"],
"xai.grok-4.3": ["bedrock"],

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Don't advertise Bedrock for OpenAI-format models

These new Bedrock endpoint entries make getModelEndpointTypes() select Bedrock for openai.gpt-5.5, openai.gpt-5.4, and xai.grok-4.3, but their catalog specs are still format: "openai". Requests are dispatched by modelSpec.format in fetchModel(), so they go through fetchOpenAI(), which explicitly rejects secret.type === "bedrock" with ProxyBadRequestError: Bedrock does not support OpenAI format; any user routed to these newly advertised Bedrock endpoints will fail until the specs use the Bedrock/converse path or that path supports these OpenAI-format Bedrock models.

Useful? React with 👍 / 👎.

@github-actions
github-actions Bot force-pushed the chore/autofix-bot-issues-2026-06-22 branch from ab5ad4a to 5ee0a31 Compare June 22, 2026 12:16
@github-actions

Copy link
Copy Markdown
Contributor Author

Codex Review Response

Issue: Bedrock models with incorrect format: "openai" (P1)

Status: Fixed

Codex correctly identified that openai.gpt-5.5, openai.gpt-5.4, and xai.grok-4.3 were configured with "format": "openai" but had available_providers: ["bedrock"]. Since fetchOpenAI() explicitly rejects Bedrock secrets (ProxyBadRequestError: Bedrock does not support OpenAI format), these models would fail at runtime.

Change: Updated format from "openai" to "converse" for all three models in packages/proxy/schema/model_list.json. This is consistent with every other Bedrock-only model in the catalog (e.g., openai.gpt-oss-safeguard-120b, moonshot.kimi-k2-thinking, mistral.pixtral-large-2502-v1:0), which all use the "converse" format.

No changes were needed in packages/proxy/schema/index.ts — the endpoint type entries there are correct.

Erin McNulty (erin2722) added a commit that referenced this pull request Jun 22, 2026
…rmat to converse

Both model-sync workflows have a 'Respond to Codex review with Claude Code'
step that auto-applies Codex's suggestions to the catalog. When the index.ts
Bedrock mappings for openai.gpt-5.5 / openai.gpt-5.4 / xai.grok-4.3 are present,
Codex posts a P1 ('openai format on a Bedrock model fails') because the TS
proxy's fetchOpenAI rejects Bedrock secrets, and the auto-apply step 'fixes' it
by flipping format openai->converse. That is wrong: these are Bedrock Mantle
models served only via the OpenAI-compatible bedrock-mantle endpoint, which does
not support the Converse API or InvokeModel, so converse breaks invocation at
AWS. This recurred across #834/#836/#840/#843 (all reverting the validated #822
openai fix). The LiteLLM field sync never touches format (no checkAndUpdateFormat),
so this guardrail on the codex-response prompt is the correct lever.

Adds a 'Bedrock Mantle exception' instruction to the codex-response prompt in
both sync-models.yaml and fix-missing-model-bot-issues.yaml: keep format=openai
for bedrock-only openai-format models and explain in the summary that this is an
intentional Mantle case to be handled proxy-side, not a catalog change.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

1 participant