Skip to content

Add centralized model consistency checks - #974

Draft
vishxrad wants to merge 2 commits into
mainfrom
visharad/model-check
Draft

Add centralized model consistency checks#974
vishxrad wants to merge 2 commits into
mainfrom
visharad/model-check

Conversation

@vishxrad

Copy link
Copy Markdown
Contributor

Summary

  • add a central model policy for self-hosted OpenAI defaults and their bare, gateway, LangChain, and display-label forms
  • add pnpm models:sync to update managed references and pnpm models:check to detect drift without writing files
  • add unit coverage and a lightweight GitHub Actions consistency check
  • synchronize three existing outliers in the Vercel AI guide and self-hosted CLI template

Why

Model defaults are currently repeated across runnable examples, documentation, environment samples, and CLI templates. Updating the recommended model can leave some surfaces behind.

This introduces role-based synchronization rather than requiring every model in the repository to be identical. The initial policy covers self-hosted OpenAI examples and integration guides. OpenUI Cloud is explicitly excluded because its provider catalog and default-model policy are different.

Developer workflow

  1. Update config/model-policy.json.
  2. Run pnpm models:sync.
  3. Commit the generated changes.
  4. CI runs the equivalent of pnpm models:check and reports any files that are out of sync.

The script currently verifies 41 managed references and supports bare (gpt-5.5), gateway (openai/gpt-5.5), LangChain (openai:gpt-5.5), and display-label (GPT-5.5) forms.

Checks

  • node --test scripts/models/model-policy.test.mjs
  • pnpm models:check
  • Prettier check for all changed files
  • git diff --check

@vercel

vercel Bot commented Aug 13, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
openui-docs Ready Ready Preview Aug 13, 2026 12:10pm

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant