-
Notifications
You must be signed in to change notification settings - Fork 42
Feat/zoo gateway #229
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Feat/zoo gateway #229
Changes from all commits
4f77882
698ac9d
8dec8a9
835c0b8
f59f98f
7a032a5
0222517
62e662f
5dd8c89
af52468
bb35707
348fb02
8a96a15
3b6d780
71e0fbc
4c14d26
9d3966a
14f4771
a0e95cc
17f6467
8d86f55
24e0f75
c37a35f
cd30577
e1ee061
fe2e2ef
48521e6
8f03729
e5ae0b6
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,24 @@ | ||
| import type { ModelInfo } from "../model.js" | ||
|
|
||
| // Zoo Gateway uses the same model ID format as Vercel AI Gateway (provider/model-name) | ||
| export const zooGatewayDefaultModelId = "anthropic/claude-sonnet-4" | ||
|
|
||
| // Zoo Gateway serves the same models as Vercel AI Gateway, so prompt caching support is identical | ||
| // We reuse VERCEL_AI_GATEWAY_PROMPT_CACHING_MODELS from vercel-ai-gateway.ts | ||
| // Instead of duplicating, we just export a reference to indicate they're the same | ||
| export { VERCEL_AI_GATEWAY_PROMPT_CACHING_MODELS as ZOO_GATEWAY_PROMPT_CACHING_MODELS } from "./vercel-ai-gateway.js" | ||
|
|
||
| export const zooGatewayDefaultModelInfo: ModelInfo = { | ||
| maxTokens: 64000, | ||
| contextWindow: 200000, | ||
| supportsImages: true, | ||
| supportsPromptCache: true, | ||
| inputPrice: 3, | ||
| outputPrice: 15, | ||
| cacheWritesPrice: 3.75, | ||
| cacheReadsPrice: 0.3, | ||
| description: | ||
| "Claude Sonnet 4 significantly improves on Sonnet 3.7's industry-leading capabilities, excelling in coding with a state-of-the-art 72.7% on SWE-bench. The model balances performance and efficiency for internal and external use cases, with enhanced steerability for greater control over implementations.", | ||
| } | ||
|
|
||
| export const ZOO_GATEWAY_DEFAULT_TEMPERATURE = 0.7 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Revisit “unlimited retention” for account-linked telemetry.
Stating indefinite retention for authenticated Pro+ users is a compliance risk for data-minimization/retention-limitation requirements. Add a bounded retention policy (or explicit legal basis + deletion workflow/SLAs) in this section.
🤖 Prompt for AI Agents