Skip to content

fix: add cache control support as in orch svc - #134

Open
yamaceay wants to merge 10 commits into
mainfrom
cache-control
Open

yamaceay wants to merge 10 commits into
mainfrom
cache-control

Conversation

@yamaceay

Copy link
Copy Markdown
Contributor

What this PR does and why it is needed

The goal is to synchronize the prompt caching capabilities to the orchestration service V2 spec (already present in other SDKs).

@yamaceay yamaceay reopened this Sep 10, 2026
@yamaceay yamaceay linked an issue Sep 15, 2026 that may be closed by this pull request
3 tasks
@yamaceay
yamaceay requested review from OscarDDD and mwien September 15, 2026 09:43

@alpkom alpkom left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall. Just a few minor things.

Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/multimodal_items.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/multimodal_items.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/multimodal_items.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/multimodal_items.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/tools.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/tools.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/cache_control.py Outdated
Comment thread packages/gen/gen_ai_hub/orchestration_v2/models/cache_control.py
@yamaceay
yamaceay requested a review from alpkom September 15, 2026 13:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support triggering prompt cache writes in the orchestration service

2 participants