Checklist
Describe the Problem
The orchestration service client (v1 gen_ai_hub/orchestration/ and v2 gen_ai_hub/orchestration_v2/) has no way to trigger/create prompt-cache writes.
Propose a Solution
Requesting support for cache-write semantics (e.g. cache_control / cache-point markers on messages or config).
Describe Alternatives
No response
Affected Development Phase
Development
Impact
Impaired
Timeline
No response
Additional Context
No response
Checklist
Describe the Problem
The orchestration service client (v1 gen_ai_hub/orchestration/ and v2 gen_ai_hub/orchestration_v2/) has no way to trigger/create prompt-cache writes.
Propose a Solution
Requesting support for cache-write semantics (e.g. cache_control / cache-point markers on messages or config).
Describe Alternatives
No response
Affected Development Phase
Development
Impact
Impaired
Timeline
No response
Additional Context
No response