generated from amazon-archives/__template_Apache-2.0
-
Notifications
You must be signed in to change notification settings - Fork 625
Open
2 / 32 of 3 issues completedLabels
enhancementNew feature or requestNew feature or request
Description
Problem Statement
As a Strands user, I would like to be able to apply a caching strategy to my agent or model provider so that it applies some caching strategy to each request.
Proposed Solution
Add a cache_config parameter to the BedrockModelProvider, AnthropicModelProvider, and any other model provider that applies a caching strategy to the messages array.
Use Case
- Apply some default cache strategy to help reduce token usage in bedrock or other model providers
Alternatives Solutions
- Build in a caching strategy into the agent class
Additional Context
DayuanJiang and sagimedina1
Sub-issues
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request