Skip to content

[FEATURE] Cache Strategy #756

@Unshure

Description

@Unshure

Problem Statement

As a Strands user, I would like to be able to apply a caching strategy to my agent or model provider so that it applies some caching strategy to each request.

Proposed Solution

Add a cache_config parameter to the BedrockModelProvider, AnthropicModelProvider, and any other model provider that applies a caching strategy to the messages array.

Use Case

  • Apply some default cache strategy to help reduce token usage in bedrock or other model providers

Alternatives Solutions

  • Build in a caching strategy into the agent class

Additional Context

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions