Skip to content

Support custom cache_control blocks with TTL configuration for Anthropic models #42

@jainaayush01

Description

@jainaayush01

Problem: Current implementation always strips existing cache_control and applies default ephemeral caching
Proposed Solution: Check for existing cache_control blocks and preserve them, with optional TTL config
Use Case: Advanced users want control over cache duration and which messages are cached
Compatibility: Maintains backward compatibility - defaults to current behavior

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions