New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature Request: Integrate Anthropic's New Prompt Caching #104

Open

stchakwdev opened this issue Aug 16, 2024 · 0 comments

stchakwdev commented Aug 16, 2024

We should consider incorporating Anthropic's new prompt caching feature into this project. This integration could offer several benefits:

Reduced costs: By caching prompts, we can potentially lower the overall API usage costs.
Improved latency: Cached prompts should result in faster response times for repeated or similar queries.
Enhanced "Agentic" capabilities: Anthropic claims this feature improves their model's ability to act as an agent. It would be interesting to explore how this affects Devon's performance and capabilities.

Implementing this feature could significantly enhance our project's efficiency and potentially expand its functionality.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment