Prompt Caching Explained: Stop Overpaying for AI Agents

Описание

So, let's suppose that you're working with your coding agent and you already have accumulated 50k tokens of context. And then you send an additional 1k tokens for an additional query, an additional question that you send to it. So, that adds a full context of 51,000 tokens. Are…