Prompt caching

Reusing the processed form of a repeated prompt prefix so you are not charged full price for it again.

Applications usually send the same long system prompt on every call. Caching stores the processed prefix so subsequent calls skip most of that work, with cache reads priced at a small fraction of the base rate.

For anything with a stable system prompt or a long shared document, this changes the economics more than switching to a cheaper model would.