04 · How Models Run
Prompt Caching
Reusing repeated input processing
A serving optimization that reuses computation for an unchanged prompt prefix, such as a long system prompt or document set. Provider rules determine eligibility, lifetime, price, and whether caching is automatic or explicit.
Concrete example
A support bot can reuse the processed handbook prefix across many questions instead of paying the full input cost each time.