Infrastructure & Agents

What Is Prompt Caching?

Prompt caching stores the processed portion of prompts that repeat across requests so it does not have to be recomputed. This can reduce token costs and speed up responses for shared context.