Prompt caching
Also called prompt cache
A model API feature that keeps a prompt's repeated opening section ready, so a later request that starts with the same prefix resumes from it instead of processing it again. It cuts processing time and cost when the same long instructions or files are sent on many calls.
See also
- Prompt
Input text supplied to a language model to condition its response, such as a question, instruction, example or text to continue.
Cite this term.
CC BY 4.0, attribution required.
This term
Orbyt Labs, Prompt caching (AI Glossary), Nov 14, 2026. https://
The dataset (JSON)
Orbyt Labs Glossaries (Nov 14, 2026), https://
Last updated .