Skip to content
InfoNewsLLM-specific

Better prompt caching for GPT-6

Published
Record updated
View JSON

Summary

OpenAI has launched an improved prompt caching system for its GPT-6 family, which delivers higher cache hit rates by default and offers discounts of up to 90% on cached input tokens for eligible shared prefixes reused within a 30-minute window. The update adds a Prompt Caching Dashboard for tracking hit rates, a diagnostics tool for investigating unexpected cache misses, and controls such as explicit cache breakpoints and prewarming.