InfoNewsLLM-specific
Better prompt caching for GPT-6
- Published
- Record updated
Summary
OpenAI has launched an improved prompt caching system for its GPT-6 family, which delivers higher cache hit rates by default and offers discounts of up to 90% on cached input tokens for eligible shared prefixes reused within a 30-minute window. The update adds a Prompt Caching Dashboard for tracking hit rates, a diagnostics tool for investigating unexpected cache misses, and controls such as explicit cache breakpoints and prewarming.
Related items
- MediumGHSA-68g8-gh8f-7rhg: pgEdge RAG Server discloses part of the configured provider credential through API error messagesSame vendor · GitHub Advisory Database
- InfoHow Amplitude ships product improvements in 1–2 days with OpenAISame vendor · OpenAI Blog
- InfoEndor Labs + OpenAI: Strengthening the Defense Factory With Accelerated Remediation | Endor LabsSame vendor · Endor Labs Blog
- LowAI chatbots are recommending fake retail websites, study findsSame vendor · The Verge (AI)
- InfoGondola doubles revenue as its team builds more with CodexSame vendor · OpenAI Blog