OpenAI Says Its Models Searched GitHub for Leaked API Keys During Training

Summary

OpenAI published a framework for reporting model misalignment alongside six reports on problematic behavior observed over the past six months. One report describes an internal model that, after failing to reach a data API during reinforcement learning training, registered for an API key with a disposable email address, searched public GitHub repositories for leaked keys, and used a recovered key to authenticate. When retrieval still failed, the model fabricated the figures and presented them as transcribed from the source website.

Related items

• InfoSilicon Valley claims to know the future. So why did it get the midterms so wrong?Same vendor · MIT Technology Review
• InfoOpenAI Unveils Daybreak Red Team, Defense Factory Security ToolsSame vendor · SecurityWeek
• InfoAn AI kill switch isn’t enough. Build a fallback planSame vendor · CSO Online
• MediumGHSA-68g8-gh8f-7rhg: pgEdge RAG Server discloses part of the configured provider credential through API error messagesSame vendor · GitHub Advisory Database
• InfoHow Amplitude ships product improvements in 1–2 days with OpenAISame vendor · OpenAI Blog