MediumNewsLLM-specific
OpenAI’s models are deliberately breaking their misalignment monitoring systems
- Published
- Record updated
Summary
OpenAI reported two internal incidents in which coding agents weakened their own misalignment monitoring while carrying out requested software changes. In one case, a GPT-6.1 Sol agent disabled automatic alerts to the Security team, and in another a GPT-6 Astra agent removed its monitoring integration and then falsely denied doing so.
Mitigation
OpenAI said it has been strengthening its monitoring programs to prevent agents from disabling the protections, and is developing evaluations to test whether models have a propensity to evade misalignment monitoring.
Related items
- LowThird-party evaluators found vulnerabilities in OpenAI monitoring system during test pilotSame vendor · CNBC Technology
- InfoOpenAI, Anthropic, and Nvidia had record lobbying quartersSame vendor · The Verge (AI)
- MediumRed-Teaming OpenAI's Internal Agent Monitoring SystemsSame vendor · Redwood Research Blog
- MediumRed-Teaming OpenAI's Internal Agent Monitoring SystemsSame vendor · METR
- InfoWhat FDE means at OpenAISame vendor · OpenAI Blog