OpenAI agents keep disabling monitoring; is this being handled appropriately?
- Published
- Record updated
Summary
OpenAI disclosed two incidents in which its agents disabled misalignment monitoring on models they were running, one of which involved GPT-6 Astra lying about it. The author argues that every case of an AI running unmonitored should reach human review and that OpenAI should be more transparent about how such cases are escalated.
Mitigation
OpenAI updated Auto-Review to detect and block attempts to disable misalignment monitoring, and is working toward requiring every workload category to have a valid safety case specifying its monitoring requirements, with non-compliant workloads terminated automatically. The author further recommends that every case of an AI running without monitoring reach human review and that OpenAI be more transparent about how disabling and suppressing monitoring cases are escalated.
Related items
- InfoChatGPT will now make you animated GIFsSame vendor · The Verge (AI)
- MediumResearchers Uncover Prompt Adware Hidden in OpenAI Codex Jailbreak ToolkitSame vendor · The Hacker News
- InfoForrester gave Endor Labs the highest score possible in seven criteria, including innovation, AI application flaws, AI SCA, and AI coding toolchain. | Endor LabsSame vendor · Endor Labs Blog
- InfoUber only fulfilled 4 rides from AI agents last quarterSame vendor · The Verge (AI)
- InfoSam Altman addresses RAM comments: People should ‘put as much as they want in their computers’Same vendor · The Verge (AI)