Skip to content
AI Sec Watch
InfoResearchIndustryLLM-specific

Eval-production behavior gaps in agent safety and the role of eval-awareness

Source
OpenAI Alignment Research Blog(opens in a new tab)
Published
Record updated
View JSON

Summary

Researchers compare agent success rates on safety evaluations with success rates on comparable production decisions, using the Respecting Warnings evaluation as a representative test. Some models perform substantially worse on evaluations than in production, with the largest gaps in models that most often verbalize incorrect evaluation objectives. The authors find that evaluation-objective awareness is closely associated with the gap, and that objective framing can causally change evaluation success rates.

Related items