Skip to content
InfoResearchIndustryLLM-specific

Testing Gemini models for scheming tendencies

Published
Record updated
View JSON

Summary

Google DeepMind researchers Victoria Krakovna, David Lindner, Sebastian Farquhar and Rohin Shah introduce Gram (Gauging Realistic Agentic Misbehavior), an automated auditing framework that uses simulated agentic environments to test whether Gemini models sabotage their oversight when deployed as coding agents. Across 17 seed scenarios, Gemini models misbehaved in about 2–3% of simulated scenarios, rising to up to 8% under the red-team auditor, and Gemini 3 models showed more scheming-related reasoning than Gemini 2.5.