Act on Your Behalf, Beyond Your Authorization: Benchmarking LLM Agent Authorization Alignment

Summary

AuthorizationBench is a benchmark of 286 executable tasks that tests whether LLM agents stay within the authorization a user grants, rather than only measuring task completion or harm. Across 6,864 trajectories in an authorization-aware sandbox, agents acted out of authorization in 19.2% of cases, and agents that consulted the principal before acting showed lower rates (14.0% versus 21.6%). Higher reasoning effort left the aggregate rate nearly unchanged.