AWS Continuum sets a new standard in autonomous code security

Summary

AWS Continuum for code vulnerabilities reached an 89.0% end-to-end success rate on CyberGym-E2E, passing 819 of 920 tasks within the 90-minute limit. That result is 23.1 percentage points above the previous public high of 65.9%. The benchmark asks an agent to find a vulnerability in a real open-source codebase, demonstrate it, and repair it without breaking the project's tests.

Related items

• InfoHow to keep AI agents within their permissionsSame vendor · BleepingComputer
• Medium'AgentCorruption' Puts AWS Environments At Risk With Single PromptSame vendor · Dark Reading
• InfoSpaceXAI backs Omarchy, the controversial Linux distro, with $1.5 million in computeSame vendor · The Verge (AI)
• MediumAWS’s repeated problems with AI agent controls illustrates the autonomous agent dilemmaSame vendor · CSO Online
• InfoAWS takes aim at runaway AI agent behavior with Strands BoxSame vendor · CSO Online