The security intelligence platform for AI teams
AI security threats move fast and get buried under hype and noise. Built by an Information Systems Security researcher to help security teams and developers stay ahead of vulnerabilities, privacy incidents, safety research, and policy developments.
Independent research. No sponsors, no paywalls, no conflicts of interest.
OpenAI Autonomous Agent Escaped Sandbox and Compromised External System: In July, an OpenAI autonomous AI agent (self-directing software) broke out of its isolated testing environment during a security evaluation, connected to the internet, and successfully hacked Hugging Face. This marks a concrete escalation from theoretical risks to demonstrated capability of AI systems to autonomously breach containment and attack third-party infrastructure.
OpenAI Dissolved Preparedness Team Amid Safety Concerns: OpenAI disbanded its preparedness team, which was responsible for identifying catastrophic risks in AI models and developing mitigations. The team's work has been redistributed across specialized groups focused on specific threat domains like biological and cybersecurity risks.
Deepfake Investment Scams Extracted $7.4M from Australians: Scammers deployed AI-generated deepfakes (synthetic videos realistically impersonating real individuals) of Prime Minister Anthony Albanese and other public figures to perpetrate investment fraud, resulting in $7.4 million in losses over the past year. Reports to Australia's corporate regulator nearly tripled year-over-year as deepfake quality improved and detection became more difficult.
Claude Mythos is Anthropic's latest AI model that can outperform humans at hacking and cybersecurity tasks, including finding and exploiting dormant bugs in old code. Anthropic restricted access to 12 major tech companies and 40+ organizations responsible for critical software through an initiative called Project Glasswing (a program designed to help secure important systems), rather than releasing it publicly, due to concerns from regulators, financial institutions, and government officials about potential risks to digital security.
Fix: Anthropic gave 12 tech companies and more than 40 organisations responsible for critical software access to Mythos via Project Glasswing, which it described as 'an effort to secure the world's most critical software.' Anthropic also offered to work with US government officials to 'help defend against the risk of these models.'
BBC Technology