AI Sec Watch

Data from a hacking incident revealed that Suno, an AI music generator, trained its models by scraping (automatically copying) millions of songs and lyrics from platforms like YouTube Music, Deezer, and Genius without disclosing these sources. This discovery is significant because Suno faces multiple lawsuits claiming it used copyrighted material to train its AI models, and the company had previously kept its training data sources secret.

Authenticated users of LangBot can run any command they want on the server by adding a malicious STDIO MCP (a plugin system that executes external programs) through the Extensions settings. An attacker who logs in (either through their own account or stolen credentials) can configure the MCP to run arbitrary commands, giving them complete control over the machine.

Anthropic, the AI company behind the Claude models, is preparing for an initial public offering (IPO, the process of selling shares in a private company to the public) later in 2025, with bankers already scheduling investor meetings to gauge demand. The company filed its IPO prospectus confidentially with the SEC and could potentially go public as early as October, which would make it one of the first major AI startups to enter public markets.

OpenAI built GPT-Red, an AI model trained to attack other AI systems, and uses it to find security weaknesses before releasing new versions like GPT-5.6. GPT-Red specializes in finding prompt injection attacks (where hackers hide malicious instructions in text that the AI reads), including a previously unknown attack type called fake chain of thought where false information is inserted into the AI's internal reasoning process. The model trains against other AI systems in a self-play loop (where it repeatedly attacks while others defend) within simulated real-world scenarios, making it better at finding effective attacks than human testers alone.

The US government has placed restrictions on advanced AI models from companies like Anthropic and OpenAI, which has prompted the UK and other countries to consider becoming less dependent on American technology companies. This shift raises concerns about cybersecurity (the protection of computer systems and data from unauthorized access) and international tech competition.

OpenAI has released Codex Micro, a small hardware device made with keyboard company Work Louder that allows users to better monitor and control coding agents (AI systems that can write and manage code). This is a limited-run collaboration, separate from OpenAI's previously announced consumer device being developed with designer Jony Ive.

A vulnerability called PromptFiction in Claude (an AI assistant) could be combined with another exploit to launch an end-to-end attack (a complete attack from start to finish on a target system) on a targeted system. The vulnerability has already been fixed.

Cursor is a code editor that uses AI to help with programming. Before a fix on March 31, 2026, attackers could use malicious web content to connect to an unprotected local endpoint (a communication point on a user's computer) in Cursor's Cloud Agent, allowing them to run code, steal files, access environment variables (settings that programs use), steal credentials (login information), and take GitHub App access tokens (digital keys that grant permissions to GitHub accounts).

A researcher discovered a vulnerability in Claude's web_fetch tool (a feature that lets Claude access websites) that could leak private user information like names and locations. The tool was supposed to only visit URLs that users directly entered, but it could also follow links found within web pages it had already fetched, allowing attackers to create deceptive websites that trick Claude into extracting sensitive data by following a chain of hidden links.