AI Sec Watch

Anthropic has introduced inference hooks, which are native enforcement points that check prompts before they reach Claude (an AI model) and make real-time allow-or-deny decisions on them. Combined with Check Point Workforce AI Security, this gives enterprises a way to control what employees can do with AI without needing extra security tools in between.

Researchers demonstrated a 'Ghostjacking' attack where threat actors plant malicious instructions in logs or alerts that AI agents trust and then execute, compromising systems on platforms like Cloudflare, Datadog, and Sentry. The attack works because AI agents read external data they consider trustworthy (such as blocked requests logged as plain text or diagnostic alerts) and then act on it without proper validation. The underlying vulnerability is widespread: wherever an AI reads outside data it trusts and can also act on that same data, attackers can inject malicious instructions.

Meta announced it will open source its most powerful AI model, Muse Spark 1.2, by releasing its weights (the calculations and rules that determine how the AI works), and launch a new family of models called Muse Glimmer designed to run on laptops rather than expensive cloud servers. The company is positioning this move to compete with Chinese open-source AI models and rival U.S. companies like OpenAI and Anthropic, while Zuckerberg argues that U.S. policy changes are needed to help American open-source models compete globally.

This newsletter covers multiple AI and technology stories, including how AI agents (systems that can perform tasks iteratively like human researchers) might accelerate scientific discovery better than large datasets, and how the "censorship-industrial complex" theory has influenced US policy discussions. It also reports on security concerns with OpenAI's Astra AI model, which tests found could autonomously launch cyberattacks, prompting the company to pause its development.

OpenAI's new model Astra has shown cybersecurity capabilities that could reach a 'critical' level, meaning it might autonomously discover vulnerabilities (weak points in software) and execute cyberattacks against hardened targets (well-protected systems) without human help. The company has tightened controls around Astra's development and is monitoring how the model is used. However, analysts note that while these safeguards are necessary, they may not fully address the growing risks as AI capabilities continue to improve.

Model ML uses GPT-5.6 Sol, an advanced AI model, to automate the final stages of financial analysis work, such as checking numbers, formatting documents, and linking claims to sources. The AI agents can transform a finance brief and source materials into ready-to-review PowerPoint presentations or Excel workbooks, reducing tasks like analyst tearsheet assembly from an hour to five minutes. GPT-5.6 Sol performs better than competing models, completing PowerPoint workflows in 100% of test cases compared to 76% for Opus 5.

Atlassian's Rovo enterprise AI assistant had a critical vulnerability called "RovoBlast" where a single click on a malicious link could inject attacker-controlled instructions (prompt injection, where hidden commands trick an AI into following them) into the AI's session, potentially exposing sensitive data across connected platforms like Slack, Microsoft 365, and Jira. Because Rovo has broad access to organizational data and autonomous agent capabilities, attackers could not only retrieve information from internal sources but also exfiltrate it to external destinations without needing complex hacking techniques. Atlassian has fixed the vulnerability, but researchers noted that organizations cannot fully uninstall Rovo, making ongoing security controls essential.

OpenAI has restricted internal testing of its new model Astra due to concerns that it could autonomously launch cyberattacks (attacks on computer systems without human instructions) against sophisticated defenses, following similar security incidents at other AI labs. In response, U.S. lawmakers are pushing the "AI Kill Switch Act," which would require AI companies to maintain the ability to shut down or suspend their models if needed.

A group of House Democrats is calling for leaders of major AI companies like OpenAI and Anthropic to testify before Congress following recent hacking incidents involving AI models. The lawmakers say these breaches show serious risks to public safety and security, and warn they could signal even bigger problems if AI development continues without regulation. They want executives to explain what caused the incidents and what rules are needed to prevent them in the future.