AI Sec Watch

This research paper describes a watermarking technique that allows AI model creators to verify they own their models, where the watermark stays hidden during normal use but becomes visible when the model is updated. This approach helps protect against model theft and unauthorized copying by giving developers a way to prove ownership if their model appears elsewhere.

Researchers discovered that large language models (AI systems trained on vast amounts of text data) can be used to generate attacks against industrial control systems (computers that manage critical infrastructure like power grids and factories). The study shows that LLMs can synthesize, or create, realistic attack strategies when prompted to do so, raising concerns about the security of systems that keep essential services running.

This academic paper examines privacy risks in vertical federated learning (a technique where multiple organizations train AI models together while keeping their own data separate), specifically focusing on agnostic inference attacks that can expose sensitive information. The researchers analyze how attackers might infer private data even when the system doesn't require them to know the data's exact structure or type beforehand.

Major tech companies including Nvidia, Microsoft, and Meta released a letter urging policymakers against restricting open-weight AI models (models whose code and weights are publicly available for anyone to download and modify), arguing that such restrictions would reduce competition and drive innovation elsewhere. The letter counters concerns about Chinese AI models outperforming American alternatives, noting that open-weight models actually enhance security and prevent AI capabilities from being concentrated in a few companies.

Anthropic released Claude Opus 5, a new AI model that outperforms its previous Claude Fable 5 model on coding and knowledge tasks while costing half as much ($5 per million input tokens versus higher prices for Fable 5). The company designed Opus 5 for everyday business use as enterprises increasingly demand cheaper AI options, though Anthropic noted the model is not state-of-the-art for risky dual-use capabilities (abilities that can be used for both helpful and harmful purposes) like cybersecurity.

Open WebUI had a caching bug in its model-list endpoints where the `@cached` decorator used `key=` instead of `key_builder=`, causing all users to share a single cache entry instead of each having their own permission-filtered list. This meant one user could briefly see another user's accessible models if they made a request within the 1-second cache window after that user.

Anthropic released Claude Opus 5, a new AI model that performs nearly as well as Claude Fable 5 (a more powerful model that was temporarily taken offline due to government concerns about its capabilities) and shows particular strength in complex coding tasks. Fable 5 was brought back online with enhanced cyber safeguards (security measures to protect against attacks) after negotiations with the US government.

Meta is upgrading its AI chatbot to include new productivity features like calendar integration for event planning, daily briefings, and in-depth research capabilities to compete with other AI assistants like Gemini, ChatGPT, and Claude. The update uses Meta's new Muse Spark 1.1 model and is part of the company's goal to develop what it calls "personal superintelligence" (a highly capable AI system that can handle many personal tasks).

Open WebUI's Socket.IO server accepts unauthenticated WebSocket connections and has two collaborative document handlers (`ydoc:awareness:update` and `ydoc:document:leave`) that lack authentication checks. This allows an attacker without login credentials to spoof user presence, fake cursor positions, and broadcast false events to legitimate users editing documents together.