AI Sec Watch

marimo (a Python notebook tool) before version 0.23.15 has a configuration injection vulnerability (a flaw where untrusted settings override safe ones) that lets notebook creators steal API keys. An attacker can hide a malicious base_url (the server address an AI request goes to) in notebook metadata, and when an operator opens the notebook and makes an AI request, marimo sends the operator's OpenAI API key to the attacker's server instead of the legitimate one, without requiring any code to actually run.

Flowise, a low-code platform for building AI applications, contains a sandbox escape vulnerability that allows attackers to achieve RCE (remote code execution, where an attacker can run commands on a system they don't own) through custom JavaScript execution. The vulnerability exploits a weakness in how Flowise uses the vm2 sandbox (a deprecated JavaScript isolation library) combined with a bypass of the CVE-2022-24785 patch in the moment library, which was supposed to prevent malicious file path access.

Flowise has a missing authorization bug in the `/api/v1/files` endpoint that allows any API key within an organization to list and delete files from other workspaces, even if that API key has no permission to access files. The endpoint only checks if files are enabled as a feature, but does not verify that the API key has permission to access files in that specific workspace, breaking the isolation between workspaces.

Flowise AI version 3.1.2 has a critical vulnerability where several database connection nodes (MySQL, PostgreSQL, SQLite, and Agent Memory components) allow users to set arbitrary options through an `additionalConfig` input that gets passed to TypeORM's DataSource class. Since TypeORM's DataSource options support loading local files as JavaScript code, an attacker can exploit this to achieve RCE (remote code execution, where an attacker can run commands on a system they don't own) by crafting malicious configuration options.

Flowise has a vulnerability where the OAuth2 token refresh endpoint is publicly accessible without authentication and makes server-side HTTP requests to attacker-controlled URLs without protections (SSRF, or server-side request forgery, where an attacker tricks a server into making requests on their behalf). This allows attackers to see the full response from their target server and steal sensitive OAuth2 secrets like client IDs and refresh tokens that get sent in the request body.

Flowise has an IDOR vulnerability (insecure direct object reference, where an attacker can access resources by guessing or changing object IDs) in its payment source endpoint that allows logged-in attackers to view other customers' sensitive data like email addresses and account balances by changing the customerId parameter in the URL. The flaw exists because the server checks only that a user is logged in, not whether they own the specific customer ID they're requesting.

Varonis announced Agent Intent-Based Access Control (IBAC), a security feature that monitors AI agents (autonomous programs that perform tasks with access to company data) to prevent them from acting outside their intended purpose. Agent IBAC compares what an agent was asked to do with its actual behavior and can block, alert, or quarantine the agent if it detects dangerous deviation, such as accessing tools or data it wasn't meant to use.

Researchers at Barracuda Networks demonstrated how attackers can exploit AI assistants built into email accounts to conduct sophisticated account hijacking attacks. In their proof of concept, attackers with a compromised lower-level email account used the AI chatbot to cover their tracks, gather intelligence about the organization, craft convincing phishing emails mimicking the compromised user's writing style, and ultimately hijack a CEO's account to authorize fraudulent wire transfers. The attack works because the resulting phishing emails come from legitimate accounts, bypass security filters, and match the expected communication patterns of trusted employees.

Zenity, an AI security company founded in 2021, has raised $125 million in funding to help organizations safely deploy AI agents (software programs that act autonomously on behalf of users) by monitoring their behavior and blocking harmful actions. The company's platform works across multiple AI systems like ChatGPT and Gemini, and its research division hunts for security vulnerabilities in agentic AI platforms, including zero-click attacks (exploits that require no user interaction to compromise a system). The new funding will support product development, expansion of security research, and growth into more global markets.