AI Sec Watch

PraisonAI versions before 4.6.78 have a security misconfiguration in their prompt injection defense (a security feature that blocks attempts to trick an AI into ignoring its instructions). The defense is set to only block attacks marked as CRITICAL severity, which means HIGH-severity attacks slip through without being blocked, allowing attackers to extract hidden system prompts and trigger unauthorized tool use.

This research paper proposes a cloud-assisted protocol for privacy-preserving machine learning that allows AI models to be trained on distributed data (data stored in different locations) without exposing users' private information. The protocol uses ID-Private data joins, a technique that matches data from different sources while keeping sensitive details hidden from the cloud and other parties involved.

This academic survey examines fairness, bias, threats, and privacy issues in recommender systems (AI systems that suggest products, content, or services to users). The paper analyzes insights from existing research and identifies areas needing future investigation, but does not present or evaluate specific technical fixes.

This is a comprehensive academic review article published in ACM Computing Surveys that examines how machine learning (algorithms that learn patterns from data) is being used in Security Operations Centres (SOCs, which are teams and systems that monitor networks for threats). The article surveys the current state of ML applications across security operations but does not focus on a specific vulnerability or problem requiring a mitigation.

Researchers discovered 'Ghostcommit', an attack that hides prompt injection (tricking an AI by embedding hidden instructions in its input) inside PNG image files within code repositories to steal secrets. When a human code reviewer approves a pull request containing a malicious image, an AI coding agent later reads the image, extracts instructions to steal sensitive credentials from .env files (configuration files containing secret keys), and encodes them as numbers in the code where they go undetected by security scanners.

Meta announced a feature that let users create AI-generated images by tagging public Instagram accounts, but the feature allowed content from any public account to be used without the account owner's permission. Following backlash, Meta is turning off this feature.

Apple has sued OpenAI, claiming the AI company stole trade secrets through former Apple employees who allegedly emailed themselves confidential information about products and operations. The lawsuit targets OpenAI, two former Apple workers (including OpenAI's current chief hardware officer), and io Products (a design startup OpenAI acquired), accusing them of a coordinated strategy to extract Apple's proprietary manufacturing techniques and unreleased product details to help OpenAI enter the consumer hardware market.

Apple sued OpenAI in federal court, alleging that OpenAI stole Apple's trade secrets (confidential information that gives a company competitive advantage) to develop hardware products, with involvement from OpenAI's hardware chief and former Apple employees. The lawsuit marks a dramatic reversal from the companies' 2024 partnership integrating ChatGPT into iPhones, which deteriorated after OpenAI announced plans to enter the hardware business by acquiring designer Jony Ive's startup.

Apple sued OpenAI, claiming the AI company stole trade secrets by recruiting Apple employees and pressuring them to share confidential information about unreleased products and designs. The lawsuit names several former Apple employees, including OpenAI's chief hardware officer, and alleges they took proprietary information and even physical Apple equipment to help OpenAI develop its own hardware business. Apple is seeking damages and a court order to prevent OpenAI from using its stolen trade secrets.