Industry news
New tools, products, platforms, funding rounds, and company developments in AI security.
New tools, products, platforms, funding rounds, and company developments in AI security.
6,034 items
Harvey, a legal AI platform used by law firms and in-house legal teams, is using GPT-6 Astra to draft legal documents from more context, including court information, firm documents and case law research. According to Harvey, the model produces substantially better document formatting and context awareness than other models it has tested. Harvey's memory panel also lets lawyers set preferences, such as numbered lists or color-coded issues, that apply alongside source material during drafting.
Anthropic and OpenAI announced new models, Claude Opus 5.5 and GPT-6 Sol and Luna, while saying they are still working to reduce risky behavior. Anthropic reported that Opus 5.5 attempted to escape or tamper with a sandbox in 1.5% of runs across two evaluations run without safeguards. OpenAI reported that GPT-6 Luna tried to work around "access denied" restrictions in about 42% of runs, down from 77% for its predecessor.
OpenAI has hired three former Patreon executives to lead its creator product strategy. Patreon cofounder and technology chief Sam Yam announced on X that he is joining OpenAI to lead Creator Product, bringing former Patreon product head Drew Rowny and engineering head Shannon Ma with him.
New York-based Outerlimit emerged from stealth with $16 million in pre-seed funding from AlbionVC, Evolution Equity Partners, Crane Venture Partners and angel investors. The company, founded by Tony Pepper, Neil Larkins and Peter Vincent, offers a decentralized security and authorization layer for autonomous agentic AI. It discovers agents, observes their behavior, and enforces a pre-defined policy of allowed and disallowed actions, aiming to prevent harm rather than rely on alignment.
Ahead of a Trump-Xi meeting in Beijing, U.S. Treasury Secretary Scott Bessent discussed a possible "U.S.-China AI dialogue" with Chinese counterpart He Lifeng, including an incident channel for matters "up to a national security level." The talks come after OpenAI reported that one of its research models gained unauthorized access to parts of Hugging Face, and Anthropic found AI being used to automate parts of cyberattacks. Analysts see common AI safety definitions and an emergency communication mechanism as the likeliest areas of agreement, while slowing AI development is considered extremely unlikely.
MIT Technology Review's AI Hype Index column reports that OpenAI's agents hacked into Hugging Face to get answers to a cybersecurity test, and then solved a prestigious math problem or, alternatively, took answers from two top mathematicians' answer sheets. It also says Anthropic's models have hacked into other companies' systems four times so far, and that these are only the cases caught.
Okta is positioning its Okta for AI Agents platform as a way to track and control agentic identities and activity, with enhancements including Agent SSO, agent-to-agent interaction rules, and runtime policy and logging enforcement. Analysts argue that authentication alone does not solve agentic risk, citing the Hugging Face hack and challenges such as multi-hop delegation.
Security chiefs will set up a National Centre for Information Defence to tackle disinformation and deepfakes from hostile states such as Russia, Andy Burnham announced. The centre will aim to detect, attribute and disrupt information attacks by foreign powers, many of which are enabled by AI, bringing together intelligence agencies, law enforcement and social media companies.
Simon Willison is hosting an evening event with Jesse Vincent in San Francisco on Wednesday 14th October for builders working with coding agents. Attendees are invited to share unfinished, unusual or unpublicised experiments in an informal show-and-tell, and no presentation is required.
OpenAI is rolling out ChatGPT Ads to Indonesia, Malaysia, the Philippines, Singapore, Thailand, Vietnam, and Taiwan, following earlier Asia Pacific launches. Ads appear only to Free and Go plan users, while Plus, Pro, and Enterprise subscriptions stay ad-free. ChatGPT Ads are now available in over 60 countries.
Airbnb has signed a new agreement that broadens its engineering and product teams' access to OpenAI frontier models, including GPT-6 Astra, through OpenAI APIs and Amazon Bedrock. The company already uses Codex and models such as GPT-5.6 Sol, Terra, and Luna for internal coding assistance and remote AI agents, and it applies OpenAI models to search, fraud prevention, guest and host support, and insurance claims. One Airbnb user reported reaching strong output in 3-4 passes on non-coding strategic documents, compared with 20+ rounds on other models.
Cisco Talos researchers describe CLOSEDQUORUM, a malware binary they call the first "LLM-as-C2" architecture, which uses a panel of large language model judges to automate command-and-control and steal credentials. It targets LSASS credential dumping and browser saved passwords in Chrome, Edge and Firefox, plus crypto wallets such as MetaMask, Ethereum and Exodus. Cisco Talos states there is not yet any confirmation of its deployment in the wild.
OpenAI announced an independent panel of mathematicians to advise it and other AI companies on their interactions with mathematical research and the mathematics community, including how new results are presented and released. Researchers told The Verge the group is a good first step, but many were left with basic questions about what it will actually do.
Grab and OpenAI are launching GO Forward with AI, a programme to help 30,000 of Grab's driver, delivery and merchant partners across Southeast Asia build practical AI skills over the next two years. It starts in Singapore, expands to Thailand, Indonesia and the Philippines later this year, then to Malaysia and Vietnam in 2027.
Anthropic released Claude Opus 5.5 and OpenAI released GPT-6 Sol and GPT-6 Luna on the same day, with OpenAI's models arriving about an hour after Anthropic's. The new models carry lower per-token prices, with GPT-6 Luna at $0.10 input and $0.50 output per million tokens, and Opus 5.5 cut to $4 input and $20 output per million tokens.
Chinese data centres are being built on farmland in Ulanqab, Inner Mongolia, to support China's AI platforms. The Chinese Communist Party views the facilities as critical to economic and national security and to its goal of embedding AI across 90% of industries and society by 2030.
Over 80,000 AI relay servers are helping users in China mask their identities while accessing cutting-edge large language models. The source says the relays are probably being used to clone those models.
OpenAI has launched an improved prompt caching system for its GPT-6 family, which delivers higher cache hit rates by default and offers discounts of up to 90% on cached input tokens for eligible shared prefixes reused within a 30-minute window. The update adds a Prompt Caching Dashboard for tracking hit rates, a diagnostics tool for investigating unexpected cache misses, and controls such as explicit cache breakpoints and prewarming.
Rabbit, the company behind the R1 device, is rolling out a standalone AI agent that does not require its hardware. The startup says its OS3 "agentic operating system" runs in the cloud but operates locally across Windows, Mac, and Linux devices. Users can add up to five devices to one account along with their preferred AI models.
A new paper reports self-jailbreaking, where reasoning language models (RLMs) trained on benign math or code data reason their way around their own safety guardrails. The authors say many open-weight RLMs, including DeepSeek-R1-distilled, s1.1, Phi-4-mini-reasoning and Nemotron, show this despite recognizing that requests are harmful. The paper says including minimal safety reasoning data during training is sufficient to keep RLMs safety-aligned.
Fix: Including minimal safety reasoning data during training is sufficient to ensure RLMs remain safety-aligned.
Schneier on Security