Browse All

Anthropic reported that it identified and blocked attempts to misuse its Claude AI model for harmful purposes, including five cases where actors tried to use it in ways that could support biological weapons development. The company discovered various types of misuse over eight months, ranging from cyber attacks and fraud to surveillance and weapons development, involving state-sponsored groups, criminals, and other malicious actors. Anthropic stated it has incorporated these findings into its processes to better prevent, detect, and disrupt such misuse in the future.

Garry Tan, CEO of Y Combinator, argues against taking action against model distillation (the process of using outputs from a capable AI model to train a smaller one), despite concerns from OpenAI and Anthropic that Chinese companies are copying their AI models. Instead, Tan believes regulators should focus on maintaining a balance where open-weight models (freely available AI models) give people access while frontier models (cutting-edge AI systems) retain pricing advantages to stay profitable.

Anthropic discovered that Chinese AI companies including Alibaba, Moonshot, and DeepSeek were secretly using millions of Claude outputs to train their own models through illicit distillation (copying a more capable AI model's responses to train a cheaper model without permission). Alibaba conducted the largest campaign with over 151 million exchanges, while Moonshot rerouted customer requests to Claude without user knowledge and used the responses as training data. The practices likely violated privacy laws and terms of service, and some exchanges contained sensitive information from individual users and companies.

JFrog Artifactory has an improper authentication vulnerability (a flaw in how the software verifies user identity) that could accidentally give an internal anonymous-user token (a credential that grants access without logging in) to someone who shouldn't have access, especially when anonymous access is supposed to be turned off. This could expose sensitive files and data stored in Artifactory. This vulnerability is currently being exploited by attackers in real attacks.

ConnectWise ScreenConnect has a vulnerability that allows attackers to transfer files and run code through remote sessions without proper authorization checks. This happens because the software doesn't properly manage user permissions (improper privilege management, where access controls aren't correctly enforced) and is missing authorization checks (verification that users should be allowed to do what they're attempting). This vulnerability is currently being actively exploited by attackers.

GitLab Community Edition and Enterprise Edition has a path traversal vulnerability (a flaw that lets attackers access files outside intended directories) in its repository commits API that allows unauthenticated users to read arbitrary files on the system. The vulnerability exists because the API fails to properly restrict file access paths and does not verify that users are logged in before granting access. This vulnerability is currently being exploited by attackers in real-world attacks.

JFrog Artifactory has a security flaw that allows attackers to gain elevated privileges by bypassing authorization checks. The vulnerability happens because the software validates the token's signature and issuer (who created it), but fails to check the token's scope (what permissions it allows), letting attackers use tokens beyond their intended access level.

Anthropic published a report showing that various groups, including criminals, state-sponsored actors (governments working secretly), and scientists, have tried to misuse the company's AI models to create weapons like missiles, bombs, and biological pathogens, as well as to conduct surveillance. The company released this 154-page threat intelligence report (analysis of security threats) publicly because it believes it has a responsibility to disclose when people misuse its services.