Anthropic Warns Small AI Models Could Soon Form Self-Propagating IoT Botnets

Summary

Anthropic warns that small AI models may within months gain the ability to self-replicate across IoT devices such as smart ovens and off-brand Android TV boxes, forming self-propagating worm botnets that are hard to shut down. In testing 11 open-weights models, Anthropic found GLM-5.2 the only one to propagate Llama3.1-8B reliably to 8 of 8 nodes running the redroid Android emulator in 4 of 5 trials.

Related items

• InfoRedesigning source control at AnthropicSame vendor · Simon Willison's Weblog
• InfoAnthropic urges court in Washington, D.C. to rehear appeal of Pentagon blacklisting Same vendor · CNBC Technology
• LowAnthropic warns self-replicating AI could spread to your smart devicesSame vendor · BleepingComputer
• InfoAI in your oven? Anthropic warns models ‘months away’ from self-replication on smart devicesSame vendor · The Guardian Technology
• InfoAnthropic Finds Ingredients for Future AI WormsSame vendor · Dark Reading