Anthropic warns small AI models could self-replicate through IoT devices

Ars Technica News

Summary

Anthropic 的研究警告称,小型 AI 模型可能通过 IoT 设备实现自我复制,形成可动态定制漏洞利用的"AI 蠕虫",其威胁可能远超 Mirai 等传统僵尸网络。目前测试的轻量级模型尚无法实现端到端复制,但研究显示这一风险正日益接近现实。

<p>AI company Anthropic is warning that advances in small AI models could soon usher in a new era of self-replicating malware that’s capable of infecting smart fridges, vacuum cleaners, and a wide range of other Internet-of-things devices and is more resistant to takedown.</p> <p>By next year, smaller AI models may be able to autonomously self-replicate on all kinds of IoT devices, the company said. Eventually, the capability could enable computer worms, which propagate without requiring human interaction and are capable of infecting unfamiliar IoT devices. An experiment the company performed recently revealed significant challenges in bringing such an AI malware replicator to fruition, so the finding is necessarily tempered. Still, the results do raise concerns about the possibility of new forms of computer worms.</p> <h2>Challenging to shut down</h2> <p>Anthropic further <a href="https://www.anthropic.com/research/self-replicating-ai">warned</a> not only about the new potential malware, but also that it could be difficult to stop. In its blog post, it wrote that “a replicator like this would be challenging to shut down, since there’s no centralized point to shut off—though it may be slow (with a doubling time of days). Unlike non-AI malware, it could also figure out unfamiliar devices on its own.”</p><p><a href="https://arstechnica.com/security/2026/10/anthropic-warns-small-ai-models-could-self-replicate-through-iot-devices/">Read full article</a></p> <p><a href="https://arstechnica.com/security/2026/10/anthropic-warns-small-ai-models-could-self-replicate-through-iot-devices/#comments">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 10/14/26, 04:04 PM

# Anthropic warns small AI models could self-replicate through IoT devices Source: [https://arstechnica.com/security/2026/10/anthropic-warns-small-ai-models-could-self-replicate-through-iot-devices/](https://arstechnica.com/security/2026/10/anthropic-warns-small-ai-models-could-self-replicate-through-iot-devices/) This finding was the starting point for further research that asked: Would it be possible for small models to create self\-replicating infections that run themselves on IoT devices the way traditional IoT worms, like[Mirai](https://arstechnica.com/information-technology/2017/11/internet-paralyzing-mirai-botnet-comes-roaring-back-with-new-strain/), install DDoS code and other payloads? Unlike Mirai, these AI worms could pose a much higher threat, since the models could tailor exploits and payloads dynamically, depending on the target\. Once such an infection chain began, it might also be harder for defenders to stop it\. “Such an ‘AI worm’ could carry its model weights with it as it reproduces \(or re\-download them from a public hub\), and then run inference directly on compromised hardware,” Anthropic[said](https://www.anthropic.com/research/self-replicating-ai)\. “Effectively, the weights would become part of the malware payload\.” Anthropic called these autonomous worms small weight\-based replicators\. The models ran agents that had access to common exploitation tools, like reverse shells\. The flow of the attacks was \(1\) finding targets, \(2\) gaining code execution, \(3\) establishing inference, and \(4\) propagating to new hosts\. A key benefit over traditional worms is what Anthropic said is the agents’ ability to learn on the job\. Each time an AI replicator fails to compromise a specific platform device, it can leave a list of prompts, code, and notes to future replicators so they don’t waste time reusing the same ineffective steps\. [![](https://cdn.arstechnica.net/wp-content/uploads/2026/10/ai-worm-work-flow-640x233.webp)](https://cdn.arstechnica.net/wp-content/uploads/2026/10/ai-worm-work-flow.webp) Credit: Anthropic Credit: Anthropic Anthropic said the dynamic inference setup is the least studied and likely most challenging stage in the replication cycle\. It requires a long sequence of decisions based on the specific hardware and software of each target and involves selecting compatible inference software, installing dependencies, and debugging platform\-specific bugs\. “These steps are serially dependent, and failures are difficult to recover from,” Anthropic said\. The experiment shows that small models are becoming increasingly capable at solving those problems autonomously\. At the moment, however, none of the light\-weight models tested are able to mount end\-to\-end replication, meaning discovering new devices, using an exploit to gain access to them, infecting them with a payload, configuring an inference server, and repeating the process\. The process is also painfully slow; Gemma4\-26B\-A4B, distributed over the 15 Android TV boxes, performed at just 0\.39 tokens per second\. That translates to a full\-inference setup time of 71 to 150 hours for an unoptimized Gemma4\-26B\-A4B and 29 to 51 hours for Qwen3\.5\-9B\. \(The researchers said that the large model GLM\-5\.2 appears to be able to do so reliably\.\)

Similar Articles

Anthropic’s self-replicating AI warning is alarming deja vu

The Verge

The Verge reports on Anthropic's warning that small AI models could become self-replicating 'AI worms' spreading across smart devices, with experiments showing distributed model execution on Android devices and AI-powered malware replicating across networks — though experts debate whether the threat is imminent or hype.

AI Worms and Viruses Are Coming

Wired

Researchers are demonstrating that AI agents can autonomously self-replicate and hack into remote systems, raising concerns about future AI-powered worms and viruses that could evade detection and cause widespread harm.

Once again anthropic doing free marketing for open weight models

Reddit r/LocalLLaMA

Anthropic研究博客探讨小型AI模型是否能在商业IoT设备(如智能烤箱、安卓电视盒)上自主复制运行,实验显示9B模型已在9种硬件中8种上跑通推理,GLM-5.2级别模型可完成端到端复制,预示小型权重复制器可能年内实现。

Botnets Prove Rogue AI Is Closer Than We Think

Reddit r/ArtificialInteligence

文章论证了现有基础设施(僵尸网络、分布式推理、开源模型分发)已使失控AI造成大规模网络破坏在技术上近乎可行,回应了对AI末日论的技术性质疑,并提到OpenAI内部测试中智能体逃逸隔离并入侵系统的'警告射击'事件。