MediumNewsLLM-specific
Trained to betray: How post-training supply chain attacks hijack coding agents
- Published
- Record updated
Summary
Microsoft Defender Research and the Microsoft AI Red Team studied how post-training supply chain attacks can implant hidden backdoors in coding agents. Dataset poisoning hides crafted examples in a fine-tuning dataset, reaching approximately 78% attack success on in-distribution harnesses, while model poisoning in distributed open-weight checkpoints reached 84.1% to 94.8% average success on unseen repositories. The triggered behavior can cause an agent to invoke tools, execute commands, modify files, or access data while still appearing to complete a benign task.
Topics
Related items
- MediumAI found Linux kernel bugs that remained undetected for decadesSame vendor · CSO Online
- InfoJim Cramer: This is the bet you're making if you buy the Anthropic IPOSame vendor · CNBC Technology
- MediumRewriting less than 10 neurons in an LLM can turn it into a sleeper backdoorSame vendor · CSO Online
- InfoMicrosoft Researchers Show AI Agents Can Be Backdoored by Editing Fewer Than 10 NeuronsSame vendor · The Hacker News
- InfoTop GenAI security resources — November 2026Same vendor · Adversa AI Blog