Skip to content
InfoResearchPreprint

You Are the Trigger: Speaker-Activated Backdoors

Published
Record updated
View JSON

Summary

Researchers introduce Speaker-Activated Backdoor (SAB), an attack in which an attacker compromises a speech model during fine-tuning and uses a target speaker's natural voice as the trigger, with no access to inference-time inputs. A two-phase fine-tuning method reaches 90.2% backdoor success on Whisper-medium and 97.0% on Parakeet, with false-positive rates of 1.7% and 0%, using as little as two minutes of the target's audio. In downstream tests, injected instructions drove GPT-4o and Claude agents to carry out the harmful action in up to 87.5% of cases.