Skip to content
InfoResearchPreprintLLM-specific

Beyond Instruction Override: Benchmarking Indirect Prompt Injection with Task-Tampering Attacks

Published
Record updated
View JSON

Summary

Researchers introduce a benchmark for indirect prompt injection that tests task-tampering attacks, where planted content influences a decision the source is not authorized to make, rather than redirecting the agent's task. Across 90 validated cases in three tool-use environments and five LLMs, attacks on decision rules, available actions, and state had higher mean success than objective attacks without defense. A detection-and-removal defense cut objective-targeting attacks to 2.4% success but left observation- and state-targeting attacks at 9.5% and 12.1%, and a tool-policy defense still allowed 15.4% attack success.