Skip to content
InfoResearchPeer-reviewedLLM-specific

PAIR: Against Inference-Time Attacks on Fine-Tuned LLMs via Path-Level Inference Randomization

Published
Record updated
View JSON

Summary

Researchers propose Path-level Inference Randomization (PAIR), a defense for fine-tuned LLMs that randomizes computation inside LoRA adapters at inference time instead of filtering inputs and outputs. PAIR inserts generated shadow weights into feature-sensitive layers to create a stochastic inference network. Across evaluated jailbreak, prompt-stealing and backdoor attacks, the authors report reduced attack metrics with small changes in held-out task performance.