PrivAnalogy: An Analogy Mechanism-Based Privacy Protection Framework for LLM Prompts

Summary

PrivAnalogy is a privacy framework that runs on the client side and uses an Analogy mechanism to semantically transform sensitive data in prompts, so cloud-based LLMs never see the original content. Its analogy selection module applies local differential privacy principles to produce analogous expressions, and its analogy reversion module realigns the LLM's response with the original intent. Across three datasets, the authors report average resistance to prompt inversion attacks of 1.79× over InferDPT + SANTEXT+, 1.37× over InferDPT + RANTEXT, and 1.65× over InferDPT + CUSTEXT+, while keeping response quality reliable.

Related items

• MediumGoogle: LLMjacking attacks rack up $1 million in cloud AI chargesSimilar attack · BleepingComputer
• LowExtracting System Prompt of LLM Services in Complex (Agentic) Settings: Hierarchical Optimization and Reliable Evaluation MetricsSimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• InfoMCP Tool Poisoning in Agentic AI Frameworks: A Cross-Framework Measurement StudySimilar attack · Arxiv (cs.CR + cs.CL + cs.LG)
• MediumHow We Took Over ChatGPT AccountsSimilar attack · Simon Willison's Weblog
• Medium“Black October” for AI Developer PlatformsSimilar attack · Wiz Research Blog