Parameter-Agnostic Privacy-Preserving Machine Unlearning for Large Language Models

Summary

This research paper proposes a privacy-preserving machine unlearning mechanism for large language models. The method uses information retrieval to remove high-risk semantic meanings from model output and adds differentially-private randomization so unlearned information is statistically indiscernible. It requires neither parametric fine-tuning nor in-context prompt calibration, and the authors report theoretical privacy and unlearning guarantees plus experiments on real-world datasets.

Topics

• Training data and privacy