Protecting Against Unauthorized Dataset Use in Fine-Tuning Text-to-Image Diffusion Models

Summary

Researchers propose a dataset watermarking framework to detect unauthorized use and trace leaks of image datasets used to fine-tune text-to-image diffusion models such as Stable Diffusion. The framework is assessed on effectiveness, harmlessness, traceability, stealthiness and robustness, including cross-dataset transferability, robustness to image transformations and adaptive attacks, and scalability. Experiments on Stable Diffusion report reliable detection and accurate tracing with minimal data modification while preserving output quality.