Hugging Face Has a Deepfake Nudes Problem

Hugging Face, an open-source AI platform hosting AI models and datasets, has a widespread problem with nonconsensual deepfake nudes, according to research by AI Forensics. Researchers found that seven out of nine tested image editing tools on the platform could easily remove clothes from photos, and over 73 percent of user requests to honeypot (fake decoy) spaces were sexual in nature, with 83 percent seeking to undress or sexualize women without consent. The platform's content policies prohibit such deepfakes, but researchers found no safety mechanisms (called guardrails, which are filters to block harmful outputs) actually implemented at the platform level to prevent this misuse.