Science news and discussion on TalkFuse.
Hugging Face Has a Deepfake Nudes Problem
An investigation by the nonprofit AI Forensics has found that Hugging Face, a major open-source AI platform valued in the billions, is widely used to generate nonconsensual nude "deepfake" images. The finding is significant because it shows that even as US, EU and UK authorities move to crack down on "nudify" tools, a large mainstream AI hosting platform is still enabling the technology largely unchecked, with little effort required to bypass any safeguards.
Researchers tested nine popular image-editing tools ("Spaces") on the site and found seven could easily turn a clothed photo of a woman into a topless one using a simple six-word prompt, with no need to circumvent safety measures. In a separate test, decoy Spaces set up by the group logged more than 1,000 user submissions over a week, of which 73% of prompts were sexual, 83% of those sought to undress or sexualise the subject (95% of them women), and 6.7% appeared to target children. Hugging Face did not respond to Wired's questions about its moderation practices, though it does have policies banning child sexual abuse material and non-consensual sexual deepfakes; some flagged pages were removed after Wired's enquiries.
In short
- Hugging Face hosts tools widely misused to create nonconsensual nude deepfakes.
- Study found 73% of test prompts sexual; most targeted women, some children.
- Platform reportedly enforces no safeguards; Hugging Face did not respond to Wired.
Steelman: both sides, in good faith
The strongest fair case each way — we don't pick a winner.
The case for
Hugging Face's stated policies explicitly prohibit non-consensual sexual deepfakes and child sexual abuse material, yet the investigation confirms these tools are readily misused for precisely these purposes with virtually no friction required. The evidence is substantial: 83% of sexual submissions involved non-consensual sexualisation, 95% targeted women, and 6.7% appeared to target children. As a significantly funded platform with clear commitments against this harm and the technical capacity to enforce those commitments, Hugging Face bears responsibility to implement meaningful safeguards that reflect its published values.
The case against
Open-source AI platforms serve important scientific, educational, and creative purposes that overly restrictive moderation could undermine; the practical reality is that content moderation at scale requires unreliable judgements about intent, particularly in open-source contexts where legitimate and harmful uses of the same tools are difficult to distinguish. Stronger legal frameworks explicitly criminalising non-consensual deepfakes, combined with enforcement action against those who create and distribute them, would address the core harm more directly than restricting platform access. This approach preserves open-source principles whilst targeting the actual wrongdoing rather than the availability of tools that serve many legitimate purposes.
Explained simply
Hugging Face is a leading open-source platform where developers share and host artificial intelligence tools, used by millions of people worldwide. The site has become one of the most important hubs in the AI development community.
"Deepfake nudes" are synthetic sexual images created using AI technology, typically generated by digitally removing clothing from photographs of real people without consent. The creation and sharing of such images has become a serious global concern, prompting authorities in the US, UK and European Union to move towards restricting or banning the tools used to generate them.
Hugging Face is notable in this context because of its scale and mainstream status. The platform has millions of users and developers worldwide, meaning any tools hosted there could potentially reach far more people than would be possible on smaller or more niche services.
Research Science Software Technology