San Francisco filed a lawsuit against 16 AI-powered websites, marking the first government action to combat non-consensual deepfake pornography. The case aims to shut down these websites, which allow users to create AI-generated nude images without consent.

The sites collectively received more than 200 million visits in the first half of 2024.

Users can upload photos of fully clothed individuals, including children, which are then manipulated by AI to create non-consensual nude images.

Individuals used the technology to create deepfake nudes of people ranging from singer Taylor Swift to Rep. Alexandria Ocasio-Cortez, and everyday citizens like middle-school girls.