Gallery
But I’m struggling with what “success” looks like for Unstable Diffusion. On the one hand, the group aims to be taken seriously as a generative art platform. On the other, as evidenced by the Discord server, it’s still a wellspring of porn — some of which is quite off-putting.
Deepfake porn is just one way , and the technology is getting better every day. From the moment AOC won her primary in 2018, she’s dealt with fake and manipulated images, whether through the use of Photoshop or generative AI. There are photos out there of her wearing swastikas; there are videos in which her voice has been cloned to say things she didn’t say. Someone created an image of a fake tweet to make it look like Ocasio-Cortez was complaining that all of her shoes had been stolen during the Jan. 6 insurrection. For months, people asked her about her lost shoes. These examples are in addition to countless fake nudes or sexually explicit images of her that can be found online, particularly on X.
Why am I talking about porn on a professional audio production website? For one reason, I think there is a profound similarity between sexual porn, in all its forms, and generative AI. In this article I explain my thinking and the concerns I have for us as humans if we rely on it as a creative tool and also as consumers. It’s not a treatise about morality and ethics, but what makes us human.
Last November, when OpenAI its plans for a marketplace where anyone could make and find bespoke versions of ChatGPT technology, the company said “The best GPTs will be invented by the community.” Nine months after the store officially , a Gizmodo analysis of the free marketplace shows that many developers are using the platform to provide GPTs—or generative pre-trained transformer models—that appear to violate OpenAI’s , including chatbot-style tools that explicitly create AI-generated porn, help students cheat without being detected, and offer authoritative medical and legal advice.
As generative AI enters the mainstream, so, too, does AI-generated porn. And like its more respectable sibling, it’s improving.
