ChatGPT answers could soon become NSFW as OpenAI opens the door to AI porn

• OpenAI is considering having its AI models generate pornography.
• OpenAI products such as ChatGPT and DALL-E prohibit users from creating explicit content.
• AI porn is rampant elsewhere, raising ethical concerns about deepfakes.

OpenAI is looking at allowing AI models to generate explicit content.

In a move first reported by Wired, OpenAI's recently released model specification document opens the door to policy changes regarding adult content.

“We are exploring whether we can responsibly provide the ability to generate NSFW content in an age-appropriate context through our API and ChatGPT,” the company said in its model specification. “We look forward to gaining a deeper understanding of user and societal expectations for model behavior in this area.”

OpenAI did not immediately respond to Business Insider's request for comment outside of normal business hours.

OpenAI's model, which powers products like ChatGPT and DALL-E, prohibits users from creating explicit content, but that hasn't stopped AI porn from thriving elsewhere.

Unstable Diffusion is a NSFW AI image generation tool. Launched from Kickstarterhas a strong following in the ambiguous world of AI porn.

The platform takes its name from Stable Diffusion, Stability AI's open source AI image generator. Unlike Stability's platform, content restrictions are minimal and users can create pornographic images.

Last year, its CEO and co-founder Arman Chaudhry told Business Insider that the program generates more than 500,000 images every day. Chaudhry said Unstable founded his original Discord group “as a haven for artists who want to create AI art without restrictions, including those related to adult content.”

However, theoretically the user deep fake Pornography or content depicting sexual acts of minors.

Platforms like Unstable claim to have content filters that prevent users from using it in this way, but these filters aren't always foolproof.