“We are exploring whether we can responsibly provide the ability to generate NSFW content in an age-appropriate context through our API and ChatGPT,” the company said in its model specification. “We look forward to gaining a deeper understanding of user and societal expectations for model behavior in this area.”
An OpenAI representative told Business Insider: “We have no intention of creating AI-generated pornography. Our products have strong safeguards built into our products to prevent unacceptable deepfakes, and we do not intend to create AI-generated pornography. “We also believe it is important to carefully consider our conversations.” About sexuality depending on age. ”
OpenAI's model, which powers products like ChatGPT and DALL-E, prohibits users from creating explicit content, but that hasn't stopped AI porn from spreading elsewhere.
Unstable Diffusion is a NSFW AI image generation tool. Launched from Kickstarterhas a strong following in the ambiguous world of AI porn.
The platform takes its name from Stable Diffusion, Stability AI's open source AI image generator. Unlike Stability's platform, content restrictions are minimal and users can create pornographic images.
Last year, the company's CEO and co-founder Arman Chaudhry told Business Insider that the program generates more than 500,000 images every day. According to Chaudhry, Unstable founded his original Discord group “as a haven for artists who want to create AI art without restrictions, including those related to adult content.”
However, theoretically the user deep fake Pornography or content depicting sexual acts of minors.
Platforms like Unstable claim to have content filters that prevent users from using it in this way, but these filters aren't always foolproof.
