OpenAI says it is “exploring” the possibility of allowing ChatGPT to generate some NSFW content, but has clarified that it has no plans to allow its generative AI products to create porn.
As anyone who has ever tried to get ChatGPT to write a racy story featuring anything more than holding hands knows, the chatbot is programmed to stringently refuse to create content related to sex in any remotely titillating context. It is also programmed to resist creating other NSFW text related to subjects such as violence and gore, swearing, and various forms of abuse.
However, last week (May 8, 2024), OpenAI published a document explaining many of the rules ChatGPT is programmed to adhere to. The document, entitled Model Spec, featured a commentary note from the company about how the chatbot’s NSFW programming could change in the future.
“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies. We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API [application programming interface] and ChatGPT,” it reads.
The commentary note continues: “We look forward to better understanding user and societal expectations of model behavior in this area.”
OpenAI, which also makes the DALL-E series of AI image generators and the forthcoming Sora AI text-to-video generator, was quick to clarify that this did not mean it was moving into the world of AI-generated porn.
Circumvent Big Tech's Censorship! Never miss another post!
Subscribe to our notifications!
Article continues below
The company told Mashable that it had “no intention to create AI-generated pornography”, adding that it had “strong safeguards in our products to prevent deepfakes, which are unacceptable, and we prioritize protecting children.”
OpenAI added that it also believed in “the importance of carefully exploring conversations about sexuality in age-appropriate contexts”.
While it’s unlikely that ChatGPT will be allowed to legitimately create stories about orgies and acrobatic sex acts any time soon, it’s a positive step that OpenAI seems to be willing to address the nuances and subjectivity of what constitutes NSFW content, and in what contexts. Currently, ChatGPT is often as quick to shut down requests for content about innocent kisses, let alone anything more hardcore.
ChatGPT users have managed to create ‘jailbreak’ versions of the chatbot in the past, utilizing programming loopholes to allow it to generate NSFW content. However, these loopholes have usually closed relatively quickly with ChatGPT updates.
Meanwhile, in lieu of ChatGPT fulfilling desires for erotic chat, sex-focused NSFW chatbots have emerged as a niche of the AI chatbot sector. They often come in the form of ‘AI girlfriend’ services such as Candy.ai and Cutechat AI.
OpenAI’s forthcoming AI video generator Sora is also certain to be a porn-free platform, but in March its chief technology officer said she is “not sure” what its nudity policy will be.
“You can imagine that there are creative settings in which artists might want to have more control over that. Right now we are working with artists, creators from different fields to figure out what’s useful, what level of flexibility should the tool provide,”Mira Murati said.
Sora is expected to be released some time in 2024, although OpenAI has not confirmed a launch schedule.
