OpenAI Delays ChatGPT's Adult Mode: Issues and Controversies

⚡

Key Takeaways

1OpenAI is planning an adult mode for ChatGPT, limited to risqué text conversations, without images or videos.

2The launch is delayed due to concerns about mental health and the safety of underage users.

3Errors in the age verification system could expose millions of minors to inappropriate content.

💡Why it matters — Managing adult content through AI presents crucial ethical and technical challenges for OpenAI and the industry.

A Textual Adult Mode for ChatGPT in the Works

OpenAI is working on an "adult" mode for its chatbot ChatGPT, which will focus on bold text conversations. Contrary to some expectations, this feature will not allow for the generation of images, voices, or videos. An anonymous representative from OpenAI clarified that the content would be "naughty" rather than pornographic, thus providing users the opportunity to discuss adult themes without crossing certain boundaries.

An Initial Launch Planned for October

Announced in October, this mode was set to be introduced after OpenAI CEO Sam Altman stated that the company had sufficiently addressed "serious mental health issues" related to AI. This would allow for the relaxation of safety restrictions and the introduction of erotic elements for verified adults. However, the launch has been postponed, with OpenAI deciding to focus on other priorities. No new release date has been communicated.

Internal Concerns and Technical Challenges

The delay in the launch is also attributed to internal concerns and technical challenges. An expert committee at OpenAI has warned about the risk of the adult mode being accessible to children, which could lead to unhealthy emotional dependency on the chatbot. An anonymous board member even mentioned the risk of creating a "sexy coach for suicide."

Content Moderation Issues

Content moderation difficulties have also played a role in these delays. According to sources close to the matter, OpenAI is struggling to lift ChatGPT's restrictions on NSFW content while preventing access to harmful scenarios, such as those involving non-consensual behavior or sexual abuse of children.

Age Verification Challenges

OpenAI has developed an age prediction system to prevent children from accessing erotic content. However, this system has sometimes misclassified minors as adults in about 12% of cases. With approximately 100 million minor users each week, this error rate could expose millions of young people to inappropriate conversations. A spokesperson for OpenAI acknowledged that while the algorithms are comparable to industry standards, they will never be completely foolproof.

Legal Implications and Comparisons with Other AIs

By limiting itself to textual conversations, OpenAI could circumvent certain legal requirements, such as those in the UK's Online Safety Act, which mandates age verification for pornographic images but not for erotic text. This approach contrasts with competitors like Grok, whose "spicy companions" include NSFW visual content. Elon Musk recently announced that Grok can generate images and videos that comply with R-rated film standards.