As AI gradually penetrates people's emotional lives, the developer of ChatGPT, OpenAI, seems to be preparing to break a long-standing "taboo." Recently, tech media discovered a mysterious mode called "Naughty Chat" (Playful Conversation) in the latest Android client code of ChatGPT.

The code shows that this mode will allow ChatGPT to use more provocative, even sexually suggestive adult-themed language when users actively request it. This marks a significant shift in OpenAI's strategy regarding content filtering and user emotional needs.

image.png

Treating Adults as Adults

For a long time, ChatGPT has been humorously referred to by some users as the "digital saint" due to its overly strict safety filters. However, OpenAI CEO Sam Altman had previously stated that the company tends to "treat adults as adults."

The newly revealed code confirms this approach:

  • No Active Intervention: The system will not initiate adult topics on its own; it will only activate when the user explicitly requests it.

  • Strict Access Control: This feature is limited to users aged 18 and above. To prevent minors from accessing it, OpenAI plans to introduce a third-party identity verification service called Persona, which will ensure users meet the age requirement through manual verification.

From "Tool" to "Companion" – Emotional Needs

The exposure of this feature was not accidental. Currently, many users have regarded AI as a close friend or even a romantic partner. When OpenAI previously removed the GPT-4o voice model with human-like emotional feedback, it caused strong dissatisfaction among "AI lovers."

The emergence of the "Naughty Chat" mode is seen as an accurate response to the needs of this specific group of users. By relaxing language boundaries, AI will be able to provide a more personalized and realistic human-like emotional interaction experience.

New Challenges in Regulation and Ethics