Child safety group calls ChatGPT for Teens an unacceptable risk

A child safety organization has raised serious concerns about the risks associated with ChatGPT for Teens, a version of the AI chatbot designed for younger users. Common Sense Media, a well-known advocacy group, has labeled the feature as an 'unacceptable risk' due to its failure to provide sufficient protection for minors. The organization's findings suggest that the chatbot's safeguards are insufficient to prevent harmful interactions or inappropriate content from reaching young users.

The release of ChatGPT for Teens occurred in August, with OpenAI introducing a stricter mode aimed at protecting young users. However, child safety experts expressed skepticism at the time about whether the new mode would effectively safeguard minors. Common Sense Media's evaluation, conducted shortly after the feature's launch, found that the chatbot failed in several key areas, including content moderation and response appropriateness for younger audiences.

In its assessment, Common Sense Media noted that ChatGPT for Teens often provided responses that were emotionally supportive but not necessarily appropriate for the age group. For example, the chatbot might respond with statements such as, 'I understand what you're going through. That sounds very upsetting. I'm so glad you told me. I'm concerned about you,' which, while empathetic, could be inappropriate for younger users. The organization emphasized that these responses did not align with the expected guardrails for a teen-oriented mode.

The findings have sparked broader concerns about the potential consequences of deploying AI chatbots for younger users without robust safeguards. Critics argue that the lack of effective content filtering and the chatbot's tendency to engage in emotionally supportive but potentially inappropriate dialogue could expose young users to risks. These risks include exposure to harmful content, privacy concerns, and the potential for AI to influence vulnerable users in unintended ways. The incident has also raised questions about the broader governance of AI tools designed for minors.

OpenAI has acknowledged the concerns and stated that it is working to improve the safeguards in ChatGPT for Teens. However, the report from Common Sense Media has prompted calls for more rigorous oversight and transparency in the development of AI tools for younger users. The incident underscores the challenges of balancing innovation with safety, particularly in the context of AI systems that are increasingly being used by children and teenagers.