← Back to the feed

ChatGPT to stop responding to teens in human voice

BBC Technology ·

OpenAI has launched ChatGPT for Teens, introducing a set of safety features aimed at under-18 users of the AI chatbot. Among the changes, teen accounts will lose the ability to have ChatGPT respond in a human-sounding voice, a move intended to reduce the risk of the technology appearing lifelike, amid wider industry concern about people mistakenly believing AI tools are sentient. The update also adds break reminders and prompts telling teenagers "it can wait," while OpenAI insists the changes are not a response to any specific incident.

The new teen accounts will apply by default to users who identify as teenagers at sign-up, or whom OpenAI itself flags as under 18, though the company has not detailed how this identification will work; under-13s remain barred from the platform. Additional features include customisable "Study Mode" hours and "quiet times" when the tool switches off, alongside new alerts that notify parents, via a human-reviewed process within about an hour, if a teen makes eating disorder-related or other harmful requests. The launch comes as separate research found 94% of surveyed UK students admitted using AI in assessments, and follows criticism from the family of a teenager who died, who said OpenAI's earlier parental controls were insufficient.

  • ChatGPT for Teens removes human-like voice responses for under-18 accounts
  • New features include break reminders, Study Mode hours and "quiet times"
  • Parents get alerts on harmful requests, reviewed by humans within an hour

New here? Start with this

ChatGPT is a chatbot made by OpenAI, a company that develops artificial intelligence tools. It generates replies to users’ questions and can also speak aloud, including in voices designed to sound human.

Teenagers use chatbots for tasks such as studying, but their lifelike responses have raised concerns about young users’ safety and whether people might mistake AI for a person. OpenAI’s teen accounts include limits and parental alerts; children under 13 are not allowed to use the service.

Both sides, in good faith

The strongest fair case each way — we don't pick a winner.

The case for

These restrictions reflect appropriate caution during a formative developmental period when teens are particularly vulnerable to parasocial attachment. Removing human voice functionality whilst preserving text-based AI acknowledges genuine psychological risks without denying teens access to the tool itself, and the parental notification system for harmful requests provides proportionate safeguarding that respects both teen autonomy and their developmental needs.

The case against

These restrictions risk underestimating teen digital literacy and agency by assuming they cannot distinguish AI from human relationships. The evidence that human voices cause specific psychological harm remains unclear, and implementing feature restrictions based on theoretical concerns may establish troubling precedent for paternalistic tech limitations; education and transparency would better serve teens who are already sophisticated enough to integrate AI into their academic work.

AI Art Culture Technology

Read the full article at the source →

Log in to join the discussion