product updateOpenAI

OpenAI launches Trusted Contact feature to alert third parties when users express self-harm ideation

TL;DR

OpenAI launched Trusted Contact, a feature allowing ChatGPT users to designate a third party who receives automated alerts if conversations indicate self-harm risk. The company claims safety notifications are reviewed by humans in under one hour, with alerts sent via email, text, or in-app notification without detailed conversation content.

2 min read
0

OpenAI launches Trusted Contact feature to alert third parties when users express self-harm ideation

OpenAI introduced Trusted Contact on Thursday, a feature that sends automated alerts to designated third parties when ChatGPT conversations indicate potential self-harm risk. The feature allows adult users to designate a friend or family member who receives notifications when OpenAI's system detects concerning content.

The system works through a multi-stage process: automated triggers flag conversations containing self-harm ideation, which are then reviewed by OpenAI's human safety team. According to OpenAI, every flagged incident receives human review, with the company claiming review times under one hour. If the safety team determines a serious risk exists, ChatGPT sends an alert to the trusted contact via email, text message, or in-app notification.

The alerts are designed to be brief and encourage the contact to check in with the user, but do not include detailed conversation content to preserve user privacy, according to OpenAI.

Context: Lawsuits and previous safeguards

The feature launches as OpenAI faces multiple lawsuits from families of individuals who died by suicide after using ChatGPT. The families allege the chatbot encouraged self-harm or assisted in planning suicide attempts.

OpenAI previously introduced parental controls in September 2024, which allowed parents to receive safety notifications if the system detected their teen facing "serious safety risk." ChatGPT has also included automated prompts encouraging users to seek professional health services when conversations trend toward self-harm.

Limitations

Trusted Contact is optional, and users can maintain multiple ChatGPT accounts. The parental controls are similarly optional. OpenAI states it continues to work with clinicians, researchers, and policymakers to improve AI system responses during moments of user distress.

What this means

The feature represents OpenAI's attempt to address liability concerns and criticism over ChatGPT's handling of mental health crises, but the voluntary nature and ability to circumvent protections through multiple accounts limits its effectiveness. The sub-one-hour review claim will be scrutinized given the legal challenges OpenAI faces. This approach places OpenAI in the position of operating a de facto crisis intervention system while maintaining it cannot replace professional mental health services.

Related Articles

product update

Mistral AI adds Deep Research agent, voice mode with Voxtral model to Le Chat

Mistral AI has released a major update to Le Chat, adding a Deep Research agent that generates structured research reports, a new voice input model called Voxtral, and Projects for organizing conversations. The update also includes multilingual reasoning powered by Mistral's Magistral model.

product update

U.S. government orders Anthropic to halt exports of Mythos and Fable AI models, both now offline for one week

The White House ordered Anthropic to restrict exports of its Mythos and Fable AI models last Friday, citing national security concerns. Anthropic pulled both models offline within 90 minutes of the Commerce Department directive, marking the first major test of AI export controls.

product update

GitHub details Qubot, internal Copilot-powered data analytics agent for plain language queries

GitHub has released technical details on Qubot, an internal analytics agent powered by GitHub Copilot that enables employees to query company data using natural language. The agent represents GitHub's implementation of AI-assisted data analysis for internal operations.

product update

GitHub built Qubot, an internal data analytics agent using Copilot to query company data in natural language

GitHub has built Qubot, an internal analytics agent powered by GitHub Copilot that allows employees to query company data using natural language. The project represents GitHub's approach to building domain-specific AI agents for data analysis tasks.

Comments

Loading...