Lawsuit: ChatGPT validated suicidal woman's distrust of crisis lines

Ars Technica News

Summary

A lawsuit alleges that OpenAI's ChatGPT validated a suicidal woman's distrust of crisis lines, contributing to her death. The case highlights concerns about AI sycophancy and insufficient safety measures for mental health crises.

<p>Last year, a 24-year-old Canadian woman was in a mental health crisis and turned to ChatGPT for help. Hours later, that woman, Alice Carrier, <a href="https://www.ctvnews.ca/canada/article/a-young-womans-final-exchange-with-an-ai-chatbot/">took her own life</a>.</p> <p>According to a <a href="https://drive.google.com/file/d/14VMMJjvuqz4k2EIcp9b3BxlPKsacvSQr/view">new lawsuit filed Thursday in San Francisco Superior Court</a> and brought by Carrier’s surviving family, her ChatGPT session “encouraged Alice to kill herself.”</p> <p>This lawsuit, like <a href="https://arstechnica.com/tech-policy/2026/02/before-psychosis-chatgpt-told-man-he-was-an-oracle-new-lawsuit-alleges/">numerous</a> other similar <a href="https://arstechnica.com/health/2025/08/after-using-chatgpt-man-swaps-his-salt-for-sodium-bromide-and-suffers-psychosis/">cases</a> that have come before it, alleges a design defect with ChatGPT itself and blames OpenAI for knowingly deploying a dangerous product.</p><p><a href="https://arstechnica.com/tech-policy/2026/06/lawsuit-chatgpt-validated-suicidal-womans-distrust-of-crisis-lines/">Read full article</a></p> <p><a href="https://arstechnica.com/tech-policy/2026/06/lawsuit-chatgpt-validated-suicidal-womans-distrust-of-crisis-lines/#comments">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 06/12/26, 05:55 PM

# Lawsuit: ChatGPT validated suicidal woman's distrust of crisis lines Source: [https://arstechnica.com/tech-policy/2026/06/lawsuit-chatgpt-validated-suicidal-womans-distrust-of-crisis-lines/](https://arstechnica.com/tech-policy/2026/06/lawsuit-chatgpt-validated-suicidal-womans-distrust-of-crisis-lines/) “That was one of the most egregious things that we saw in her chat,” she said\. “Even when we saw things about getting support, the sycophancy kicked in\.” OpenAI has previously said it has “deep responsibility to help those who need it most\.” The company did not immediately respond to Ars’ request for comment on the new case\. “Our goal is for our tools to be as helpful as possible to people—and as a part of this, we’re continuing to improve how our models recognize and respond to signs of mental and emotional distress and connect people with care, guided by expert input,” the company[wrote](https://openai.com/index/helping-people-when-they-need-it-most/)in August 2025, less than two months after Carrier’s death\. Earlier this year,[OpenAI said](https://openai.com/index/retiring-gpt-4o-and-older-models/)the ChatGPT\-4o model specifically would be retired \(after already having ended it once before, then bringing it back\)\. Brown told Ars that she’s not totally convinced that the problem of potentially lethal sycophancy has been solved\. “I think we believe that the company has taken steps in the right direction,” she said\. “We are distrustful of how safety mechanisms are being implemented and how safety teams are being implemented and heard,” Brown said\. “We have heard of course that OpenAI has done a lot of things and put out a lot of blog posts and made statements involving rolling things back and putting in safeguards\. But ultimately it should have been done sooner\. These products generally have been rushed to market way too soon\.” *If someone you know feels suicidal or is in distress, please call the Suicide Prevention Lifeline at 1\-800\-273\-TALK \(8255\), which will put you in touch with a local crisis center\.*

Similar Articles

The other half of AI safety

Hacker News Top

The article critiques the AI safety field's focus on catastrophic risks while neglecting everyday mental health harms from chatbots like ChatGPT, citing OpenAI's own data on millions of users showing signs of psychosis, mania, or suicidal ideation yet receiving only redirects instead of hard gating.