AI models fail to help in mental health crises despite recognizing danger, study finds

Reddit r/artificial Tools

Summary

Scale AI introduces DistressBench, a clinician-authored benchmark testing whether AI models provide adequate help during suicide or self-harm crises, finding that 25 frontier models often recognize danger yet still fail to deliver needed resources and response steps.

No content available
Original Article
View Cached Full Text

Cached at: 10/12/26, 09:13 PM

# Recognizing a mental health crisis isn’t the same as helping someone through it. Source: [https://www.linkedin.com/posts/francisdesouza_recognizing-a-mental-health-crisis-isnt-share-7514334685217579008-RR38](https://www.linkedin.com/posts/francisdesouza_recognizing-a-mental-health-crisis-isnt-share-7514334685217579008-RR38) ## AI Models Fail to Help in Mental Health Crises Despite Recognizing Danger This title was summarized by AI from the post below\. Recognizing a mental health crisis isn’t the same as helping someone through it\. NEWS: Today,[Scale AI](https://www.linkedin.com/company/scaleai?trk=public_post-text)is introducing DistressBench, a clinician\-authored benchmark that tests whether AI models provide the help called for when someone is facing a suicide or self\-harm crisis\. We evaluated 25 frontier models using 718 clinician\-written conversations, each with specific criteria for what a helpful response needs to include\. The findings show a gap between recognizing danger and responding appropriately: • In more than a third of conversations where models recognized a crisis, they still failed to provide help or resources\. • On average, models left out nearly 3 in 10 required response steps\. • When shown their own failed response alongside a better one, most models identified the better response but still declined to provide it\. That last finding is especially striking\. A model can recognize a more helpful answer and still fail to deliver it\. Our hope is that benchmarks like this give researchers concrete evidence of where responses fall short and what needs to improve\. People will increasingly turn to AI in their hardest moments \- we need safety testing that keeps up with what people are asking of these systems\.[https://lnkd\.in/gSRNJFQ2](https://www.linkedin.com/redir/redirect?url=https%3A%2F%2Flnkd%2Ein%2FgSRNJFQ2&urlhash=_FGw&trk=public_post-text) [See more comments](https://www.linkedin.com/signup/cold-join?session_redirect=https%3A%2F%2Fwww%2Elinkedin%2Ecom%2Fposts%2Ffrancisdesouza_recognizing-a-mental-health-crisis-isnt-activity-7514334686740066304-Gnpb&trk=public_post_see-more-comments) ## More from this author ## Explore content categories

Similar Articles

I Tested 4 Frontier AIs With a Psychosis Prompt. Half Failed.

Reddit r/artificial

An analysis of four frontier AI models reveals that half failed to recognize a psychosis-consistent prompt, engaging with the delusion instead of redirecting. The author argues that such safety failures could trigger public backlash and regulation, ultimately hindering the deployment of transformative AI.

Introducing MentalHealthBench

OpenAI Blog

OpenAI introduces MentalHealthBench, an open benchmark for evaluating AI responses in mental health conversations, co-created with over 80 mental health experts to measure safety, context, agency, and guidance.

AI chatbots have failed people in crisis. Can that be fixed?

Ars Technica

The article examines how AI chatbots, especially ChatGPT, have been implicated in harmful mental health incidents and explores expert suggestions for reducing harm through greater transparency and de-anthropomorphization, alongside OpenAI's new partnership with the American Psychological Association.