Is there any AI with extremely high sensitivity to impaired speech?

Reddit r/ArtificialInteligence News

Summary

A user seeks advice on AI speech recognition models that can accurately understand severely impaired speech, such as that of their minimally verbal brother with Down syndrome and autism, noting that current systems like Whisper fail to recognize it.

Hi everyone, My brother has Down syndrome and is autistic. He is minimally verbal, and his speech is significantly impaired. I had the idea of building an app, almost like Duolingo, with a gamified experience: it would present a word, he would try to say it, the app would listen, provide feedback, and gradually increase the difficulty as he improves. The biggest challenge is that his speech is very difficult to understand. My family understands him because we've lived with him for 12 years, but almost no one else can. Speech-to-text models like Whisper and other AI systems almost never recognize what he's saying, so the app wouldn't work as intended. Do you know of any AI model or speech recognition system that is sensitive enough to handle speech like this? Or perhaps another technical approach that could work? Thank you!
Original Article

Similar Articles

Silent speech with ultrasound

Hacker News Top

A model trained on ultrasound recordings of the tongue can decode silent speech with a 15.6% word error rate, approaching lip-reading performance despite a smaller dataset.

@FeitengLi: Actually, these problems can be well solved: 1. Ditch whisper, switch to an ASR model. Qwen3-ASR is great with few hallucinations, and there are other ASR options. Whisper has many hallucinations and requires 30s segments. Qwen3-ASR gets more accurate with longer audio, supporting up to 20…

X AI KOLs Timeline

Recommends using Qwen3-ASR instead of Whisper to reduce hallucinations, using LattifAI tools for precise audio-text alignment and subtitle generation, and introducing their own OmniVAD-Kit project for voice activity detection.

Real-Time Voice AI Hears but Does Not Listen (arXiv:2606.26083)

Reddit r/artificial

This paper evaluates four leading real-time voice AI systems (GPT Realtime 2, Gemini 3.1 Flash Live, Qwen3.5 Omni Plus, Omni Flash) and finds they consistently act on words rather than vocal tone, ignoring distress, fear, or sarcasm even when they can perceive them—termed the 'emotional intelligence gap' of voice AI.

Transcribing Children's Speech: ASR Performance and Obtaining Reliable Orthographic Transcriptions

arXiv cs.CL

This paper evaluates nine ASR models (Whisper, Parakeet, Wav2Vec2) on Dutch child speech datasets JASMIN and DART, finding that fine-tuned Whisper-medium achieves the best performance (WER 5.54% on JASMIN, 70.37% on DART). It also proposes a selection method to automatically identify correctly pronounced utterances with high precision, reducing the need for manual verification.