Is there any AI with extremely high sensitivity to impaired speech?
Summary
A user seeks advice on AI speech recognition models that can accurately understand severely impaired speech, such as that of their minimally verbal brother with Down syndrome and autism, noting that current systems like Whisper fail to recognize it.
Similar Articles
Silent speech with ultrasound
A model trained on ultrasound recordings of the tongue can decode silent speech with a 15.6% word error rate, approaching lip-reading performance despite a smaller dataset.
@FeitengLi: Actually, these problems can be well solved: 1. Ditch whisper, switch to an ASR model. Qwen3-ASR is great with few hallucinations, and there are other ASR options. Whisper has many hallucinations and requires 30s segments. Qwen3-ASR gets more accurate with longer audio, supporting up to 20…
Recommends using Qwen3-ASR instead of Whisper to reduce hallucinations, using LattifAI tools for precise audio-text alignment and subtitle generation, and introducing their own OmniVAD-Kit project for voice activity detection.
Real-Time Voice AI Hears but Does Not Listen (arXiv:2606.26083)
This paper evaluates four leading real-time voice AI systems (GPT Realtime 2, Gemini 3.1 Flash Live, Qwen3.5 Omni Plus, Omni Flash) and finds they consistently act on words rather than vocal tone, ignoring distress, fear, or sarcasm even when they can perceive them—termed the 'emotional intelligence gap' of voice AI.
Transcribing Children's Speech: ASR Performance and Obtaining Reliable Orthographic Transcriptions
This paper evaluates nine ASR models (Whisper, Parakeet, Wav2Vec2) on Dutch child speech datasets JASMIN and DART, finding that fine-tuned Whisper-medium achieves the best performance (WER 5.54% on JASMIN, 70.37% on DART). It also proposes a selection method to automatically identify correctly pronounced utterances with high precision, reducing the need for manual verification.
Is AI actually getting better at understanding context in long conversations, or does it still fall apart?
This article discusses the limitations of AI models in maintaining context over long conversations, highlighting recency bias and the distinction between context window size and actual comprehension. It suggests practical workarounds like restating constraints and using running context documents.