Room reverberation and low SNR hurt STT accuracy far more than model size

Reddit r/ArtificialInteligence News
speech-to-text acoustics preprocessing snr reverberation whisper word-error-rate

Summary

Room reverberation and low-frequency noise from the environment hurt speech-to-text accuracy far more than the choice of model size; front-end audio preprocessing like adaptive spectral subtraction can recover masked phonemes and reduce word error rate more effectively than upgrading the model backend.

In many STT discussions, when a transcript fails, people immediately blame the model architecture, assuming the fix is upgrading from Whisper-medium to Large-v3, or cranking up Temperature settings. Almost nobody checks the Mel-spectrogram to see what acoustic masking actually did to the input audio. I ran a quick acoustic test using a phone MEMS mic placed 2.5 meters away on a wooden desk near an open window. I read a control sentence containing unvoiced fricatives and the phrase "do not approve." On playback through small speakers, human ears naturally interpolate the missing sounds. But inspecting the STFT (Short-Time Fourier Transform) frames revealed two physical issues: Low-frequency rumble (200Hz to 500Hz) from window traffic compressed the dynamic range, lifting the noise floor. Room reverberation ($T_{60}$ reflection off the hard desk) created comb filtering, degrading the high-frequency energy (4kHz to 8kHz) required to distinguish unvoiced consonants like /s/ or /t/. When running the raw audio through a local Whisper-large-v3 instance without preprocessing, the missing spectral energy caused token decoding errors. However, routing the same file through vomo ai yielded significantly cleaner output. Its cloud pipeline incorporates adaptive spectral subtraction and front-end DSP filtering that cleans the low-frequency noise floor before feeding frames to the decoder, successfully recovering the masked phonemes. Fixing the input SNR through front-end audio enhancement yields a far greater WER (Word Error Rate) reduction than simply swapping model backends. Effective STT relies just as heavily on pre-processing acoustics as it does on the underlying model architecture.
Original Article

Similar Articles

I evaluated top STT models on large Real-World data

Reddit r/AI_Agents

An evaluation of leading STT models on 1000+ noisy real-world clips reveals most perform poorly in noisy environments, with DG Nova performing best. Applying noise cancellation significantly improves accuracy.

@FeitengLi: Actually, these problems can be well solved: 1. Ditch whisper, switch to an ASR model. Qwen3-ASR is great with few hallucinations, and there are other ASR options. Whisper has many hallucinations and requires 30s segments. Qwen3-ASR gets more accurate with longer audio, supporting up to 20…

X AI KOLs Timeline

Recommends using Qwen3-ASR instead of Whisper to reduce hallucinations, using LattifAI tools for precise audio-text alignment and subtitle generation, and introducing their own OmniVAD-Kit project for voice activity detection.

Adapting Foundation ASR Models to Dysarthric Speech: A Case Study

arXiv cs.CL

This paper presents a personalized ASR system for a dysarthric speaker by fine-tuning the Whisper foundation model, achieving 9.7% word error rate using only 22.5 hours of adaptation data plus 8.8 hours of user corrections. The results demonstrate that personalized fine-tuning can make foundation ASR models substantially more effective for dysarthric speech, with a deployed mobile application enabling real-world data collection.