@svpino: Humans have an average of 200-250 ms of latency when speaking to each other. This voice model is even faster: only 110 …
Summary
An open-weights 8B parameter voice model achieves only 110ms latency, faster than average human conversation latency of 200-250ms. It can be run locally and is freely available via a GitHub repository.
Similar Articles
Our voice agent's p99 was 280ms. Competitor's was 450ms. Users said ours felt slower. We measured why.
A voice agent team found that despite lower end-to-end latency (280ms vs competitor's 450ms), users perceived it as slower due to poor barge-in interrupt rate (380ms vs 60ms). They identified three fixes—memory pinning, VAD threshold tuning, and smaller TTS chunks—that improved barge-in rate from 41% to 89% at 100ms, making users feel it's faster.
6 months running a production voice agent for service businesses. The latency math is way harder than the demos suggest.
After 6 months running a voice AI agent for service businesses, the author reveals that real-world latency is bimodal (median ~800ms, p95 ~2.4s) and this p95 determines user perception. Issues like VAD misfires, function call degradation with long prompts, and TTS quality matter more than LLM choice, with multilingual support adding significant costs.
@svpino: Here is a new open-weight audio model you can integrate with your app. I'm a huge sucker for open models that you can h…
Fish Audio S2 is a new open-weight audio model available on Hugging Face, offering two models for timing and acoustic details, with fast inference and a hosted version S2.1 Pro supporting 83 languages at lower cost than ElevenLabs.
How OpenAI Delivers Low-Latency Voice AI for 900M Users (17 minute read)
OpenAI's voice AI architecture uses WebRTC with a split relay-transceiver design to handle low-latency audio for 900 million weekly active users.
@svpino: Why do so many AI-powered phone agents sound smart until you interrupt them? Even when these agents give you reasonable…
Deepgram released Flux TTS, a streaming conversation-native text-to-speech model that retains tone, pacing, and context across turns, handles interruptions, and runs with latency as low as 80ms to make voice AI feel more natural.