realtime

The author built a local realtime voice stack using Parakeet STT, Qwen 2.5 7B, and Qwen3-TTS, integrated with Ollama.

VideoSDK AI Agents is an open-source Python framework for building production-ready real-time voice and multimodal AI agents that join VideoSDK rooms as participants, with unified pipeline configuration and multiple execution modes.

ByteDance announced SeedRealtime, a native audio-visual model that can process continuous video, audio, and text while speaking in real time.

A developer asks what STT APIs people use in production voice agents, comparing Deepgram, AssemblyAI, and Smallest AI Pulse, and highlighting common failure points like endpointing, latency, and barge-in.

OpenAI describes how they built GPT-Live, a full-duplex realtime voice AI system that eliminates the turn detector, enabling natural continuous conversation. The article details architecture improvements in inference, context management, and media transport over six months.

Hologram, an Elixir framework that runs in the browser, has released four feature updates in 2025, porting most of Elixir's standard library to the client side, adding JavaScript interop, a realtime layer, and closer local-first sync capabilities, with strong community backing.

MOSS-VL-Realtime is a realtime streaming vision-language model that processes continuous video frames, supports interruptible interaction, proactive silence, and dynamic correction, with timestamp-aware encoding and a 256K context window.

A developer describes building a multi-agent voice social-deduction game, solving turn-taking with a central conductor but struggling with shared memory and preserving social subtext when compressing conversation history into structured state.

Flowcat addresses the high cost and limited context of realtime voice models, achieving 4x lower cost and 7x more context.

VikParuchuri announces the launch of turbo mode data extraction, claiming 5x faster and cheaper performance with 7% more accuracy than Azure Content Understanding, achieving competitive latency for real-time workflows.

parakeet.cpp enables running NVIDIA Parakeet ASR behind the OpenAI API locally with prebuilt Docker images, supporting CPU and CUDA (including arm64) for real-time transcription with word timestamps.

Simon Willison updates his OpenAI WebRTC Audio Session tool to support the new GPT-Realtime-2 model and adds document context for conversational audio discussions.

NVIDIA released Nemotron 3.5 ASR, an open-source multilingual speech-to-text model with the lowest latency tested, available in multilingual and English-only variants, ideal for voice agents and self-hosted deployments.

The author introduces an experimental project, Hey Codex, a real-time conversational version of Codex that allows users to interact with Codex via voice for Vibe Coding in scenarios like driving.

An AI system maps bird vocalizations into 3D visualizations, converting frequency and modulation data into colored point clusters in real time, with potential applications in industrial and medical anomaly detection.

Author describes building FlashRT, a CUDA-first inference runtime that rewrites model inference paths with C++/CUDA kernels to address bottlenecks beyond GEMM for small-batch/realtime workloads, achieving significant latency improvements on Jetson Thor and RTX 5090. The article discusses lessons on precision (FP8 helpful, FP4 mixed) and the need to bypass generic runtimes for realtime inference.

SolveIt now supports editing messages via conversational voice with optional diff tracking.

Discussion of an upcoming fully realtime interaction model that will be released via API, with plans to create distillation data from it.

OpenAI released the GPT-Realtime-2 voice model, featuring GPT-5-level reasoning capabilities and a 128,000 token context window. It supports real-time translation from over 70 input languages to 13 output languages, achieving 96.6% accuracy on the Big Bench Audio Intelligence benchmark. Greg Brockman called it a milestone in voice translation.

OpenAI has released gpt-realtime-2, a new speech-to-speech model optimized for real-time voice agent interactions with low-latency tool calling.