Tag
This survey paper reviews developments in brain-to-language decoding, translating neural activity into linguistic outputs for communication restoration and scientific study, covering tasks, methods, evaluation, and future directions.
Ruby-ASR presents a new supervision method for Japanese automatic speech recognition that binds orthographic spans to their lexical readings, improving reading recognition while maintaining transcription accuracy.
Open-sourcing Audio8 ASR Infinite, a speech recognition tool with ultra-low latency, unlimited audio support, 24/7 transcription, and built-in semantic turn detection, claimed to be new state-of-the-art for streaming ASR.
This paper proposes a practical recipe for semi-supervised federated ASR using online pseudo-labels with server update stabilization, demonstrating significant improvements over prior methods in both in-domain and cross-domain settings.
NetEase Youdao's open-source AI models R2T2 and T3PO have topped Hugging Face leaderboards for speech recognition and translation, outperforming major competitors with impressive real-time performance and stability.
Speechka is a real-time voice translation tool that mimics the user's voice across 44 languages, available on macOS, Windows, and browsers.
The article highlights how aggregate Word Error Rate (WER) metric fails to capture critical errors in voice agents for production, such as misrecognized bank codes and multilingual speech, necessitating per-field tracking for real-world applications like banking and collections.
The paper proposes optimizations to the Viterbi algorithm using the Hirschberg algorithm and constrained random walk, reducing memory usage from 140 GB to 5 MB and improving speed, enabling forced alignment to run on end-user devices for better scalability in speech processing.
This paper proposes a three-stage pipeline for accented conversational ASR that improves entity and disfluency recall, achieving 80–85% entity recall and outperforming baseline systems with fewer parameters.
R2T2 is a low-latency and high-accuracy real-time speech recognition model that processes audio in small chunks and commits text without revision, suitable for applications like live captioning and translation.
The article reflects on the need for stability over speed in ASR for voice agents, discussing the 'Confucius r2t2' model that integrates wait/commit mechanisms to enhance reliability.
TypeDash is a desktop application that lets users control their computer and dictate text via voice commands, featuring app launching, web search, and optional ChatGPT-powered cleanup for speech recognition.
The paper proposes T-SANDHI, a Tone Sandhi-aware Adaptive Network for low-resource Taiwanese Hokkien speech recognition, which explicitly decouples tonal variations to improve accuracy on top of a Whisper backbone.
NetEase Youdao AI is open-sourcing Confucius4-R2T2, a 1.7B frontier real-time streaming ASR model designed for voice agents, featuring low latency, high accuracy, and configurable decoding chunks.
The paper proposes DiaWhisper-DPO, an end-to-end model for transcription and role attribution in clinical interviews using failure-mined preference optimization, achieving high accuracy and reducing errors compared to cascaded baselines.
The post introduces the open-source Audio8 models, which enable on-device speech recognition and synthesis on phones and PCs, including an offline transcription version for iPhone.
Google advances AI for language support with new Gemini models for real-time translation and transcription, aiming to cover 1,000 languages through initiatives like the Universal Speech Model.
Jexxa is a high-speed dictation tool for macOS that runs entirely on-device, ensuring privacy and fast performance with no data uploads.
This paper systematically evaluates token merging for multilingual speech recognition on the Whisper model family, demonstrating improved computational efficiency with minimal accuracy loss across low-resource languages and fine-tuned models.
The article discusses the tradeoff between latency and control in voice AI architectures, comparing traditional cascaded systems with end-to-end models, and seeks community input on current practices.