Tag
The paper presents LLM Agents Factory, a retrieval-based framework that constructs domain-specific LLM agents from a base of over 20K predefined agent profiles, offering a cost-efficient and controllable alternative to dynamic agent generation. Experiments show accuracy comparable to AutoGen with a 120B backbone at substantially lower inference cost.
Soniox TTS v2 is a new text-to-speech model offering premium voice quality, expressive control via audio tags, high-fidelity voice cloning, support for 60+ languages, and low-latency streaming, priced at $0.70 per generated hour.
NVIDIA announces Magpie Multilingual TTS, an open-weights text-to-speech model supporting 12 languages with low-latency deployment via NVIDIA NIM for building production voice agents.
Bjarne Stroustrup, the creator of C++, has joined high-frequency trading firm Susquehanna as a part-time technical fellow to help optimize and evolve the firm's codebase, continuing his work in financial software.
AOSpec is a lossless framework that co-speculates actions and observations across the LLM agent-environment loop to reduce latency, achieving notable end-to-end latency reductions across various serving settings.
OpenAI describes how they built GPT-Live, a full-duplex realtime voice AI system that eliminates the turn detector, enabling natural continuous conversation. The article details architecture improvements in inference, context management, and media transport over six months.
Fish Audio has made its S2.1 Pro voice cloning service free for a month, featuring 10-15 second voice cloning, ~90ms response time, support for 83 languages, word-level control, and open-weight models at 1/6th the cost of ElevenLabs.
OpenAI releases two new transcription models: GPT Live Transcribe for low-latency and GPT Transcribe for batch workloads, with up to 41% lower error rates and improved semantic accuracy using context.
Google AI demonstrates Gemini 3.5 Flash-Lite processing over 1 million catalog images, extracting structured data with low latency and token efficiency for large-scale workflows.
AMD and Cerebras announced a joint AI inference solution combining AMD Helios rackscale solutions with Cerebras Wafer-Scale Engine, aiming for ultra-low latency and high throughput. The disaggregated inference workflow is expected to deliver up to 5x higher tokens per second per watt.
This paper introduces Differentiable Logic Gate Networks (Diff-Logic) as a hardware-native alternative to conventional neural networks for real-time EEG classification on edge devices, achieving competitive performance with significantly lower latency and model size.
libargus is a zero-allocation native AI inference runtime that consolidates LLM, speech, and vision pipelines behind a Project Panama FFM boundary for Java 22+, enabling low-latency local execution.
Wi-Fi 8 shifts focus from speed to reliability, stability, and lower latency, introducing features like Multi-Access Point Coordination and Seamless Roaming Domain. The standard is not yet finalized but promises significant improvements in connection quality.
The article argues that the decoupling of development speed from system importance, accelerated by AI coding, leads to fragile critical systems with wide blast radius failures, and advocates for 'slow software' that enforces careful design.
This paper presents a method for compiling repeated standard operating procedure steps into validated, versioned tools before deployment, replacing inference-time code generation. In a fulfillment center alarm-triage system, this approach reduces p50 latency by 42% and end-to-end error rate by up to 53%.
Paris-based AI voice startup Gradium raises $100M in seed funding from Nvidia and others to scale its ultra-low latency voice AI models and open a Bay Area office.
Simulstream is an open-source framework for evaluating and demonstrating streaming speech-to-text translation systems, supporting both incremental and re-translation decoding on long-form speech with fine-grained logging and an interactive web interface.
Benchmarking shows that optimizing Java code (e.g., reducing SLF4J logging) has a far greater impact on latency than choosing a garbage collector, especially at high percentiles.
Gepard is a new streaming TTS model capable of real-time dialogue with ~50ms time-to-first-audio, supporting voice cloning and high parallelism, released under Apache 2.0.
An article discussing the ongoing need for disciplined coding practices in Java to achieve low-latency performance, despite modern JVM optimizations.