Tag
JPEG XS (ISO/IEC 21122) is an image and video codec offering visually and mathematically lossless quality with low latency and low computational complexity, targeting professional video over IP, broadcast, VR, drones, and autonomous vehicles.
Liquid AI released d1-2B, a 1.92B-parameter decision model for text, images, and video built on LFM3-VL-2B that returns calibrated typed answers in a single forward pass with no token generation, achieving millisecond-scale inference and leading open d1 benchmarks.
Falcon is a causal audio-visual target speaker extraction model that uses lip video to isolate a target speaker's voice in noisy, overlapping speech, cutting parameters by 91.9% and latency by 11.1× versus causal AV-TFGridNet. The paper also introduces RealSSA, a benchmark spanning simulated and real-recorded acoustic scenes with varied interference conditions.
OpenAI 正式向所有用户开放其 Decisions API，基于 ChatGPT Luna 重新配置以实现超低延迟与低成本推理，直接与 TypeSafe 的 Jev 等决策模型展开竞争。
OpenAI宣布Decisions API正式可用，基于GPT-6 Luna，面向有界答案的快速决策场景，速度比通过Responses API调用GPT-6 Luna快达10倍，并新增GPT-Live原生集成、提示缓存与推理驻留等功能。
腾讯混元发布 Hy-SimulMT-30B-A3B-FP8 实时同传模型，支持中英双向语音到语音翻译，具备实时语音克隆能力，在长音频评测中实现约3秒的最低延迟。
LEAF 提出首个 LUT 感知的 Transformer/linformer 架构，面向 FPGA 上的超低延迟推理，在喷注标记基准上以更少 LUT 资源实现更高精度，适用于 CERN 等实时系统。
qev-0.8b is a 0.8B-parameter local decision model that takes a single forward pass to return calibrated probabilities over any input, ranking #1 of 27 similar-sized models on Benchmark Heaven (77.1%) at 3.5 ms p50 latency while running in 1.3 GB on a laptop. It ships in CUDA, MLX and GGUF formats and generalizes to games (Tetris, Pac-Man, 2048, Breakout, Whac-A-Mole) never seen in training.
DeepSeek has fully open-sourced DeepInfer, its internal production-grade inference framework used to power the DeepSeek-V4.1-Flash model, emphasizing high throughput and low latency. They also open-sourced the deepseek-recipe component to ensure community deployments behave consistently with the official API.
VoiceManager 是一个低延迟的流式语音到语音（STT/TTS）本地服务器，通过单一 WebSocket 进行流式传输，支持带打断（barge-in）的多轮对话；HermesConsole 则是一个 LCARS 风格的 Kotlin 客户端参考实现，展示唤醒词、流式语音回复、工具调用及会话上下文保持等功能，采用 MIT 协议开源。
StyleStream 2.0 是一个快速且可控的流式语音风格转换框架，通过 few-step MeanFlow 模型和自回归反馈微调将端到端延迟降至 520ms，并借助统一的文本条件流匹配模型支持文本驱动的语音设计与指令式语音编辑。
LiveKit has overcome the previous limitation of AI being unable to achieve millisecond-level bidirectional real-time interaction in live streaming, showing enormous potential. It can be widely applied in scenarios such as e-commerce, live streaming, intelligent assistants, telemedicine, customer service call centers, real-time translation, game NPCs, and more.
Reflection 的美国制造开源权重模型 Beam 此前以 stealth/cat-jam 名义运行，现已在 Vercel AI Gateway 上限时免费提供，主打低延迟，可接入 Eve agents 和编码工具使用。
Pipecat Labs 发布 PhoneLLM Alpha 2，推出 Mini (30B/A3.5B MoE) 与 Max (120B/A12B) 两款开放权重语音代理文本模型；Max 引入单句「微思考」推理，在 PhoneBench 上以 83.0% 得分超越 Claude Sonnet 5.5、Gemini 3.6 Flash 与 GPT-5.6 等模型，同时保持 200ms 以下的首响应延迟。
ByteDance and Fudan University researchers present ByteExpress, a software communication layer over RDMA for large-scale parameter-server inference and training, reporting up to 74% lower P99 push latency and significant CPU savings versus TCP in production deployments.
微软发布 Microsoft-Decision-1，一个专为快速决策打分设计的模型，可用于路由、分类、优先级排序与工作流控制，基于 Qwen3.5-9B 后训练，在 36 项基准测试中取得最高准确率，延迟比 GPT-6 Sol 快约 35 倍。
eth68 is a 1U rackmount ethernet audio interface for Linux running custom bare-metal firmware on an STM32H7, achieving 3.620 ms round-trip latency at 48 kHz and supporting multi-unit synchronization to scale channel count without added latency.
Speakrail is an open-source, fully-local full-duplex voice assistant that runs on a single RTX 4090, combining Voxtral Mini 4B for streaming speech with a turn-taking head, a Gemma 4 12B LoRA for interruptible dialogue decisions, and Breeze TTS 2 for speech output, achieving ~0.7-0.8s median reply latency and the top open-weights score on Full-Duplex-Bench conversational dynamics.
The team behind .wave introduces an inference engine using a Wave Persistent Kernel compiler to serve NVIDIA Nemotron 3.5 ASR Streaming at $0.00045/minute, sustaining 4,800 concurrent streams on one H100 with p99 frame completion under 106.3 ms — roughly 20x NVIDIA's published stream capacity and a fraction of competing ASR pricing.
作者分享为电话语音机器人调优对话轮替（turn-taking）的经验：单靠 VAD 静音阈值不够，需结合 STT 部分文本判断句子是否完整，再配合 TTS 延迟一起调试，才能让机器人响应更自然。