Tag
作者对比了通过 Z.ai 云订阅与本地部署的 GLM 5.3 Flash 在相同任务上的表现，本地推理在输出几乎相同的情况下快了 4.2 倍，指出本地 AI 除省钱外的最大价值是节省时间、提升代码产出效率。
Egzakta AI Lab released KVARK Sparkle 1.0, an open-weight 27B model based on Qwen3.8-27B that cuts thinking tokens by up to 67% and doubles median response speed while maintaining comparable accuracy across five standard benchmarks.
The post argues that raw inference speed is becoming as important as model intelligence for AI agents, since agents run dozens of chained calls per task — comparing top throughput setups like N0.5 Flash (~2,000 tok/s), DeepSeek V4.1 Flash, GLM-5.3-Flash, and MiMo-V2.5-Pro UltraSpeed.
DiffuSpace released Clover-35B-A3B-Preview, an open-source block-diffusion language model with a 35B MoE backbone (~3B active params), 128K context, 680 tok/s on GB300, 73.6% SWE-bench Verified, and Apache 2.0 licensing.
Mica v0.5 是一个 4B 参数的决策模型，在单张消费级 GPU 上实现极速推理（256 token 仅 19.8 ms），并在 JevBench Hard 和 JDI 上取得 4B 级别最佳成绩，采用 Apache-2.0 开源协议发布。
Mercury 3 是目前发布的最强扩散式大语言模型，宣称以 1,000+ tokens/s 的速度运行，比竞争对手快 4–8 倍，并在性能上超越 GPT-6 Luna 和 Claude Haiku 5.5，实现 40 倍扩展而不降低速度。
Skyfall announced its new frontier engineering model Sky-001, claiming it outperforms Astra with 100x greater speed and 150x lower cost.
FLUX 3 Max 由 fal Research 与 Black Forest Labs 合作推出，在 Artificial Analysis 图生视频榜单上并列第一，10 秒 720/768p 视频仅需约 12 秒生成，速度远超 Seedance 2.5，并在 fal 上限时 75% 折扣。
Nace AI 发布多模态决策模型 Drex Max，可直接从截图、屏幕录像、扫描文档和图表中快速做出决策，适用于 computer-use 和 browser-use 智能体。该模型在 Mind2Web 上达到 88.3%，Decision Index 得分 67.6，推理速度为 34ms/决策。
MiniMax 发布 M3.1 Flash 模型，速度提升 3 倍、成本降低 70%，专为智能体（agents）场景优化。
llmspeed is an open-source site that lets you preview how fast local LLMs run across a wide range of GPUs, Macs, and CPUs before purchasing hardware, with numbers drawn from community benchmarks and spec-based projections.
Amazon 发布 ALoDLM 自适应循环扩散语言模型家族（1.7B 和 8B，基于 Qwen3 骨干初始化），通过共享层循环复用与自适应计算分配，在推理速度上约为其基座模型的 3 倍，同时在多项基准测试中取得更好成绩。
User shares independent testing results showing that Strata and Swift quantization variants of Qwen3.8 models sacrifice significant intelligence for speed, with the 27B Q4 model delivering better real-world coding results despite being 3-5x slower.
A user with a 128GB Mac Studio M1 Ultra compares running Qwen 3.8 Flash Next versus DeepSeek V4 locally, noting that Flash Next benchmarks higher but takes dramatically longer per task, questioning the practical tradeoff between quality and speed.
Zhipu's GLM-5.3-Highspeed model has appeared in a ZCode gray release, with early users reporting inference speeds of around 490 tokens/s. The model is being rolled out gradually to randomly selected subscribers.
一位评测者在 7900 XTX 上花 16 小时对比了名字夸张的 Qwen3.8-27B-Coder390-EfficientThink 变体与官方原版等模型，发现准确率无明显差异，主要差别在响应速度，最终推荐了更快的 ThinkingCap 版本。
vllm-sr/d3 是 Decision 3.0 的 27B 多模态基础决策模型，支持文本、JSON、图像与视频输入，可在一次调用中完成选择、是非与评分决策并输出概率，无需生成文本。它在 Jev Decision Index 上以 66.3 排名官方文本榜第一，较 Decision 2.0 提升 10.4，并在 AMD MI325X 上实现 27 req/s 的服务性能。
Tibo announces a ~50% speed optimization for GPT-6 Astra and GPT-6.1 Sol across OpenAI products and third-party partners using Sign in With ChatGPT, and a user's test confirms a jump from ~20 tps to ~30 tps.
Liquid AI announced that its decision model d1 now supports images, text, or both as inputs, claiming to match or beat GPT-6.1 Sol on 4 of 6 real-world applications while costing 19x to 200x less and responding significantly faster. d1 returns yes/no, choice, or score probabilities in a single forward pass without generating tokens, answering in 200–300 ms.
The paper introduces DuplexJev, a method that feeds ASR-encoder hidden states through a small connector into a frozen LLM to answer closed-form questions about speech as single-token distributions without decoding, enabling batched decisions about eight utterances in ~0.1s and improving speaker gender/emotion recognition to 90%.