vlm-inference

Tag

Cards List
#vlm-inference

New model from Telperion: Qwen3.8-27B-MLA & Qwen3.8-27B-GLA-g2. 4x smaller KV cache, smarter, and more efficient reasoning.

Reddit r/LocalLLaMA ↗ · 6d ago

Telperion 发布了 Qwen3.8-27B 的潜在注意力(MLA 与 GLA-g2)变体,将 KV cache 压缩 4 倍,在消费级硬件上实现接近 4 倍的最大上下文或服务器端 4 倍并发,并在 SWE-bench Verified 上取得 +6.58% 的性能提升,同时减少约 20% 的推理 token 消耗。

0 favorites 0 likes
← Back to home

Submit Feedback