hybrid-swa

Tag

Cards List
#hybrid-swa

Inference Optimization for MiMo v2.5: Pushing Hybrid SWA Efficiency to the Limit

Hacker News Top · 2026-07-07 Cached

Details end-to-end inference optimization for Xiaomi's MiMo-V2.5 series, combining hybrid sliding window attention, sparse MoE activation, and multimodal encoders to achieve near-theoretical efficiency gains in long-context and multimodal scenarios.

0 favorites 0 likes
← Back to home

Submit Feedback