MiMo-V3 is getting a new architecture. The core of it, HySparse2, is out today.
Summary
MiMo-V3 is being updated with a new architecture centered on HySparse2, which has been released as a preprint on arXiv.
Similar Articles
MiMo v2.6 pro
MiMo v2.6 pro is an AI model released with open weights, and it is suggested to have impressive performance in benchmarks.
XiaomiMiMo/MiMo-V2.5-Pro-FP4-DFlash
XiaomiMiMo releases MiMo-V2.5-Pro-FP4-DFlash, an FP4-quantized MoE model with block-diffusion speculative decoding to reduce memory and bandwidth for trillion-parameter inference.
Xiaomi MiMo v2.6
Xiaomi has released version 2.6 of its MiMo model, suggesting an incremental update to its AI capabilities.
XiaomiMiMo/MiMo-V2.5-Pro
Xiaomi releases MiMo-V2.5-Pro, an open-source MoE language model with 1.02T total parameters and 1M token context, optimized for complex agentic and software engineering tasks.
Xiaomi open-sources MiMo-V2.6 Pro and Flash models (2 minute read)
Xiaomi has open-sourced the MiMo-V2.6 series, introducing two omnimodal AI models, Pro and Flash, that perform competitively with top proprietary models and are available for various applications.