small-activation-params

Tag

Cards List
#small-activation-params

@VukRosic99: Li Auto's Mach-Mind-4-Flash: a 35B MoE with only 3B active params that matches 100B-class models through post-training …

X AI KOLs Timeline · 2026-07-13 Cached

Li Auto's Mach-Mind-4-Flash is a 35B MoE model with only 3B active parameters that, through post-training optimization using a unified RL/on-policy distillation loss, achieves performance matching or surpassing 100B-parameter models across multiple benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback