binary-masking

Tag

Cards List
#binary-masking

BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE

arXiv cs.AI · 2026-05-15 Cached

BEAM introduces binary expert activation masking for dynamic routing in Mixture-of-Experts LLMs, achieving up to 85% FLOPs reduction with minimal performance loss and up to 2.5× faster decoding.

0 favorites 0 likes
← Back to home

Submit Feedback