AMD Instella-MoE-16B-A3B

Reddit r/LocalLLaMA Models

Summary

AMD released an open-source Mixture-of-Experts model Instella-MoE-16B-A3B on HuggingFace.

https://huggingface.co/amd/Instella-MoE-16B-A3B-Think I was browsing HuggingFace and came across this model apparently uploaded a day ago, and thought to share it here. I've not tried it out yet, but it's good to see AMD joining the open source model game.
Original Article

Similar Articles

amd/Instella-MoE-16B-A3B-Think

Hugging Face Models Trending

AMD releases Instella-MoE, a fully open 16B-parameter Mixture-of-Experts language model with 2.8B active parameters, trained from scratch on AMD Instinct GPUs and released across all training stages from pre-training to reinforcement learning.

tencent/Hy3

Simon Willison's Blog

Tencent released Hy3, a 295B-parameter Mixture-of-Experts model with 21B active parameters, under Apache 2.0 license, outperforming similar-size models and rivaling larger open-source models with 2-5x parameters.

MobileMoE: Scaling On-Device Mixture of Experts

Hugging Face Daily Papers

MobileMoE introduces efficient on-device mixture-of-experts language models with sub-billion parameters, achieving better performance and efficiency than dense baselines and existing MoE models. The models are trained on open-source datasets and demonstrate significant speedups on commodity smartphones.

Mixture of Experts (MoEs) in Transformers

Hugging Face Blog

Hugging Face blog post explaining Mixture of Experts (MoEs) architecture in Transformers, covering the shift from dense to sparse models, weight loading optimizations, expert parallelism, and training techniques for MoE-based language models.