Huawei open-sources OpenPangu-2.0-Flash - 92B total,6B active

Reddit r/LocalLLaMA Models

Summary

Huawei open-sources OpenPangu-2.0-Flash, a 92B-parameter MoE model with 6B active parameters and 512K context, along with inference code and training operations.

https://x.com/Chinazhidx/status/2071877413685109071 TODAY: #Huawei open-sources OpenPangu-2.0-Flash #OpenPangu 2.0 includes two 512K-context models: • Flash: 92B total,6B active—Weights+inference code+training ops released • Pro: 505B total,18B active—flagship model, coming in July More open-source components later this year https://preview.redd.it/29tji3noteah1.png?width=1446&format=png&auto=webp&s=836b711cc97c5efb3d37126105a11a7d20c49ca2 https://x.com/CalatheaAI/status/2071917592810496273
Original Article

Similar Articles

Huawei Released openPangu 2.0 (Will open source on June 30)

Reddit r/LocalLLaMA

Huawei announced openPangu 2.0, an open-source large model with 505B total parameters and a 28:1 sparsity ratio, optimized for Ascend computing and HarmonyOS, with key components to be open-sourced starting June 30.