ascend-tribe/openPangu-2.0-Flash (They haven't uploaded it to Huggingface yet)

Reddit r/LocalLLaMA Models

Summary

openPangu-2.0-Flash is a 92B MoE model with 6B activated parameters, 512k context, trained on Ascend with 34T tokens, incorporating slow/fast thinking and multiple RL training stages.

https://ai.gitcode.com/ascend-tribe/openPangu-2.0-Flash openPangu-2.0-Flash is an MoE model trained on Ascend. The model has 92B total parameters and 6B activated parameters. Its context length is 512k. The total pretraining data contains 34T tokens. During Post-training, openPangu-2.0-Flash is trained through unified SFT with slow and fast thinking capability, multiple specialist RL traning, on-policy distillation combining multiple RL specialists.
Original Article

Similar Articles

README_EN.md · openpangu/openPangu-2.0-Flash at main

Reddit r/LocalLLaMA

openPangu-2.0-Flash is a 92B-parameter MoE model with 6B activated parameters, trained on Ascend, featuring 512k context length and fast thinking capabilities. It achieves strong performance on reasoning and coding benchmarks, using architectural innovations like MLA attention and multi-token prediction.

stepfun-ai/Step-3.7-Flash-GGUF

Hugging Face Models Trending

StepFun releases GGUF quantizations of their 198B-parameter sparse MoE vision-language model Step-3.7-Flash, enabling local deployment with up to 256K context and selectable reasoning levels.