ascend-tribe/openPangu-2.0-Flash (They haven't uploaded it to Huggingface yet)
Summary
openPangu-2.0-Flash is a 92B MoE model with 6B activated parameters, 512k context, trained on Ascend with 34T tokens, incorporating slow/fast thinking and multiple RL training stages.
Similar Articles
README_EN.md · openpangu/openPangu-2.0-Flash at main
openPangu-2.0-Flash is a 92B-parameter MoE model with 6B activated parameters, trained on Ascend, featuring 512k context length and fast thinking capabilities. It achieves strong performance on reasoning and coding benchmarks, using architectural innovations like MLA attention and multi-token prediction.
Huawei open-sources OpenPangu-2.0-Flash - 92B total,6B active
Huawei open-sources OpenPangu-2.0-Flash, a 92B-parameter MoE model with 6B active parameters and 512K context, along with inference code and training operations.
@AdinaYakup: Step-3.7-Flash New VL model from @StepFun_ai 198B / 11B active - MoE 256K context 3 reasoning level Up to 400 tokens/sec
StepFun releases Step-3.7-Flash, a new large vision-language MoE model with 198B parameters (11B active), 256K context, and up to 400 tokens/sec inference speed.
Ling-3.1-flash: ~560B total params, ~25B active/token, up to 1M-token context- Free trail for 2 weeks then open source
Ling-3.1-flash is a ~560B-parameter MoE model with only ~25B active parameters per token and up to 1M-token context, offered with a 2-week free trial before being open-sourced.
stepfun-ai/Step-3.7-Flash-GGUF
StepFun releases GGUF quantizations of their 198B-parameter sparse MoE vision-language model Step-3.7-Flash, enabling local deployment with up to 256K context and selectable reasoning levels.