512k-context

dots3-note Preview is an AI model targeting autonomous agency and dynamic real-world environments with a 512K context window.

openPangu-2.0-Flash is a 92B MoE model with 6B activated parameters, 512k context, trained on Ascend with 34T tokens, incorporating slow/fast thinking and multiple RL training stages.