Nemotron 3 Ultra. 550 billion parameters, 55B active. 1 million context
Summary
NVIDIA releases Nemotron 3 Ultra, a massive 550 billion parameter mixture-of-experts model with 55B active parameters and a 1 million token context window.
Similar Articles
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
NVIDIA releases Nemotron-3-Ultra, a 550B-parameter open-weight model with a hybrid architecture combining Mamba-2, MoE, and attention, supporting up to 1M token context and configurable reasoning mode.
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Hugging Face
NVIDIA releases Nemotron-3-Ultra-550B-A55B, a 550B parameter (55B active) frontier LLM featuring a hybrid LatentMoE architecture combining Mamba-2, MoE, and Attention layers, with up to 1M token context length and configurable reasoning mode. It supports 11 languages and is optimized for complex agentic workflows, long-context analysis, and high-accuracy reasoning.
Nemotron 3 Ultra by NVIDIA
NVIDIA introduces Nemotron 3 Ultra, a new AI model designed to enable faster and more efficient reasoning for long-running agents.
@ctnzr: We've gone even farther: Nemotron 3 Super is 120B and pretrained on 25T tokens in NVFP4. Nemotron 3 Ultra is ~500B and …
NVIDIA announces Nemotron 3 Super (120B) and Nemotron 3 Ultra (~500B) models, pretrained on 25T tokens using NVFP4 precision, emphasizing accelerated computing and efficiency improvements.
@mervenoyann: NVIDIA Nemotron Ultra is here > 55B/550B a hybrid MoE  with 1M context window > supports MTP speculative decoding > da…
NVIDIA released Nemotron Ultra, a hybrid MoE model with 55B/550B parameters and a 1M context window, supporting MTP speculative decoding and available day-0 in transformers.