@PavloMolchanov: We’re releasing Nemotron-Labs-Diffusion - the first Tri-mode LM family (3B/8B/14B) that switches between Autoregressive…
Summary
NVIDIA releases Nemotron-Labs-Diffusion, the first tri-mode language model family (3B/8B/14B) that switches between autoregressive, diffusion, and self-speculation decoding by changing the attention pattern, achieving up to 4× higher real throughput.
View Cached Full Text
Cached at: 05/20/26, 02:25 AM
We’re releasing Nemotron-Labs-Diffusion - the first Tri-mode LM family (3B/8B/14B) that switches between Autoregressive, Diffusion, and Self-Speculation decoding by simply changing the attention pattern/mask.
One model Three decoding modes. No extra draft models. No architecture changes. Just significantly better efficiency across different concurrency levels.
Up to 4× higher real throughput for a single user.
HF Collection: https://huggingface.co/collections/nvidia/nemotron-labs-diffusion…, open license Project page: https://research.nvidia.com/publication/2026-05_nemotron-labs-diffusion-tri-mode-language-model-unifying-autoregressive… Tech report: http://bit.ly/Nemotron-Labs-Diffusion-Report…
Details below
Nemotron-Labs-Diffusion - a nvidia Collection
Source: https://huggingface.co/collections/nvidia/nemotron-labs-diffusion updatedabout 8 hours ago
Set of models of internal diffusion models
- —
#### nvidia/Nemotron-Labs-Diffusion-8B Text Generation• 8B• Updatedabout 8 hours ago • 12.5k • 5 - — #### nvidia/Nemotron-Labs-Diffusion-VLM-8B Image-Text-to-Text• 9B• Updatedabout 8 hours ago • 1 • 4
- — #### nvidia/Nemotron-Labs-Diffusion-14B Text Generation• 14B• Updatedabout 8 hours ago • 11 • 14
- — #### nvidia/Nemotron-Labs-Diffusion-3B Text Generation• 4B• Updatedabout 8 hours ago • 10.6k • 6
- — #### nvidia/Nemotron-Labs-Diffusion-14B-Base Text Generation• 14B• Updatedabout 8 hours ago • 160 • 1
- — #### nvidia/Nemotron-Labs-Diffusion-8B-Base Text Generation• 8B• Updatedabout 8 hours ago • 170k
- — #### nvidia/Nemotron-Labs-Diffusion-3B-Base Text Generation• 4B• Updatedabout 8 hours ago • 12.5k • 2
Similar Articles
nvidia/Nemotron-Labs-Diffusion-14B
NVIDIA releases Nemotron-Labs-Diffusion, a family of tri-mode language models (3B, 8B, 14B) supporting AR, diffusion, and self-speculation decoding, achieving 2.7x-4x speed-ups over standard AR decoding.
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
The paper introduces Nemotron-Labs-Diffusion, a tri-mode language model that unifies autoregressive, diffusion, and self-speculation decoding, achieving superior throughput and efficiency compared to existing models.
Nemotron-Labs-Diffusion from NVIDIA
NVIDIA released the Nemotron-Labs-Diffusion model family (3B to 14B) that supports both AR and diffusion decoding with novel self-speculation, achieving significant speedups (up to 4x) over standard AR and Eagle3 methods across hardware platforms.
NVIDIA has released Nemotron-TwoTower-30B-A3B-Base-BF16, an unusual diffusion-based language model built from the Nemotron 3 Nano 30B-A3B backbone.
NVIDIA released Nemotron-TwoTower-30B-A3B-Base-BF16, a diffusion-based language model that uses block-wise autoregressive diffusion to generate text by iterative denoising of token blocks, achieving 2.42× the generation throughput of the autoregressive baseline while retaining 98.7% of benchmark quality.
@NVIDIAAI: Most language models only generate one token at a time. We just released Nemotron-Labs-Diffusion, a family of diffusion…
NVIDIA released Nemotron-Labs-Diffusion, a family of diffusion language models that generate multiple tokens in parallel, enabling faster inference and better GPU utilization, with sizes from 3B to 14B including vision-language variants.