DiffResearch: Accelerating Deep Research with Diffusion Language Models

Hugging Face Daily Papers Papers

Summary

DiffResearch 将自回归骨干替换为扩散语言模型(dLLM)用于多智能体深度研究,在 Deep Research Bench 上实现约 6 倍端到端加速并提升报告质量,还提出 dFast 提前从去噪状态提取子查询,以 Apache-2.0 开源。

Deep research systems iteratively plan, gather evidence, synthesize, and revise, making end-to-end latency a key bottleneck for interactive use. Almost all production systems are built on autoregressive (AR) language models and inherit left-to-right decoding in planning and long-form writing. We present DiffResearch, an open multi-agent deep research framework that places a diffusion language model (dLLM) at the core of every stage, and measure how a diffusion backbone changes latency and report quality. Holding the agentic scaffold, retrieval code, prompts, and evaluation fixed, we swap the backbone between an open diffusion model and a comparable AR model. Across 100 Deep Research Bench tasks, the diffusion backbone is roughly 6 times faster end-to-end, driven by order-of-magnitude reductions in planning and writing. We further introduce dFast, a decomposition mode that reads intermediate denoising states and extracts subqueries before generation finishes, providing a 1.99 times median speedup for decomposition in isolation with no loss of report quality. On the benchmark's RACE rubric, dFast obtains the best overall score among the three configurations. Finally, in a public system-level leaderboard snapshot, an instance built on a stronger diffusion model ranks above several commercial systems. We release DiffResearch under an Apache-2.0 license.
Original Article
View Cached Full Text

Cached at: 10/22/26, 07:36 PM

Paper page - DiffResearch: Accelerating Deep Research with Diffusion Language Models

Source: https://huggingface.co/papers/2610.28909

Abstract

DiffResearch replaces autoregressive backbones with diffusion language models in multi-agent deep research, achieving large latency reductions and improved report quality via iterative planning and early subquery extraction.

Deep research systems iteratively plan, gather evidence, synthesize, and revise, making end-to-end latency a key bottleneck for interactive use. Almost all production systems are built on autoregressive (AR) language models and inherit left-to-right decoding in planning and long-form writing. We present DiffResearch, an openmulti-agent deep researchframework that places adiffusion language model(dLLM) at the core of every stage, and measure how adiffusion backbonechanges latency and report quality. Holding the agentic scaffold, retrieval code, prompts, and evaluation fixed, we swap the backbone between an open diffusion model and a comparable AR model. Across 100 Deep Research Bench tasks, thediffusion backboneis roughly 6 times faster end-to-end, driven by order-of-magnitude reductions in planning and writing. We further introducedFast, a decomposition mode that reads intermediatedenoising statesand extracts subqueries before generation finishes, providing a 1.99 times median speedup for decomposition in isolation with no loss of report quality. On the benchmark’s RACE rubric,dFastobtains the best overall score among the three configurations. Finally, in a public system-level leaderboard snapshot, an instance built on a stronger diffusion model ranks above several commercial systems. We release DiffResearch under an Apache-2.0 license.

View arXiv pageView PDFGitHub41Add to collection

Get this paper in your agent:

hf papers read 2610\.28909

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.28909 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.28909 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.28909 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

On-Policy Residual Learning for Diffusion Language Models

arXiv cs.LG

该论文提出ORL(On-policy Residual Learning)框架,通过熵收缩目标与异步残差捕获等系统级协同设计,使扩散语言模型(DLM)在相近质量下将吞吐量提升至约6.9×,在单请求解码速度上超越自回归模型的推测解码方案。