parallel-decoding

Tag

Cards List
#parallel-decoding

Asynchronous Flow Map Language Models

arXiv cs.CL ↗ · 2026-11-02 Cached

提出了异步流映射语言模型(aFMLM),通过token级时间调度将预测顺序编码进单步生成的隐藏计算中,在Sudoku和GSM8K代码生成任务上刷新了一步生成的最先进性能。

0 favorites 0 likes
#parallel-decoding

OBB-PBD: Extending Parallel Box Decoding to Oriented Bounding Boxes for Referring Expression Grounding in Aerial Imagery

Hugging Face Daily Papers ↗ · 2026-10-26 Cached

OBB-PBD extends Parallel Box Decoding from horizontal to oriented bounding boxes via double-angle parameterization, validating the design with shuffle controls and leakage probes, and improving rotated IoU on the aerial vehicle visual grounding benchmark from 0.1253 to 0.303.

0 favorites 0 likes
#parallel-decoding

Large Flow Language Models

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

The paper presents Lafa, an 8B-parameter blockwise continuous flow language model trained with under 30B tokens that matches or surpasses autoregressive quality while achieving 2.54x inference throughput via self-speculative decoding and blockwise parallel decoding.

0 favorites 0 likes
#parallel-decoding

On-Policy Residual Learning for Diffusion Language Models

arXiv cs.LG ↗ · 2026-10-16 Cached

该论文提出ORL(On-policy Residual Learning)框架,通过熵收缩目标与异步残差捕获等系统级协同设计,使扩散语言模型(DLM)在相近质量下将吞吐量提升至约6.9×,在单请求解码速度上超越自回归模型的推测解码方案。

0 favorites 0 likes
#parallel-decoding

@yoheinakajima: look at the way this thing generates

X AI KOLs Following ↗ · 2026-10-14 Cached

Yohei Nakajima 转发介绍 Next-Concept Modeling (NCM):一种快速、并行、由粗到细的文本生成新范式,在摘要等下游任务上相比同规模扩散语言模型最快可达 31 倍加速。

0 favorites 0 likes
#parallel-decoding

Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

DiffDiffusion提出一种受扩散模型启发的LLM框架,通过预测编辑路径而非重新生成整个代码段来实现高效代码编辑,在公共基准上比自回归基线快2.78倍,并在生产环境中将P50模型延迟降低39.0%。

0 favorites 0 likes
#parallel-decoding

@djjruhe: Introducing Gumbel Straight Flow : Distilling Autoregressive Models into One-step Flow Maps Can autoregressive (languag…

X AI KOLs Timeline ↗ · 2026-10-02 Cached

Introduces Gumbel Straight Flow, a method for distilling autoregressive language models into one-step flow maps that enable parallel sampling.

0 favorites 0 likes
#parallel-decoding

FastGuide: Accelerating Reward Guidance for Diffusion Large Language Models

arXiv cs.CL ↗ · 2026-09-30 Cached

FastGuide 是一种自适应的并行与自回归混合解码方法,通过复用奖励模型反向传播计算、利用 KV 缓存和稀疏注意力重计算来加速扩散大语言模型的梯度奖励引导,在三个奖励基准上实现最高 4.4× 加速同时保持相近生成质量。

0 favorites 0 likes
#parallel-decoding

Less Uniform Discrete Diffusion is More Powerful and Scalable

arXiv cs.CL ↗ · 2026-09-30 Cached

This paper proposes LUDI, a less uniform diffusion language modeling framework that fixes over-uniform training objectives and condition-target confusion in uniform diffusion LMs, enabling a 7B-scale UDLM with 3x-token-per-step speedup over autoregressive decoding and competitive complex reasoning performance.

0 favorites 0 likes
#parallel-decoding

GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed

Hugging Face Daily Papers ↗ · 2026-09-30 Cached

GroundAnything 提出一个 4B 参数的视觉定位基础模型,通过块状去噪协调并行解码与精确定位,在 30 个 grounding 基准上取得同类模型新 SOTA(72.42%),并借助自投机解码实现 4.51 倍加速。

0 favorites 0 likes
#parallel-decoding

WaveFront Decoding: Parallelized Self-Speculative Decoding for Looped Language Models

Hugging Face Daily Papers ↗ · 2026-09-26 Cached

WaveFront Decoding introduces a training-free self-speculative decoding framework for looped language models that reduces latency by concurrently batching drafting and verification, achieving up to 4.81x speedup on Huginn-3.5B.

0 favorites 0 likes
#parallel-decoding

Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs

Hugging Face Daily Papers ↗ · 2026-09-22 Cached

Flash-dLLM is a training-free inference acceleration framework for diffusion LLMs that uses IO-aware KV caching and parallel decoding to achieve significant speedups and memory efficiency improvements.

0 favorites 0 likes
#parallel-decoding

Scaling E-Commerce Attribute Extraction with Parallel Decoding

arXiv cs.CL ↗ · 2026-09-10 Cached

The paper introduces a two-stage LLM pipeline using fine-tuned Qwen3-4B with Hyper-Parallel Decoding to extract purchase-discriminative attributes in e-commerce, achieving 85% accuracy with 92% cost reduction.

0 favorites 0 likes
#parallel-decoding

alibaba-pai/MiniMax-H3-Acc-LoRAs

Hugging Face Models Trending ↗ · 2026-08-26 Cached

Alibaba PAI releases LoRA checkpoints for accelerating MiniMax-H3 video generation using Parallel Decoding Distillation, enabling efficient inference in 8 steps.

0 favorites 0 likes
#parallel-decoding

CForce: Boosting Parallel Decoding for dLLMs via Consistency Forcing

arXiv cs.CL ↗ · 2026-08-17 Cached

The paper introduces Consistency Forcing (CForce), a distillation technique for diffusion large language models that improves parallel decoding by aligning early-stage predictions with later stages, enhancing speed-quality trade-offs.

0 favorites 0 likes
#parallel-decoding

Ripple-Pivot Search: Active Parallel Decoding for Diffusion Large Language Models

arXiv cs.CL ↗ · 2026-08-13 Cached

Proposes Ripple-Pivot Search, a training-free decoding method for diffusion large language models that proactively commits mid-entropy pivot positions to reduce uncertainty and accelerate parallel decoding, achieving 4-10x speedup.

0 favorites 0 likes
#parallel-decoding

PaDoc: Layout-Grounded Parallel Decoding for Document Parsing

Hugging Face Daily Papers ↗ · 2026-08-06 Cached

PaDoc introduces a layout-grounded parallel decoding method for end-to-end document parsers, decoupling layout and content decoding to reduce decoding depth and improve throughput. It achieves state-of-the-art results on OmniDocBenchFull and significantly speeds up inference compared to sequential baselines.

0 favorites 0 likes
#parallel-decoding

Parallel Decoding for Video Generation (10 minute read)

TLDR AI ↗ · 2026-07-30 Cached

NVIDIA introduces Parallel Decoding Distillation (PDD) for accelerating image and video generation, enabling high-quality outputs with fewer neural function evaluations on models like LTX-2.3 and Wan2.1-14B.

0 favorites 0 likes
#parallel-decoding

Parallel Decoding Distillation for Fast Image and Video Generation

Hugging Face Daily Papers ↗ · 2026-07-28 Cached

Parallel Decoding Distillation (PDD) is a trajectory-based distillation method that accelerates image and video generation by predicting multiple denoising steps per network evaluation, achieving state-of-the-art performance with 4-8 NFEs on models like LTX-2.3, Wan14B, and Qwen-Image.

0 favorites 0 likes
#parallel-decoding

DC-Leap: Training-Free Acceleration of dLLMs via Draft-Guided Contiguous Leaping Decoding

arXiv cs.AI ↗ · 2026-07-24 Cached

Proposes DC-Leap, a training-free framework that accelerates diffusion large language models by introducing dynamic contiguous verification and draft-guided decoding, achieving up to 105× speedup with comparable generation quality.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback