decoding

提出 CADENCE（Context-Adaptive Decoding）方法，通过高斯预测头与学习式路由自适应选择每次解码的跨度长度，在 Llama-3.1-8B-Instruct 上实现最高 1.3× 的生成吞吐提升。

提出训练无关的解码算法 One Block Ahead (OBA)，在块扩散语言模型中并发去噪当前块与下一块并传递采样器状态，在 DiffusionGemma 上将每次前向传递的 token 数提升 42.3%、单请求吞吐提升 16.3%。

The paper proposes Predictive-State Flows (PSF), a continuous diffusion language model design where a rectified-flow prior generates block-level predictive states and a block-causal decoder generates tokens in parallel, significantly reducing diffusion states and sequential depth while improving efficiency and generative quality over models like ELF-B.

This paper introduces hLLM, a decoding strategy for generative reranking that uses the Hungarian algorithm to achieve single-pass decoding, resulting in a 64x speed-up while maintaining ranking quality.

EEG-VID introduces task-guided latent predictive pretraining to improve EEG decoding under session and subject shifts, achieving above-chance target selection in assistive robotics scenarios.

Introduces Faster Flash Decoding (FFD), a training-free hardware-algorithm co-design framework that accelerates long-context decoding in LLMs by exploiting attention sparsity, achieving up to 11.6x speedup and scaling to 256K context length.

Firefox 157 intends to enable JPEG XL decoding by default on all platforms, using the jxl-rs Rust library for improved performance and feature parity with other image formats.

The paper 'On the Entropy Calibration of Language Models' interprets rising entropy as increasing diffusion of accessible pathways in autoregressive generation, proposing that scaling has limited benefits due to heavy-tailed data and suggesting a pathway-aware decoding alternative.

The article explains why tiny JPEGs can look different in Chrome compared to other browsers, due to a JPEG decoding optimization that skips high-frequency DCT coefficients during heavy downscaling.

This paper investigates when classifier-free guidance (CFG) is actually necessary in masked diffusion language models, showing that guidance dependence is prompt-specific and can often be removed without losing constraint satisfaction, leading to a defined 'commitment horizon'.

This paper critiques existing benchmark contamination mitigation metrics and proposes SA-PPG (Stratified Aggregate of Per-question Probability Gaps) for more reliable evaluation, alongside RailCap, a decoding-time mitigation method that caps greedy fallback tokens to suppress memorization.

This paper introduces LATCH, a training-free candidate-aware early-exit framework for diffusion language models that separates when to stop from where to accelerate, achieving 9.3-17.8x speedups on short-answer tasks and 2-3.3x on long-reasoning tasks with minimal accuracy loss on LLaDA and Dream.

DeepLook is a training-free framework that improves LLM reasoning by allocating compute at uncertainty bottlenecks, reducing token generation by 87.3% on average while improving accuracy on competition math benchmarks.

DecodeShare proposes a method to identify a low-dimensional subspace consistently shared across tasks in LLM decode-time hidden states and shows that disturbing this subspace degrades decision performance more than random or prefill-derived subspaces, with implications for activation steering.

Introduces Deco-G, a decoding framework that separates format adherence from problem-solving in LLMs, using a Format Estimation Module to ensure compliance without degrading reasoning. Achieves improved accuracy on mathematical reasoning, event extraction, and LLM-as-a-judge tasks.

Discusses methods for generating structured outputs from large language models using constrained sampling techniques.

A blog post details the discovery and decoding of an obfuscated bash script printed on a Uniqlo t-shirt as part of Akamai's Peace for All campaign, which reveals a hidden Easter egg message when executed.

TACG is a training-free decoder for diffusion language models that uses trajectory-aware signals to decide when to commit tokens, improving accuracy and efficiency on code and math benchmarks.

An analysis comparing prefill and decoding phases in LLM inference, questioning whether prefill is underappreciated in terms of ROI for local LLM deployments.

Fable 5 demonstrates impressive ability to decode shorthand where users type the first letter of each word, accurately reconstructing the intended message.