decoding-strategy

Tag

Cards List
#decoding-strategy

Deeper is Not Always Better: Mitigating the Alignment Tax via Confident Layer Decoding

Hugging Face Daily Papers · 2026-06-20 Cached

This paper introduces Confident Decoding, a training-free decoding strategy that dynamically selects the most reliable intermediate layer in LLMs using entropy-guided search, mitigating the alignment tax and improving reasoning performance on benchmarks like GPQA-Diamond and Omni-MATH with negligible overhead.

0 favorites 0 likes
#decoding-strategy

From Context-Aware to Conflict-Aware: Generalizing Contrastive Decoding for Knowledge Conflict in LLMs

arXiv cs.AI · 2026-06-10 Cached

The paper generalizes contrastive decoding to a conflict-aware paradigm that dynamically allocates authority between external context and parametric priors, proposes the TriState-Bench evaluation protocol, and introduces Adaptive Regime Routing (ARR) to resolve asymmetry between correction and resistance.

0 favorites 0 likes
#decoding-strategy

Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding

arXiv cs.LG · 2026-06-10 Cached

This paper introduces MGAP, a training-free decoding method that reduces hallucinations in Multimodal Large Language Models by adaptively suppressing only the harmful parts of language priors while preserving the model's semantic manifold. The method outperforms prior baselines on POPE and CHAIR benchmarks.

0 favorites 0 likes
#decoding-strategy

Intermittent random token injection during decoding stage increases LLM diversity without fine-tuning

Reddit r/ArtificialInteligence · 2026-05-11

A Harvard research paper introduces Recoding-Decoding (RD), a novel decoding scheme that injects random priming phrases and diverting tokens to tap into an LLM's long-tail knowledge, significantly boosting output diversity without fine-tuning. The method maintains high relevance while mitigating response homogenization, with stronger models showing greater diversity gains.

0 favorites 0 likes
← Back to home

Submit Feedback