decoding

Tag

Cards List
#decoding

Distilling Long-CoT Reasoning through Collaborative Step-wise Multi-Teacher Decoding

Hugging Face Daily Papers · 2026-05-04 Cached

CoRD is a collaborative multi-teacher decoding framework that synthesizes reasoning trajectories through predictive perplexity scoring and beam search, enabling efficient distillation of large reasoning models with high-quality outputs and generalized performance.

0 favorites 0 likes
#decoding

No-Worse Context-Aware Decoding: Preventing Neutral Regression in Context-Conditioned Generation

arXiv cs.CL · 2026-04-21 Cached

A research paper proposing NWCAD (No-Worse Context-Aware Decoding), a decode-time adapter that prevents 'neutral regression' where LLMs overwrite already-correct answers when given non-informative context, using a two-stream architecture with gated fallback to no-context decoding.

0 favorites 0 likes
← Previous
← Back to home

Submit Feedback