predictive-entropy

Tag

Cards List
#predictive-entropy

Beyond the Context Window: An Adaptive Entropy-Based Routing Framework for Hybrid Retrieval and Long-Context Language Models

arXiv cs.CL ↗ · 2026-09-30 Cached

The paper proposes EDAR, an entropy-driven adaptive routing framework that decides at inference time whether to answer a query with retrieval-augmented generation or escalate it to full long-context processing. EDAR retains 97.4% of the pure long-context baseline's accuracy while cutting token cost by 70.7%, escalating only 18.2% of queries on LongBench v2 and Infinity-Bench.

0 favorites 0 likes
#predictive-entropy

Length-Adaptive Decoding for Masked Diffusion Machine Translation

Hugging Face Daily Papers ↗ · 2026-08-23 Cached

This paper introduces Entropy-Valley, a training-free length selector for masked diffusion machine translation that uses predictive entropy to improve adequacy, showing that length choice matters more than unmasking order.

0 favorites 0 likes
← Back to home

Submit Feedback