rate-distortion-theory

Tag

Cards List
#rate-distortion-theory

Memory Is Communication: The Frontier Between Remembering and Signaling

arXiv cs.AI · 18h ago Cached

This paper explores the trade-off between memory and peer communication in bounded agents, proposing a 'remembering–signaling frontier' to optimize information allocation for task performance under resource limits.

0 favorites 0 likes
#rate-distortion-theory

RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory

arXiv cs.LG · 2026-05-11 Cached

This paper introduces RateQuant, a method for optimal mixed-precision KV cache quantization that uses rate-distortion theory to address distortion model mismatch. It significantly reduces perplexity compared to existing methods like KIVI and QuaRot with minimal calibration overhead.

0 favorites 0 likes
← Back to home

Submit Feedback