key-value-cache-compression

Tag

Cards List
#key-value-cache-compression

BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference

Hugging Face Daily Papers ↗ · 2026-09-04 Cached

BeaconKV is a training-free method that uses beacon queries to compress key-value cache for efficient inference in Large Reasoning Models, reducing memory usage and improving throughput without sacrificing accuracy.

0 favorites 0 likes
← Back to home

Submit Feedback