inertia-kv

Tag

Cards List
#inertia-kv

What Matters for Aggressive Decoding-Time KV Eviction? Temporal Aggregation and Ranking Preservation

arXiv cs.AI · 4h ago Cached

This paper investigates the importance of temporal aggregation and ranking preservation in decoding-time KV cache compression for AI models, introducing InertiaKV methods to improve decode throughput.

0 favorites 0 likes
← Back to home

Submit Feedback