transform-coding

Tag

Cards List
#transform-coding

Spend Bits Where Queries Look: KV Cache Vector Quantization with Attention-Preserving Transforms

arXiv cs.LG · 3d ago Cached

This paper proposes NOVA-KV, a transform-coding approach to KV cache quantization that uses attention-preserving transforms to allocate bits where queries actually attend, improving long-context retrieval accuracy at low bit rates compared to prior methods.

0 favorites 0 likes
← Back to home

Submit Feedback