spectral-transform

Tag

Cards List
#spectral-transform

SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

arXiv cs.LG · 13h ago Cached

SPECTRA is a training-free codec that re-encodes LLM KV caches via spectral transform to concentrate bit budgets on important channels, achieving near-lossless 4x compression and usable compression up to 12x, surpassing the 2-bit quantization cliff.

0 favorites 0 likes
← Back to home

Submit Feedback