phase-sensitivity

This paper identifies 'phase sensitivity' in models using chunked KV-cache compression, showing that retrieval accuracy oscillates in cycles matching the compression stride and can flip answers or shift long-context accuracy by up to 40 points at 128K tokens, an effect confirmed via controlled 0.6B pretraining experiments to stem from the compression itself.