needle-in-a-haystack

This paper introduces HOLA, a method that gives fast AI models (like linear-attention and state-space models) an additional memory cache to store surprising facts, improving their recall in long-context tasks without sacrificing speed.