Tag
Propose Fractional Decay KV-Cache (FD-KVC), an ownership-aware memory management algorithm for dialog systems that uses dual-channel scoring to improve inference relevancy, outperforming H2O by +6.7% in composite metrics and adapting faster to topic shifts.