Why decay is the wrong model for agent memory facts (and what write-time supersession actually looks like)
Summary
The article critiques treating fact staleness as relevance decay in agent memory, advocating for splitting memory by type at write time and using write-time contradiction checks for facts instead of decay, citing Mem0's implementation. It warns that decay works for episodic data but not for facts, which can lead to agents confidently stating contradictory information.
Similar Articles
When Retrieval Is Not Enough: Obsolete Facts in Agent Memory
This paper shows that retrieving the correct fact is insufficient for memory agents, as an obsolete competing statement harms accuracy more than unrelated evidence of the same size, evaluated on MemoryAgentBench's FactConsolidation task with Qwen2.5 and Qwen3 models.
The agent failure mode no eval catches: acting on a fact that was true when it was cached and wrong when it was used
Discusses a blind spot in AI agent reliability: cached facts that were true when ingested but become stale by the time they are used, leading to coherent but incorrect actions. Proposes separating consistency (match with source) from currency (source still true now), and asks how the community handles this.
Tested how long small models hold a fact across a conversation. The memory failure mode is a real problem for agents, and it's not what I expected.
A developer tested how small edge models (LFM2.5, Gemma variants) retain a single fact across conversation turns, finding that models often confidently deny knowing information that remains in context, posing a trust issue for agent architectures and suggesting a trade-off between memory and format discipline.
Every agent memory system is benchmarked on recall. Almost none check whether the memory is still true
Argues that agent memory systems are evaluated on recall but not on whether recalled facts remain true; introduces a 'correctness under staleness' benchmark showing vector stores return stale facts 68% of the time.
starting to think “agent memory” is the wrong first framing
The author argues that 'agent memory' is the wrong first framing because it conflates working state and durable memory, leading to debugging issues. They advocate separating messy working state (which should expire) from strict durable memory with provenance and authority.