What Should an Agent Forget? Separating What Is Stored from What Is Used

arXiv cs.AI Papers

Summary

This paper introduces RD-Forget, a training-free framework for persistent language agents that separates stored memory from query-conditioned evidence to handle changing facts while preserving historical information.

arXiv:2609.10263v1 Announce Type: new Abstract: Persistent language agents need stored experience to remain available across time, while each answer requires evidence suited to a particular question. A superseded fact can mislead a current-state answer and still be essential for a historical query. We present RD-Forget, a training-free framework that separates what an agent stores from what it uses. A retained source archive preserves observations, and a query-conditioned memory view controls their influence on the current answer. A frozen language-model curator extracts relevant evidence, groups facts into semantic slots, and preserves the relations needed for multi-hop reasoning. Same-slot replacement links suppress superseded values in current-state contexts, while intent-aware retrieval makes earlier evidence eligible again. A rate-distortion formulation guides construction of the answer-time view within a memory budget. Experiments span conversational memory, knowledge updating, fact consolidation, long-context reasoning, and personalization under a shared answering pipeline. The results associate accurate answers with both query-relevant evidence construction and control over obsolete alternatives. Configurations without forgetting or query conditioning have the largest score deficits, while slot grouping, historical access, and relation preservation contribute complementary functions. Retaining history while selectively controlling its use offers a practical way to accommodate changing facts and future questions.
Original Article
View Cached Full Text

Cached at: 09/11/26, 08:44 AM

# What Should an Agent Forget?Separating What Is Stored from What Is Used
Source: [https://arxiv.org/html/2609.10263](https://arxiv.org/html/2609.10263)
\\submissionType

Conference:; ;Yuhang LiNote:Both authors contributed equally to this work\.Affiliation:Beihang University,Hangzhou,ChinaYuchen LiAffiliation:East China Normal University,Shanghai,China

© none

###### Abstract\.

Persistent language agents need stored experience to remain available across time, while each answer requires evidence suited to a particular question\. A superseded fact can mislead a current\-state answer and still be essential for a historical query\. We present RD\-Forget, a training\-free framework that separates what an agent stores from what it uses\. A retained source archive preserves observations, and a query\-conditioned memory view controls their influence on the current answer\. A frozen language\-model curator extracts relevant evidence, groups facts into semantic slots, and preserves the relations needed for multi\-hop reasoning\. Same\-slot replacement links suppress superseded values in current\-state contexts, while intent\-aware retrieval makes earlier evidence eligible again\. A rate\-distortion formulation guides construction of the answer\-time view within a memory budget\. Experiments span conversational memory, knowledge updating, fact consolidation, long\-context reasoning, and personalization under a shared answering pipeline\. The results associate accurate answers with both query\-relevant evidence construction and control over obsolete alternatives\. Configurations without forgetting or query conditioning have the largest score deficits, while slot grouping, historical access, and relation preservation contribute complementary functions\. Retaining history while selectively controlling its use offers a practical way to accommodate changing facts and future questions\.

###### Keywords:

Language agents, persistent memory, selective forgetting, query\-conditioned retrieval

Figure 1\.Separating storage and use in RD\-Forget\. The archive retains source observations; the query\-conditioned view determines the evidence used for an answer\. Same\-slot replacement suppresses the earlier employer while preserving the independent location relation\. Historical intent and the rescue switch jointly make superseded entries eligible again\. The shared selector and packer construct the answer context, illustrated by the Mira–Beryl–Lyon chain\.Three stages of RD\-Forget: query\-conditioned curation, selective forgetting, and budgeted retrieval and answering\. Mira's employer changes from Acme to Beryl, while Beryl's location remains Lyon\. The old employer is superseded, and the current employer and its location stay active\. Superseded evidence is eligible only when both historical intent and rescue are enabled\. A shared selector and greedy packer produce the context used by a frozen language model to answer Lyon\. The archive remains available for curation when a new query arrives\.## 1\.Introduction

Persistent language agents face two decisions about memory: what experience should remain stored, and what evidence should influence the next answer\. These decisions diverge when the world changes\. An earlier employment record can mislead a question about a user’s current employer while correctly answering a question about a previous job\. The observation remains useful in storage even when its use must change\. Separating retention from answer\-time access allows an agent to preserve history while excluding obsolete alternatives from a current\-state response\.

External memory gives language agents access to information beyond a single interaction\. Generative Agents accumulate observations and reflections\([Park et al\., 2023](https://arxiv.org/html/2609.10263#bib.bib8)\); MemGPT manages information across memory tiers\([Packer et al\., 2023](https://arxiv.org/html/2609.10263#bib.bib7)\); A\-MEM builds linked notes that evolve with new observations\([Xu et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib12)\)\. ACE and ReasoningBank further develop the accumulation and reuse of task experience\([Zhang et al\., 2026a](https://arxiv.org/html/2609.10263#bib.bib13);[Ouyang et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib6)\)\. As experience accumulates, memory management must connect what remains available in storage to what is appropriate for the current answer\.

The use of a fact also depends on its relation to other evidence\. A new employer supersedes an old employer within one relation, while an older fact about the new employer’s location may supply a necessary reasoning step\. Recency alone does not distinguish a competing value from a complementary relation\. A compact general\-purpose memory can omit a relation whose value becomes clear only when the question arrives\. Useful forgetting must therefore respect both the scope of an update and the evidence chain required by the query\.

We make the separation between stored history and used evidence explicit in RD\-Forget\. A source archive retains observations, and a query\-dependent memory view controls their influence on the next answer\. A frozen language\-model curator identifies relevant facts and their semantic slots\. Same\-slot replacement links suppress superseded values for current\-state questions, while historical intent allows earlier evidence to become eligible again\. The curator preserves the relations needed to derive an answer, including complementary facts that remain useful after an update\. Figure[1](https://arxiv.org/html/2609.10263#S0.F1)shows how the retained archive supports these changing views\.

We formulate construction of the answer\-time view through a rate–distortion trade\-off: selected evidence should preserve answer utility within a representation budget\. The archive supplies observations that can be reconsidered when the question changes\. Curation determines relevance, supersession determines revision eligibility, and budgeted selection forms the final context\. Forgetting thus has a query\-local scope: an observation can remain stored while its influence on a particular answer is suppressed\.

We evaluate five task suites with four language models\. The tasks cover conversational memory, knowledge updates, fact consolidation, long\-context reasoning, and personalization\. On fact consolidation, gains over the better\-performing baseline range from 11\.00 to 26\.00 percentage points across the four backbones\. In the matched Luna ablations, the configuration without forgetting scores lowest, followed by the query\-unconditioned configuration\. These results connect the distinction between storage and use to which facts enter the view and which revisions remain eligible for answering\.

## 2\.Related Work

### 2\.1\.Selective forgetting and consolidation

Forgetting can act on the information retained in working context or on the organization of persistent memory\. MemAct learns context insertion and deletion actions through reinforcement learning\([Zhang et al\., 2026b](https://arxiv.org/html/2609.10263#bib.bib14)\)\. FadeMem combines adaptive decay, relevance and access signals, conflict resolution, and memory fusion\([Wei et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib10)\)\. RD\-Forget conditions forgetting on the current question and the semantic scope of a replacement\. An old fact can leave the current answer context while remaining accessible for historical use\. This connects forgetting to changing evidence requirements across queries\.

### 2\.2\.External memory and context organization

Generative Agents store observations, synthesize reflections, and retrieve memories to guide behavior\([Park et al\., 2023](https://arxiv.org/html/2609.10263#bib.bib8)\)\. MemGPT uses virtual context management to move information between memory tiers\([Packer et al\., 2023](https://arxiv.org/html/2609.10263#bib.bib7)\)\. A\-MEM constructs notes with contextual attributes and links, allowing later observations to update earlier memory organization\([Xu et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib12)\)\. These systems provide structures for retaining and accessing experience\. RD\-Forget focuses on constructing the used evidence from retained history, using query intent and semantic slots to distinguish replacement from complementary information\.

### 2\.3\.Experience\-based adaptation

ACE maintains evolving playbooks through generation, reflection, and incremental curation, with structured delta updates and a grow\-and\-refine process\([Zhang et al\., 2026a](https://arxiv.org/html/2609.10263#bib.bib13)\)\. ReasoningBank extracts reusable strategies from successful and failed experiences and combines memory with test\-time computation through MaTTS\([Ouyang et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib6)\)\. Their update policies motivate the comparison between editing existing memory and accumulating additional entries\.

### 2\.4\.Evaluating evolving memories

LoCoMo evaluates long\-term conversational memory\([Maharana et al\., 2024](https://arxiv.org/html/2609.10263#bib.bib5)\)\. LongMemEval distinguishes extraction, multi\-session reasoning, temporal reasoning, knowledge updates, and abstention\([Wu et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib11)\)\. MemoryAgentBench includes conflict resolution through fact consolidation\([Hu et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib3)\)\. BEAM adds long conversations with knowledge\-update, contradiction, temporal, and preference probes\([Tavakoli et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib9)\); PersonaMem evaluates responses aligned with evolving user profiles\([Jiang et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib4)\)\. Together, these tasks expose different consequences of forgetting: obsolete values can corrupt current answers, while discarded history or relations can make later questions unanswerable\.

## 3\.Separating Storage from Use

### 3\.1\.Stored history and used evidence

LetH=\(e1,…,eT\)H=\(e\_\{1\},\\ldots,e\_\{T\}\)be the stored source history available to queryqq\. Observations can carry session identifiers, timestamps, or sequence indices\. Evidence used for answering forms a memory viewZ⁡\(q\)Z\(q\)derived fromHHand passed to a frozen answer modelgθg\_\{\\theta\}\. RD\-Forget constructs this view through evidence extraction, replacement relationships, and eligibility decisions\. These operations change the materialized entries available for an answer; their source observations remain inHH\. A later query can therefore produce a different view from the retained history\.

A rate–distortion formulation applies the representation cost to the answer\-time view and measures distortion through loss of answer utility\([Cover and Thomas, 2005](https://arxiv.org/html/2609.10263#bib.bib2)\):

\(1\)Z∗​\(q\)\\displaystyle Z^\{\*\}\(q\)∈arg⁡minZ⊆C⁡\(q\)​Dq​\(Z\),\\displaystyle\\in\\arg\\min\_\{Z\\subseteq C\(q\)\}D\_\{q\}\(Z\),subject to∑m∈Zc⁡\(m\)≤B,\\displaystyle\\sum\_\{m\\in Z\}c\(m\)\\leq B,whereC⁡\(q\)C\(q\)is the query\-dependent candidate pool and

\(2\)Dq\(Z\)=𝔼\[d\(Y,gθ\(q,Z\)\)∣q,H\]D\_\{q\}\(Z\)=\\mathbb\{E\}\\big\[d\(Y,g\_\{\\theta\}\(q,Z\)\)\\mid q,H\\big\]measures task lossddagainst the correct answerYY\. The query determines which omissions are costly: forgetting a replaced value may help a current\-state answer, while forgetting the same observation can prevent a historical answer\. RD\-Forget implements the selection through language\-model curation, status\-based eligibility, and greedy packing\.

The experiments use the memory accounting rule

\(3\)c\(m\)=Tok\(m\.text\)\+8,B=2,048,c\(m\)=\\operatorname\{Tok\}\(m\.\\mathrm\{text\}\)\+8,\\qquad B=2\{,\}048,whereTok\\operatorname\{Tok\}uses theo200k\_basetokenizer and the constant covers per\-entry overhead\. The budget governs the selected viewZ⁡\(q\)Z\(q\)\. Reading stored history, query text, and other prompt instructions contributes separately to model input\.

### 3\.2\.Building the query\-dependent view

The curator extracts active evidence and facts identified as replaced fromHHforqq\. Each item contains an atomic statement, a proposed fact slot, a source\-evidence string, and an optional validity time\. The slot has the formsubject\|relation\|scope\. It makes replacement specific to a relation: changing a person’s employer updates their employment slot, while a fact about the employer’s location belongs to another slot\.

The curator is prompted to extract the smallest complete evidence set needed by the question\. For a multi\-hop query, it retains each relation needed to reach the answer and resolves updates within each hop\. In Figure[1](https://arxiv.org/html/2609.10263#S0.F1), the current employment relation and the employer\-location relation jointly support the answer\. Suppressing the previous employer removes a competing value while preserving that chain\.

Temporal interpretation follows the history format\. In MAB\-FC, larger sequence numbers identify later updates within a relation slot\. AMB\-Text exposes the conversation through the query’s session boundary\. LME\-KU supplies oracle sessions and a query date; current\-state questions use the latest explicit update in those sessions\. Within a slot, the curator distinguishes a replacement from a related observation that can coexist with the current value\.

The intent\-aware extension also handles questions that need several states at once\. Contradiction\-resolution questions retain the relevant claims, evolution questions preserve turning points, and recommendation questions combine useful preferences with later constraints\. Scope remains local to the proposition being updated\. Rejecting a particular course, for example, need not replace a broader preference for learning that skill\. Figure[2](https://arxiv.org/html/2609.10263#S3.F2)illustrates how a recommendation view retains the learning goal while incorporating an option\-specific rejection and updated study constraints\.

The curator has access to the question and source evidence; gold answers and judge decisions are used during evaluation\. If curation produces no usable entries, a lexical fallback returns up to 20 nonempty source lines ranked by overlap with the question\.

### 3\.3\.Controlling use through supersession

The materializer normalizes slot strings by stripping whitespace and lowercasing them, then creates active entries before processing proposed replacements\. The last active entry in each slot supplies the replacement target\. Letmom\_\{o\}be an older fact andmnm\_\{n\}an active entry\. A superseded record is created when

\(4\)slot⁡\(mo\)=slot⁡\(mn\),status⁡\(mn\)=𝖠𝖢𝖳𝖨𝖵𝖤,\\operatorname\{slot\}\(m\_\{o\}\)=\\operatorname\{slot\}\(m\_\{n\}\),\\quad\\operatorname\{status\}\(m\_\{n\}\)=\\mathsf\{ACTIVE\},and both entries have content\. The older entry’ssuperseded\_byfield points tomnm\_\{n\}\. Rows without an active same\-slot replacement are omitted from the materialized memory, while their source observations remain inHH\.

This ordering ties each supersession decision to a concrete replacement\. It separates two reasons for excluding a fact: the fact can be irrelevant to the present query, or it can have been explicitly replaced within its slot\. The latter receives a stored relationship that subsequent retrieval can use\. With forgetting disabled, the older fact stays active and its supersession link is cleared\. With slot grouping disabled, older conflicts remain separate active entries\.

### 3\.4\.Reusing stored history

LetAA,DD, andSSdenote materialized entries with active, deprecated, and superseded status, and letrrindicate whether archive rescue is enabled\. Retrieval forms the eligible pool

E⁡\(q\)=A\\displaystyle E\(q\)=A∪\{D,r=1,∅,r=0,\\displaystyle\\;\\cup\\;\\begin\{cases\}D,&r=1,\\\\ \\varnothing,&r=0,\\end\{cases\}\(5\)∪\{S,r=1​and​h​\(q\)=1,∅,otherwise,\\displaystyle\\;\\cup\\;\\begin\{cases\}S,&r=1\\text\{ and \}h\(q\)=1,\\\\ \\varnothing,&\\text\{otherwise\},\\end\{cases\}whereh⁡\(q\)h\(q\)identifies a historical or revision\-chain request\. Its input convention is specified in Section[4\.2](https://arxiv.org/html/2609.10263#S4.SS2)\. The selector is instructed to use deprecated evidence when it is relevant and lacks an active substitute\. The query\-conditioned curator produces active and superseded entries; the incremental memory interface also supports deprecated entries\.

Older evidence can return through two paths\. A new query can cause the curator to extract it fromHHinto a new memory view\. Within an existing materialized view, rescue makes a non\-active entry eligible for selection\. Thearchive\_rescuescounter measures selected entries on this second path\. A historical fact extracted directly into active memory uses the first path\.

These paths preserve access to stored history while changing what is used\. In Figure[1](https://arxiv.org/html/2609.10263#S0.F1), a current employer query uses Beryl, a historical query can recover Acme, and an evolution query can retain both states\. The query changes the evidence view drawn from the archive\.

Figure 2\.Scope\-aware preference curation, shown through a constructed example\. \(a\) A user wants to learn Python, considers Course A, then rejects that option and requests online evening study\. \(b\) The recommendation view keeps the learning goal, applies the new format and schedule constraints, and excludes Course A\. Rejecting an option does not imply rejecting the broader interest\. Icons represent evidence and constraints, not measured execution steps\.A timeline uses book and course icons to show learning Python, considering Course A, and rejecting Course A while requesting online evening study\. The recommendation view combines a book, laptop, evening clock, and crossed\-out Course A card into an online evening Python\-course recommendation\. The rejection is local to Course A\.
### 3\.5\.Packing the answer\-time view

Eligible entries are ranked by lexical overlap withqq, with an additional score of 0\.4 for active entries\. The candidate collector admits the first ranked entry and adds further entries within a 10,000\-token serialization target\. A language\-model selector, shared across the compared policies, returns an ordered list of entry identifiers\. Candidate order serves as the fallback when no usable identifiers are returned\.

The packer traverses this ordering and includes an entry when its cost fits the remaining memory budget\. Oversized entries are skipped\. This gives∑m∈Zc⁡\(m\)≤B\\sum\_\{m\\in Z\}c\(m\)\\leq Bfor the selected memory\. Packing operates on individual entries, while the curator’s chain instruction supplies the complementary relations available for selection\. The answer model receivesqqand the selected entries with their identifiers and statuses\.

Algorithm[1](https://arxiv.org/html/2609.10263#alg1)summarizes the procedure\. WithNNmaterialized entries, deterministic ranking takesO⁡\(N​log⁡N\)O\(N\\log N\)comparisons and packing is linear in the returned ordering\.

Algorithm 1From stored history to an answer in RD\-Forget1:Available history

HH, query

qq, budget

BB, rescue switch

rr
2:

\(A0,F0\)←Curateθ​\(H,q\)\(A\_\{0\},F\_\{0\}\)\\leftarrow\\textsc\{Curate\}\_\{\\theta\}\(H,q\)
3:

M←MaterializeActive​\(A0\)M\\leftarrow\\textsc\{MaterializeActive\}\(A\_\{0\}\)
4:forolder item

f∈F0f\\in F\_\{0\}do

5:ifan active same\-slot replacement

mmexiststhen

6:append

ffwith status

𝖲𝖴𝖯𝖤𝖱𝖲𝖤𝖣𝖤𝖣\\mathsf\{SUPERSEDED\}to

MM
7:link

f\.superseded​\_​by←m\.idf\.\\mathrm\{superseded\\\_by\}\\leftarrow m\.\\mathrm\{id\}
8:endif

9:endfor

10:if

MMis emptythen

11:

M←LexicalSourceFallback​\(H,q\)M\\leftarrow\\textsc\{LexicalSourceFallback\}\(H,q\)
12:endif

13:

E←Eligible​\(M,q,r\)E\\leftarrow\\textsc\{Eligible\}\(M,q,r\)using Eq\. \([5](https://arxiv.org/html/2609.10263#S3.E5)\)

14:

C←RankAndCollect​\(E,q\)C\\leftarrow\\textsc\{RankAndCollect\}\(E,q\)
15:

π←Selectθ​\(C,q\)\\pi\\leftarrow\\textsc\{Select\}\_\{\\theta\}\(C,q\)
16:use candidate order if

π\\pihas no usable identifiers

17:

Z←\[\];b←0Z\\leftarrow\[\\ \];\\hskip 9\.24994ptb\\leftarrow 0
18:forentry

mmin

π\\pido

19:if

b\+c⁡\(m\)≤Bb\+c\(m\)\\leq Bthen

20:append

mmto

ZZ;

b←b\+c⁡\(m\)b\\leftarrow b\+c\(m\)
21:endif

22:endfor

23:return

gθ​\(q,Z\)g\_\{\\theta\}\(q,Z\)

## 4\.Experimental Setup

### 4\.1\.Task suites

The main evaluation covers three question\-answering suites\.AMB\-Textcontains 86 text questions from the first LoCoMo conversation\([Maharana et al\., 2024](https://arxiv.org/html/2609.10263#bib.bib5)\)as distributed with AgentMemoryBench\([Hu et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib3)\)\. We exclude category 5, multimodal questions, and questions without a session boundary\. Each query receives the conversation through its boundary\.LME\-KUcontains the 78 knowledge\-update questions in the LongMemEval oracle data\([Wu et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib11)\)\.MAB\-FCcontains 100 question–answer pairs from thefactconsolidation\_mh\_6ksource in MemoryAgentBench’s Conflict\_Resolution split\([Hu et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib3)\)\. These questions share one fact history\.

The three suites comprise 264 tasks per method and 792 method–task combinations per model\. Selection follows source order and fixed index ranges\. The query\-intent evaluation adds 150 BEAM questions and 579 PersonaMem questions per method, excluding the first ten development questions in each benchmark\. Section[6](https://arxiv.org/html/2609.10263#S6)describes these two suites and their scoring rules\.

### 4\.2\.Models and execution

We evaluate Qwen3\.5\-flash, GPT\-5\.6\-Luna, MiniMax\-M2\.5, and Kimi\-K2\.5\. Within each run, curation, selection, answering, and model\-based evaluation use the same model family and client configuration\. We therefore treat model\-judged scores as within\-protocol evaluation rather than as fully independent external judgments\. Available query dates and task metadata accompany curation and selection;h⁡\(q\)h\(q\)combines lexical cues with task\-type labels for contradiction resolution, temporal reasoning, and preference history\. These auxiliary inputs are implicit in Algorithm[1](https://arxiv.org/html/2609.10263#alg1)\.

The main\-suite and matched\-Full protocol allows up to 4,096 output tokens for curation and 256 for each selection, answer, and judge call\. The query\-intent protocol uses caps of 8,192 and 2,048, respectively, and an 8,000\-token source chunk target\.

### 4\.3\.Scoring and aggregation

AMB\-Text and LME\-KU report mean binary semantic judgments against the gold answer\. MAB\-FC reports rule accuracy from normalized substring matching\. The rule lowercases and tokenizes text, converts number words from zero through twelve to digits, and accepts a nonempty gold substring in the answer or an answer of at least three characters within a gold string\. Accuracy is computed over completed evaluations\.

Table 1\.Main comparison \(%\)\. Mean equally weights the three displayed benchmark scores\. Bold marks column bests within each model; purple identifies RD\-Forget\.
### 4\.4\.Ablations

The matched Full batch and five variants use the same 264 tasks\.−\-FORGET keeps identified older revisions active\.−\-RESCUE excludes non\-active entries from retrieval\.−\-SLOT removes shared slot grouping and retains older conflicts as separate active facts\.−\-CLOSURE instructs the curator to keep directly matched evidence without expanding the complete multi\-hop chain\. The selector retains its common instruction to preserve necessary links\.

−\-QC hides the question from the curator and builds a general\-purpose memory per source\. The downstream selector and the empty\-curation fallback still receive the question\. These variants compare complete curation configurations: switches can change the upstream extracted evidence as well as entry eligibility\.

Table 2\.Luna ablations \(%\)\. The shaded matched Full is a separate batch from Table[1](https://arxiv.org/html/2609.10263#S4.T1)\. Bold marks column bests, including ties\.
Table 3\.Query\-intent evaluation \(%\)\. BEAM averages rubric scores; PersonaMem uses single\-option accuracy\. Bold marks row bests\.

## 5\.Results and Analysis

### 5\.1\.Answer quality across models

RD\-Forget has the highest accuracy in all twelve model and benchmark combinations in Table[1](https://arxiv.org/html/2609.10263#S4.T1)\. It leads on AMB\-Text and LME\-KU with all four models\. Relative to the better of ACE and ReasoningBank in each setting, the gains range from 1\.16 to 19\.77 percentage points on AMB\-Text and from 6\.41 to 25\.64 points on LME\-KU\.

On fact consolidation, RD\-Forget exceeds the better\-performing baseline by 17\.00 points with Qwen and 26\.00 points with Luna\. MiniMax scores 57\.00% with RD\-Forget, compared with 42\.00% for ACE and 46\.00% for RB, a gain of 11\.00 points over the better\-performing baseline\. Kimi scores 59\.00%, compared with 41\.00% and 45\.00%, a gain of 14\.00 points\. The gains are positive across all four backbones, with the largest margin for Luna\.

RD\-Forget has the highest three\-suite mean with all four models: 66\.59% for Qwen, 86\.71% for Luna, 77\.13% for MiniMax, and 72\.83% for Kimi\. These means weight the three benchmark scores equally; per\-benchmark gains show how the size of the advantage varies across tasks\.

Fact\-consolidation questions require selecting current revisions along a relation path\. Curation must extract that path and resolve each relation before packing the context\. RD\-Forget improves fact\-consolidation accuracy with all four models\.

### 5\.2\.Forgetting and query\-conditioned curation

The−\-FORGET configuration scores 68\.60% versus matched Full’s 91\.86% on AMB\-Text, 60\.26% versus 93\.59% on LME\-KU, and 51\.00% versus 74\.00% on MAB\-FC \(Table[3](https://arxiv.org/html/2609.10263#S4.T3)\)\. Relative to matched Full, the deficits are 23\.26, 33\.33, and 23\.00 percentage points\. Within the matched Luna configuration,−\-FORGET has the largest score deficit on all three suites, with the largest difference on LME\-KU\.

−\-QC scores 77\.91%, 82\.05%, and 56\.00% on the three suites, respectively\. The corresponding deficits relative to matched Full are 13\.95, 11\.54, and 18\.00 points\. These are the second\-largest deficits among the component ablations on each benchmark\. Figure[3](https://arxiv.org/html/2609.10263#S5.F3)contrasts the matched Full and all five variants on a common accuracy scale\. A memory formed before seeing the question must anticipate which relations a later answer will require\. The−\-QC result occurs despite its larger curation output allowance and query\-aware downstream selector\.

Across the matched Luna ablations, the score deficit of−\-FORGET relative to matched Full exceeds that of−\-QC by 9\.31, 21\.79, and 5\.00 points on AMB\-Text, LME\-KU, and MAB\-FC, respectively\.

Figure 3\.Matched Luna component comparison on \(a\) AMB\-Text, \(b\) LME\-KU, and \(c\) MAB\-FC\. Bars show the aggregate answer accuracies from Table[3](https://arxiv.org/html/2609.10263#S4.T3); all panels use the same zero\-based percentage scale\. Purple denotes matched Full\.−\-FORGET has the largest deficit relative to matched Full on every benchmark, followed by−\-QC\. Variants use the end\-to\-end protocol in Section[4\.4](https://arxiv.org/html/2609.10263#S4.SS4)\.Three panels show the matched Full and five ablation scores\. Full scores 91\.86, 93\.59, and 74\.00 percent; minus FORGET scores 68\.60, 60\.26, and 51\.00; minus QC scores 77\.91, 82\.05, and 56\.00\. Minus RESCUE, SLOT, and CLOSURE also score below Full on every benchmark\.
### 5\.3\.Evidence chains, slots, and historical eligibility

−\-CLOSURE scores below matched Full by 4\.65 points on AMB\-Text, 3\.85 points on LME\-KU, and 3\.00 points on MAB\-FC \(Table[3](https://arxiv.org/html/2609.10263#S4.T3)\)\. The 3\.00–4\.65\-point differences are consistent with direct question matches omitting complementary relations needed for some answers\.

−\-RESCUE scores below matched Full by 3\.49 points on AMB\-Text, 2\.56 points on LME\-KU, and 9\.00 points on MAB\-FC\. The corresponding deficits for−\-SLOT are 5\.81, 3\.85, and 10\.00 points\. Both variants score lower on every suite, with the largest differences on MAB\-FC\. Rescue changes retrieval eligibility for non\-active entries; the curator can still recover historical facts directly from the source archive\.

## 6\.Stored History across Query Intents

We evaluate the intent\-aware extension on BEAM and PersonaMem\-v1 with the same four backbones\. BEAM uses the100Ksplit, corresponding to the experiment’s 128K tier\. Its questions cover knowledge updates, contradiction resolution, temporal reasoning, and preference following\([Tavakoli et al\., 2026](https://arxiv.org/html/2609.10263#bib.bib9)\)\. PersonaMem\-v1 uses the 32K configuration and truncates context at the index specified by each question\([Jiang et al\., 2025](https://arxiv.org/html/2609.10263#bib.bib4)\)\.

The evaluation excludes the first ten development questions from each benchmark and covers 150 BEAM questions and 579 PersonaMem questions per method\. BEAM’s loader interleaves its four categories within conversation order\. Each rubric criterion is graded 0, 0\.5, or 1; criterion scores are averaged within a question and question scores are then averaged across the suite\. PersonaMem uses the official single\-option parsing score over four answer options\. Its parser checks the tagged final answer and the full response, preferring parenthesized options\. An answer is correct when either extracted option\-letter set equals the gold singleton\.

RD\-Forget leads all eight model and benchmark combinations in Table[3](https://arxiv.org/html/2609.10263#S4.T3)\. On BEAM, Qwen scores 50\.21%, compared with 32\.84% for ACE and 34\.75% for RB, a gain of 15\.46 points over the better\-performing baseline\. Luna scores 70\.58%, compared with 56\.97% and 53\.47%, a gain of 13\.61 points\. Kimi scores 57\.83%, exceeding the better\-performing baseline by 15\.67 points, while MiniMax scores 42\.39%, a gain of 8\.47 points over RB\. The observed margins span 8\.47–15\.67 points across the four backbones\.

On PersonaMem, Qwen scores 59\.93%, compared with 39\.21% for ACE and 38\.17% for RB, a gain of 20\.72 points over the better\-performing baseline\. Luna scores 79\.97%, compared with 65\.46% and 68\.05%, a gain of 11\.92 points\. Kimi reaches 64\.08%, ahead of ACE by 10\.88 points and RB by 15\.20 points\. MiniMax reaches 60\.10%, exceeding ACE by 17\.61 points and RB by 21\.59 points\. Thus the advantage over the better\-performing baseline ranges from 10\.88 to 20\.72 points\.

The query\-intent results extend the comparison to long histories and evolving preferences\.

## 7\.Discussion

Separating storage from use makes forgetting a decision about which retained observations influence an answer\. A superseded fact can leave a current\-state context while remaining available for a historical query\. Complementary relations can stay useful after another fact is replaced\.

The matched Luna ablations have the same ordering on all three suites\. Relative to matched Full,−\-FORGET has the largest deficit and−\-QC the next largest\. The differences for−\-CLOSURE,−\-RESCUE, and−\-SLOT are smaller\.

Fact consolidation requires the evidence view to preserve a usable relation path while resolving revisions within each hop\. The retained archive provides the observations; curation determines which relations and versions enter the answer context\.

Slot granularity governs this separation in practice\. The curator must distinguish complementary facts while grouping competing values of one relation; the materializer checks the same\-slot relationship\.

## 8\.Conclusion

What an agent should forget depends on which stored facts are appropriate to use for the current question\. RD\-Forget implements this separation with a retained source archive and a query\-conditioned memory view\. The experimental comparisons connect answer quality to query\-relevant evidence, revision control, and preservation of complementary relations\. The archive preserves availability, while the memory view governs the evidence used for an answer\. This separation accommodates both current\-state evidence and historical observations whose usefulness changes with the question\.

## References

- Cover and Thomas \(2005\)Thomas M\. Cover and Joy A\. Thomas\. 2005\.*Elements of Information Theory*\(1 ed\.\)\.Wiley\.[doi:10\.1002/047174882x](https://doi.org/10.1002/047174882x)
- Hu et al\.\(2026\)Yuanzhe Hu, Yu Wang, and Julian McAuley\. 2026\.Evaluating Memory in LLM Agents via Incremental Multi\-Turn Interactions\. In*The Fourteenth International Conference on Learning Representations*\.[https://openreview\.net/forum?id=DT7JyQC3MR](https://openreview.net/forum?id=DT7JyQC3MR)
- Jiang et al\.\(2025\)Bowen Jiang, Zhuoqun Hao, Young\-Min Cho, Bryan Li, Yuan Yuan, Sihao Chen, Lyle Ungar, Camillo J\. Taylor, and Dan Roth\. 2025\.Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale\. In*Second Conference on Language Modeling*\.[https://openreview\.net/forum?id=6ox8XZGOqP](https://openreview.net/forum?id=6ox8XZGOqP)
- Maharana et al\.\(2024\)Adyasha Maharana, Dong\-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang\. 2024\.Evaluating Very Long\-Term Conversational Memory of LLM Agents\. In*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, Lun\-Wei Ku, Andre Martins, and Vivek Srikumar \(Eds\.\)\. Association for Computational Linguistics, Bangkok, Thailand, 13851–13870\.[doi:10\.18653/v1/2024\.acl\-long\.747](https://doi.org/10.18653/v1/2024.acl-long.747)
- Ouyang et al\.\(2026\)Siru Ouyang, Jun Yan, I\-Hung Hsu, Yanfei Chen, Ke Jiang, Zifeng Wang, Rujun Han, Long T\. Le, Samira Daruki, Xiangru Tang, Vishy Tirumalashetty, George Lee, Mahsan Rofouei, Hangfei Lin, Jiawei Han, Chen\-Yu Lee, and Tomas Pfister\. 2026\.ReasoningBank: Scaling Agent Self\-Evolving with Reasoning Memory\. In*The Fourteenth International Conference on Learning Representations*\.[https://openreview\.net/forum?id=jL7fwchScm](https://openreview.net/forum?id=jL7fwchScm)
- Packer et al\.\(2023\)Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G\. Patil, Ion Stoica, and Joseph E\. Gonzalez\. 2023\.MemGPT: Towards LLMs as Operating Systems\.arXiv:2310\.08560[https://arxiv\.org/abs/2310\.08560](https://arxiv.org/abs/2310.08560)
- Park et al\.\(2023\)Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S\. Bernstein\. 2023\.Generative Agents: Interactive Simulacra of Human Behavior\. In*Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology*\. ACM, New York, NY, USA, 1–22\.[doi:10\.1145/3586183\.3606763](https://doi.org/10.1145/3586183.3606763)
- Tavakoli et al\.\(2026\)Mohammad Tavakoli, Alireza Salemi, Carrie Ye, Mohamed Abdalla, Hamed Zamani, and J Ross Mitchell\. 2026\.Beyond a Million Tokens: Benchmarking and Enhancing Long\-Term Memory in LLMs\. In*The Fourteenth International Conference on Learning Representations*\.[https://openreview\.net/forum?id=y59hf5lrMn](https://openreview.net/forum?id=y59hf5lrMn)
- Wei et al\.\(2026\)Lei Wei, Xu Dong, Xiao Peng, Niantao Xie, and Bin Wang\. 2026\.FadeMem: Biologically\-Inspired Forgetting for Efficient Agent Memory\. In*ICASSP 2026 \- 2026 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\)*\. IEEE, Barcelona, Spain, 4011–4015\.[doi:10\.1109/ICASSP55912\.2026\.11462095](https://doi.org/10.1109/ICASSP55912.2026.11462095)
- Wu et al\.\(2025\)Di Wu, Hongwei Wang, Wenhao Yu, Yuwei Zhang, Kai\-Wei Chang, and Dong Yu\. 2025\.LongMemEval: Benchmarking Chat Assistants on Long\-Term Interactive Memory\. In*The Thirteenth International Conference on Learning Representations*\.[https://openreview\.net/forum?id=pZiyCaVuti](https://openreview.net/forum?id=pZiyCaVuti)
- Xu et al\.\(2025\)Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, and Yongfeng Zhang\. 2025\.A\-MEM: Agentic Memory for LLM Agents\. In*Advances in Neural Information Processing Systems*, Vol\. 38\.[https://openreview\.net/forum?id=FiM0M8gcct](https://openreview.net/forum?id=FiM0M8gcct)
- Zhang et al\.\(2026a\)Qizheng Zhang, Changran Hu, Shubhangi Upasani, Boyuan Ma, Fenglu Hong, Vamsidhar Kamanuru, Jay Rainton, Chen Wu, Mengmeng Ji, Hanchen Li, Urmish Thakker, James Zou, and Kunle Olukotun\. 2026a\.Agentic Context Engineering: Evolving Contexts for Self\-Improving Language Models\. In*The Fourteenth International Conference on Learning Representations*\.[https://openreview\.net/forum?id=eC4ygDs02R](https://openreview.net/forum?id=eC4ygDs02R)
- Zhang et al\.\(2026b\)Yuxiang Zhang, Jiangming Shu, Ye Ma, Xueyuan Lin, Shangxi Wu, and Jitao Sang\. 2026b\.Memory as Action: Autonomous Context Curation for Long\-Horizon Agentic Tasks\. In*Findings of the Association for Computational Linguistics: ACL 2026*, Maria Liakata, Viviane P\. Moreira, Jiajun Zhang, and David Jurgens \(Eds\.\)\. Association for Computational Linguistics, San Diego, California, United States, 19149–19164\.[doi:10\.18653/v1/2026\.findings\-acl\.956](https://doi.org/10.18653/v1/2026.findings-acl.956)

Similar Articles