ECHO: A Cognitively Inspired, Auditable Memory Plane for Long-Horizon Agents
Summary
ECHO is a cognitively inspired, auditable memory architecture for long-horizon agents, evaluated on benchmarks like LoCoMo and LongMemEval-S with high retrieval performance.
View Cached Full Text
Cached at: 08/25/26, 04:24 AM
# A Cognitively Inspired, Auditable Memory Plane for Long-Horizon Agents
Source: [https://arxiv.org/html/2608.21755](https://arxiv.org/html/2608.21755)
Hong MiaoThanks:Yu Qian, Hong Miao, and Boyang Guo contributed equally to this work\.Boyang GuoThanks:Yu Qian, Hong Miao, and Boyang Guo contributed equally to this work\.Tingyi JiangShan ZhaoTianxing LeLintian LiMeng LiuThanks:All authors are with XDream Robotics, Building T2, Moli Community, No\.˜1, Lane˜188, Yuren Road, Pudong New Area, Shanghai 200120, China \(e\-mail: \{ethan,harold,ray,poluz,chloe,letianxing,lynk,meng\.liu\}@xdreamrobo\.com\)\.
###### Abstract
Long\-horizon agents need memory that identifies relevant experience, resolves revisions, and exposes checkable provenance\. We present ECHO \(Embodied Context & History Orchestration\), an auditable memory architecture and service prototype inspired by episodic encoding, consolidation, contextual reinstatement, reconsolidation, and executive control\. This is functional inspiration, not neural equivalence; the empirical analysis focuses on retrieval and context construction\.
Development runs reach 96\.29% Hit@10 and 73\.64% turn Recall@5 on 1,536 LoCoMo category\-1–4 questions, and 97\.60% Hit@10, 88\.84% turn Recall@5, and 88\.71% session Recall@5 on all 500 LongMemEval\-S questions\. A five\-history BEAM gate fails, and in a separate matched 91\-question QA sample Mem0 OSS scores 64\.84% versus ECHO’s 41\.76% \(exact McNemarp=\.00107p=\.00107\), with a history\-cluster interval crossing zero\. A post\-hoc audit found source\-specific phrases in the query\-expansion rules\. Although no gold answer field entered the runtime, expansion\-enabled retrieval scores are therefore descriptive development measurements, not independent confirmation\.
###### Index Terms:
cognitive memory, agent memory, bitemporal data, evidence retrieval, provenance, long\-context evaluation, memory systems
## IIntroduction
Consider an assistant that remembers a user’s former address, the correction that replaced it, and the conversation in which the correction occurred\. A nearest\-neighbor store may retrieve both addresses\. A useful memory system must do more: preserve the original experience, represent the revision without rewriting history, decide which value is valid for the requested time, and return the evidence that justifies the decision\. This is the difference between storing a past and maintaining a past that can safely constrain the present\.
Persistent assistants and embodied agents therefore need a memory*plane*, not merely a vector index\. Such a plane must coordinate four separable responsibilities: durable experience capture, evolution of structured state, context\-sensitive discovery, and controlled realization into an answer or action\. A failure at any boundary can survive a favorable headline score\. A retriever may return one relevant turn while omitting the other events needed for a count; a semantically close stale value may outrank the current revision; or a reader may receive the right evidence and still answer incorrectly\.
Existing long\-memory benchmarks expose several parts of this problem\. LoCoMo tests multi\-session factual, temporal, and multi\-hop memory\[[12](https://arxiv.org/html/2608.21755#bib.bib2)\]; LongMemEval tests information extraction, knowledge update, temporal reasoning, multi\-session synthesis, preference, and abstention over timestamped histories\[[23](https://arxiv.org/html/2608.21755#bib.bib3)\]; BEAM extends coherent histories toward millions of tokens and broad memory operations\[[20](https://arxiv.org/html/2608.21755#bib.bib4)\]\. These benchmarks are valuable, but headline scores often mix readers, prompts, retrieval cutoffs, data revisions, and judges\. A single Hit@kkadditionally hides how much annotated evidence was recovered and whether a memory API exposes the provenance needed to measure that coverage\. Consequently, it may be impossible to tell whether a failure arose in candidate discovery, temporal resolution, evidence packing, or answer realization\.
We study memory as auditable cognitive infrastructure\. ECHO follows a continual loop of*encoding, organization, recall, and evolution*: immutable events retain episodes; projection builds typed revisions; hybrid routes propose candidates; a bitemporal ledger alone determines currentness; provenance closure restores the dependencies required by an operation; and an executive boundary separates internal derivation from the visible answer\. The cognitive mapping motivates this decomposition but makes no anatomical, biological, or clinical claim\.
The empirical results deliberately include negative evidence\. LongMemEval\-S shows that question hits and evidence coverage can be simultaneously high on a full frozen run\. The one\-history BEAM development pilot instead shows that a perfect Hit@10 can coexist with incomplete evidence\. Most importantly, a fresh\-history BEAM gate does not reproduce the pilot result, and a matched 91\-question QA sample favors Mem0 OSS\. These outcomes narrow rather than weaken the contribution: they distinguish what the architecture guarantees from what the current ranker and answerer have demonstrated\.
This paper makes five contributions:
- •We translate episodic traces, semantic consolidation, reconsolidation, contextual recall, and executive control into explicit, testable systems commitments, with a strict neural\-equivalence disclaimer\.
- •We specify and unit\-test a typed bitemporal authority component in which valid time, transaction time, revision state, provenance, and conflicts are explicit, while semantic similarity cannot determine factual currentness\.
- •We implement a worker\-oriented retrieval pipeline and evaluate retrieval, provenance\-closure, and bounded\-context behavior at explicit system boundaries\.
- •We report frozen descriptive retrieval artifacts for LoCoMo and LongMemEval\-S, a scoped BEAM development pilot, and a preregistered five\-history BEAM gate that fails, retaining question\-level audits, failures, latency, context size, and hashes while disclosing the query\-expansion contamination risk\.
- •We provide a protocol\-matched 91\-question ECHO–Mem0 OSS QA comparison with paired statistics and an observability contract that forbids assigning provenance metrics when a baseline does not expose source lineage\.
The evidence is stage\-separated throughout\. ECHO retrieval, matched sampled QA, and author\-reported product scores use different estimands; none is silently converted into another\. The result is an architecture\-and\-audit study whose claims are aligned with the corresponding empirical boundaries and evaluation protocols; reported results remain scoped to those settings\.
## IIProblem Formulation
### II\-AEvents, States, and Two Time Axes
Let an interaction history be an append\-only event streamE=\(e1,…,eT\)E=\(e\_\{1\},\\ldots,e\_\{T\}\)\. Each event contains immutable source identity, speaker or actor, observed text, source order, and available timestamps\. Projection maps events to typed propositions and state revisions\. A state record is
s=\(k,v,τv,τt,ρ,π,g,σ\),s=\(k,v,\\tau\_\{v\},\\tau\_\{t\},\\rho,\\pi,g,\\sigma\),\(1\)
wherekkis a typed entity–relation key,vva value,τv\\tau\_\{v\}its valid\-time interval,τt\\tau\_\{t\}the transaction or known\-time interval,ρ\\rhothe revision relation,π\\piimmutable provenance,gga ledger generation, andσ\\sigmaa status such as active, superseded, revoked, or unresolved\. Valid time denotes when a proposition is true in the modeled world; transaction time denotes when the system records it\. This separation follows established bitemporal database semantics\[[21](https://arxiv.org/html/2608.21755#bib.bib5)\]\.
For a query viewt=\(tv,tt\)t=\(t\_\{v\},t\_\{t\}\), ledger resolution is
𝒮\(k,t\)=\{s:s\.k=k,tv∈s\.τv,tt∈s\.τt,s\.g≤gvisible\}\.\\mathcal\{S\}\(k,t\)=\\\{s:s\.k=k,\\;t\_\{v\}\\in s\.\\tau\_\{v\},\\;t\_\{t\}\\in s\.\\tau\_\{t\},\\;s\.g\\leq g\_\{\\mathrm\{visible\}\}\\\}\.\(2\)
If𝒮\\mathcal\{S\}contains one supported active revision, that state can be answered\. If it is empty, evidence is missing\. If it contains incompatible unresolved revisions, the system must not pick the most similar one; it either discloses the minimal conflict set when requested or abstains\.
We make that authority boundary explicit with a three\-valued resolver
Resolve\(k,t\)=\{s,𝒮adm\(k,t\)=\{s\},⊥miss,𝒮adm\(k,t\)=∅,⊥conflict,\|𝒮adm\(k,t\)\|\>1,\\operatorname\{Resolve\}\(k,t\)=\\begin\{cases\}s,&\\mathcal\{S\}\_\{\\mathrm\{adm\}\}\(k,t\)=\\\{s\\\},\\\\ \\bot\_\{\\mathrm\{miss\}\},&\\mathcal\{S\}\_\{\\mathrm\{adm\}\}\(k,t\)=\\varnothing,\\\\ \\bot\_\{\\mathrm\{conflict\}\},&\|\\mathcal\{S\}\_\{\\mathrm\{adm\}\}\(k,t\)\|\>1,\\end\{cases\}\(3\)
where admissibility requires compatible valid time, known time, revision status, provenance, and visible ledger generation\. Semantic similarity is deliberately absent from Eq\. \([3](https://arxiv.org/html/2608.21755#S2.E3)\); it may discover a state but cannot make that state authoritative\.
### II\-BEvidence and Answer Operations
A retrieval hit is not necessarily sufficient evidence\. Letuube an evidence unit andΠ\(u\)\\Pi\(u\)its source lineage\. For a selected state or derived result, the evidence closureΓ\(u\)\\Gamma\(u\)contains the originating events, required revision links, and dependencies needed to verify the result\. Candidate discovery first unions route\-specific results,
ℋ\(q\)\\displaystyle\\mathcal\{H\}\(q\)=⋃r∈ℛTopMr\(ℋr\(q\)\),\\displaystyle=\\bigcup\_\{r\\in\\mathcal\{R\}\}\\operatorname\{Top\}\_\{M\_\{r\}\}\\bigl\(\\mathcal\{H\}\_\{r\}\(q\)\\bigr\),\(4\)F\(u∣q\)\\displaystyle F\(u\\mid q\)=∑r∈ℛαrϕr\(u,q\)\+λSupport\(session\(u\)\),\\displaystyle=\\sum\_\{r\\in\\mathcal\{R\}\}\\alpha\_\{r\}\\phi\_\{r\}\(u,q\)\+\\lambda\\,\\operatorname\{Support\}\(\\operatorname\{session\}\(u\)\),\(5\)
where routes include lexical, semantic, typed\-state, and neighborhood discovery\. The fusion scoreFForders inspection only; currentness remains the output of Eq\. \([3](https://arxiv.org/html/2608.21755#S2.E3)\)\. An admissible context is then an atomic\-closure packing problem,
𝐱⋆\\displaystyle\\mathbf\{x\}^\{\\star\}=argmax∑u∈ℋ𝐱∈\{0,1\}\|ℋ\|xuU\(u∣q,o\),\\displaystyle=\\arg\\max\_\{\\mathbf\{x\}\\in\\\{0,1\\\}^\{\|\\mathcal\{H\}\|\}\}\\sum\_\{u\\in\\mathcal\{H\}\}x\_\{u\}\\,U\(u\\mid q,o\),\(6\)s\.t\.∑u∈ℋxutokens\(Γ\(u\)\)≤B,C=⋃u:xu⋆=1Γ\(u\),\\displaystyle\\sum\_\{u\\in\\mathcal\{H\}\}x\_\{u\}\\,\\operatorname\{tokens\}\(\\Gamma\(u\)\)\\leq B,\\qquad C=\\bigcup\_\{u:x\_\{u\}^\{\\star\}=1\}\\Gamma\(u\),\(7\)
for utility\-conditioned evidence unitsℋ\\mathcal\{H\}and budgetBB\. A packer may defer an atomic closure that does not fit, but it cannot silently include only the conclusion while dropping its required support\.
The public question induces an operation such asFact,Count,List,TemporalLookup, orTemporalArithmetic\. The operation determines which evidence must be complete and which answer surface is required\. Importantly, internal completeness is not equivalent to visible completeness\.
### II\-CObjective and Claim Taxonomy
For questionqq, frozen contextCC, internal derivationzz, and surface contracthh, the reader computes
z\\displaystyle z=D\(q,C,o\),\\displaystyle=D\(q,C,o\),\(8\)a\\displaystyle a=R\(q,z,h\)\.\\displaystyle=R\(q,z,h\)\.\(9\)
DDmay enumerate members or retain temporal endpoints\.RRemits only the answer requested byqq\. We optimize all\-row strict answer correctness while also reporting support recall, abstention behavior, token use, and latency\. Retrieval metrics diagnoseCC; they never substitute for the correctness ofaa\.
The system objective is therefore constrained rather than a single retrieval score\. For evaluation rowsi=1,…,ni=1,\\ldots,n, we report
𝒥=1n∑i=1n𝟙\[ai≡yi\]−λsLstale−λcLconflict−λfLfalseabstain−λbB¯,\\begin\{split\}\\mathcal\{J\}=\{\}&\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\mathbb\{1\}\[a\_\{i\}\\equiv y\_\{i\}\]\-\\lambda\_\{s\}L\_\{\\mathrm\{stale\}\}\-\\lambda\_\{c\}L\_\{\\mathrm\{conflict\}\}\\\\ &\-\\lambda\_\{f\}L\_\{\\mathrm\{false\\ abstain\}\}\-\\lambda\_\{b\}\\overline\{B\},\\end\{split\}\(10\)
subject to provenance closure and generation\-fencing invariants\. The first term is end\-to\-end answer correctness; the remaining terms expose safety and cost failures that a high Hit@kkcan hide\.
We distinguish four evidence levels throughout the paper: stage\-level retrieval, matched visible development, frozen candidate evaluation, and fresh confirmatory evaluation\. Only the last two can support final superiority language, and only when their preregistered gates pass\.
## IIIThe ECHO Memory Plane
### III\-ACognitive Inspiration and Engineering Commitments
Human memory is not a uniform store\. The episodic–semantic distinction separates temporally situated experience from organized knowledge\[[22](https://arxiv.org/html/2608.21755#bib.bib19)\]; complementary learning systems explain why rapid experience capture and slower structured learning serve different roles\[[13](https://arxiv.org/html/2608.21755#bib.bib20),[10](https://arxiv.org/html/2608.21755#bib.bib21)\]; and reconsolidation shows that recall can reopen an established memory to revision\[[15](https://arxiv.org/html/2608.21755#bib.bib22)\]\. Temporal\-context models connect recall to a changing internal context\[[7](https://arxiv.org/html/2608.21755#bib.bib23)\], while cognitive\-control accounts emphasize goal\-dependent selection of what guides behavior\[[14](https://arxiv.org/html/2608.21755#bib.bib24)\]\.
TABLE I:Functional cognitive inspiration and testable system commitments\.These correspondences are design hypotheses, not anatomical claims\. Their value is operational: each row creates an independently auditable invariant or ablation\. In this sense, “brain\-inspired” names the decomposition of memory functions, while bitemporal state and provenance provide the engineering semantics needed to test it\.
Functional cognitive loopEpisodic encodingrapid traceSystems consolidationepisode↔\\leftrightarrowschemaContextual reinstatementcue\-conditionedExecutive gatingtask\-selectiveReconsolidating updateevidence\-authorizednew experience or correctionAuditable memory planeImmutable eventssource order \+ timeTyped projectionstate \+ revisionBitemporal ledgervalid/known timeCandidate discoverylexical \+ semantic \+ typedProvenance closureatomic dependency packsDerive→\\rightarrowrealizecomplete in, selective outTarget authority boundary\.Similarity proposes candidates; the ledger alone resolves currentness\. The target evidence contract binds answer construction to provenance, ledger generation, a context hash, an operation plan, and a surface contract, with evaluation reported at the corresponding system boundaries\.
Fig\. 1:ECHO at a glance\. The upper lane translates a functional cognitive loop into the auditable memory plane below; colors distinguish experience, projected state, temporal authority, discovery, provenance, and realization\. Solid arrows are runtime flow and dashed arrows are testable correspondences\. The feedback loop admits only new experience or authorized correction, never an unverified retrieval result\.
### III\-BTarget Runtime and Evaluation Scope
Figure[2](https://arxiv.org/html/2608.21755#S3.F2)specifies the intended online and asynchronous composition\. Durable ingestion is decoupled from optional projection and index maintenance, and the target query path returns from derived\-index discovery to the bitemporal ledger before packing evidence\. The empirical study evaluates durable carrier, candidate discovery, and context\-construction paths at service level, and assesses V25 ledger, provenance\-closure, operation\-planning, and surface\-contract properties through domain\-level tests\. Results are attributed to the corresponding evaluation boundary\.
Write / consolidateDialogue, perception, API eventsImmutable evidence source order \+ timeAsync projection worker queueTyped revisions provenance linksBitemporal ledger valid / known timeRebuildable indexes lexical / dense / graphdurable firstgeneration fencedQuery / answerPublic question \+ time viewOperation planner query expansionParallel discovery lexical / dense / entityAuthority resolver revision \+ conflictProvenance closure budgeted contextDerive then realize selective surfaceAnswer / action or abstentionGovern / learnAudit plane hashes / latency / failuresAuthorized update evidence or correctionappend; never overwrite sourceepisodic encodingsystems consolidationcontextual reinstatementexecutive gatingreconsolidation\-like update
Fig\. 2:Target ECHO runtime architecture and current integration boundary\. Solid arrows denote the intended synchronous authority path; dashed arrows denote asynchronous projection, observability, and authorized updates\. The empirical analysis focuses on retrieval and context construction\. Cognitive labels are functional correspondences, not claims of anatomical or neural equivalence\.
### III\-CProjection, Provenance, and Revision Integrity
Projection converts raw turns and events into typed units while preserving raw source pointers\. Observed propositions remain distinct from derived summaries or states, following the database\-provenance principle that derived results must remain traceable to contributing records\[[2](https://arxiv.org/html/2608.21755#bib.bib6)\]\. Repeated textual mentions do not automatically become distinct countable entities; deduplication uses event and typed entity identity\.
The ledger component appends revisions rather than overwriting prior state\. A revision may supersede, revoke, or leave another revision unresolved, allowing late\-arriving evidence to change transaction\-time knowledge without rewriting historical valid time\. Component tests cover ledger generations and stale\-index fences\. Resolver behavior is evaluated through component\-level invariants, and benchmark results are reported as retrieval and context\-construction measurements\.
### III\-DCandidate Discovery and Currentness Authority
The candidate union combines typed routes, lexical matching, semantic retrieval, and fixed neighborhood expansion\. BM25 provides an exact\-anchor floor\[[19](https://arxiv.org/html/2608.21755#bib.bib7)\]; semantic retrieval improves paraphrase recall; and relation or state routes expose connected evidence\. Fusion produces a candidate set, not truth\. The ledger subsequently applies the requested valid/known\-time view and revision status\.
This separation prevents a frequent failure: a semantically close stale value outranking a less similar current value\. Semantic rank can affect which states are inspected, but not which inspected revision is declared current\.
### III\-EProvenance\-Closed Evidence Packing
For each operation, the packer constructs atomic evidence sets\. A count set groups the countable members; a temporal arithmetic set groups both endpoints; a current\-state set groups the active revision with the revision evidence needed to exclude an older value\. Sets are deduplicated, prioritized, and packed under budgets of 768, 2,048, or 7,000 estimated tokens\. Within an admitted set, source order and timestamps are restored before reading\.
The packer records context hash, source IDs, candidate and packed hit counts, truncation, admitted and deferred closure IDs, and the currentness owner\. This trace makes an evidence intervention testable independently of the generated answer\.
### III\-FSelective Surface Realization
Evidence completeness and answer verbosity are different constraints\. LetIoI\_\{o\}be internal requirements andFoF\_\{o\}the visible contract for operationoo\. The reader may enumerate members, compare revisions, or normalize temporal endpoints internally, but the public result isR\(D\(q,C,Io\),Fo\)R\(D\(q,C,I\_\{o\}\),F\_\{o\}\)\. This boundary is an engineering analogue of executive gating: the mapping is functional and testable, not neural\.
TABLE II:Internal and visible realization contracts\.Activation receives only the public question\. It never receives benchmark, question ID, arm, retrieval fields, reference answer, rubric, or gold support\. If evidence is missing, the reader emitsINSUFFICIENT\_EVIDENCE\. If revisions are mutually inconsistent and no ledger field resolves them, the system abstains rather than selecting by similarity\. This resembles selective prediction’s rejection option\[[6](https://arxiv.org/html/2608.21755#bib.bib8)\], but the trigger is evidence and state integrity rather than classifier confidence\.
### III\-GFailure Semantics
Every public row and every arm\-budget cell is retained\. Reader transport, parsing, and judge failures score zero\. Exact abstentions are scored deterministically; remaining byte\-distinct answers are judged once per question\-response pair and reused across consuming cells\. Prediction files are sealed before gold can be opened\. These rules prevent retry, deduplication, or row filtering from improving reported accuracy after failures are observed\.
## IVImplementation Status and Reproducibility
The evaluated retriever runs through the service carrier\. The empirical study reports service\-level retrieval results and domain\-level typed\-ledger and closure tests at their corresponding evaluation boundaries\. Working bundles retain prompts, revisions, predictions, and scores\. Reproducibility statements in this preprint refer to the archived artifacts and configurations described here\. API credentials are never serialized\.
The sampled Mem0 arm is pinned to a recorded OSS and benchmark revision, with its dependency, model, and protocol metadata archived alongside the artifact\. The protocol\-correct overlay maps benchmark timestamps tometadata\.created\_at, applies SDK entity filters and Top\-10 limits, disables hidden Qwen thinking for wire compatibility, and enforces an exact extraction schema\. The frozen stock adapter drops benchmark timestamps; this is retained as a protocol limitation, not repaired silently\. Mem0 does not expose complete source\-turn lineage across memory revisions, so ECHO\-style Hit@10, turn/session recall, and provenance MRR are*not observable*for this arm\.
Runs execute on Windows 11 with Docker 29\.7\.2 over WSL2, an Intel i9\-13900H, 15\.6 GiB host RAM, an RTX 4060 Laptop GPU with 8 GiB VRAM, and an 8 GiB Docker memory limit\. Ollama 0\.32\.14 serves both Qwen models\. These local measurements are distinct from managed Mem0 and from author\-reported product results\[[3](https://arxiv.org/html/2608.21755#bib.bib9)\]\.
## VEvaluation Protocol
### V\-AResearch Questions
- •RQ1:How much annotated evidence does the frozen ECHO read path recover on LoCoMo, LongMemEval\-S, and BEAM histories?
- •RQ2:Which benchmark types remain limited by session discovery, multi\-session coverage, temporal filtering, or context packing?
- •RQ3:Under a shared local answerer and judge, how does ECHO compare with pinned, protocol\-correct Mem0 OSS on a fixed sampled QA set?
- •RQ4:What latency, context, and construction costs accompany the retrieval gains on the fixed local stack?
- •RQ5:Which ledger, closure, routing, and worker components remain load\-bearing under ablation and concurrency tests?
### V\-BDatasets
TABLE III:Frozen ECHO retrieval scopes\. Registered/evaluated counts are both shown to prevent denominator drift\.LoCoMo contains four questions with no registered evidence; the category\-1–4 primary retrieval slice therefore has 1,536 evaluated rows, while category 5 has 446 and is reported separately\. LongMemEval\-S uses the cleaned 500\-question release with 246,750 turns\. The development BEAM result is one local 100K conversation with 188 turns, not the official BEAM\-1M or BEAM\-10M evaluation\. The five\-history gate uses rows fixed before retrieval outcomes were opened; five additional confirmation rows remain sealed\. LoCoMo, LongMemEval\-S, and the one\-history BEAM pilot were visible during development\.
### V\-CMatched Arms and Budgets
The frozen ECHO runs use Top\-10 retrieval, HNSW, eight workers, query expansion with at most three subqueries, and the local Qwen embedding endpoint\. Candidate and context ceilings are dataset\-specific: LoCoMo and BEAM use 256 candidates and 29\.4 kB total context; LongMemEval\-S uses 512 candidates and 60 kB total context\.
A post\-hoc source audit found that the frozen query\-expansion rule set contains proper names and lexical phrases added while benchmark histories were visible\. The public adapters still exclude answer, reference, rubric, and support fields, so this is not a direct gold\-field path\. Nevertheless, an expansion can inject an answer\-bearing token that was absent from the question\. We therefore classify every expansion\-enabled retrieval and ablation number as a development\-stage diagnostic\. A source\-neutral rewrite and clean rerun are required before these values can support confirmatory retrieval claims\.
The Mem0 comparison is a sampled matched run rather than a full\-dataset reproduction\. It contains 91 questions from eight histories: 65 LoCoMo, six LongMemEval, and 20 from the local BEAM\-100K history\. Both systems use the same localqwen3:4banswerer and binary judge, while their saved Top\-10 contexts remain system\-specific\. We retain every question and all transport, empty\-answer, and judging failures\. Because the pinned Mem0 revision does not retain complete source\-turn lineage across memory revisions, ECHO\-style Hit@10, turn recall, session recall, and provenance MRR have no Mem0 value in the matched table\.
Author\-reported systems are separated because their readers, judges, cutoffs, dataset releases, and managed components differ\. A published LLM\-judge score is not compared numerically with ECHO retrieval recall\.
### V\-DMetrics and Statistical Treatment
LetGiTG\_\{i\}^\{T\}andGiSG\_\{i\}^\{S\}be the unique gold turn and session sets for questionii, letG^i,kT\\widehat\{G\}\_\{i,k\}^\{T\}andG^i,kS\\widehat\{G\}\_\{i,k\}^\{S\}be their recalled subsets in the firstkkhits, and letrir\_\{i\}be the rank of the first relevant hit \(∞\\inftyif absent\)\. We report
Hit@k\\displaystyle\\operatorname\{Hit@\}k=1n∑i=1n𝟙\[G^i,kT≠∅\],\\displaystyle=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\mathbb\{1\}\[\\widehat\{G\}\_\{i,k\}^\{T\}\\neq\\varnothing\],MRR\\displaystyle\\operatorname\{MRR\}=1n∑i=1n1ri,\\displaystyle=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\frac\{1\}\{r\_\{i\}\},\(11\)Rturn@k\\displaystyle R\_\{\\mathrm\{turn\}\}@k=∑i\|G^i,kT\|∑i\|GiT\|,\\displaystyle=\\frac\{\\sum\_\{i\}\|\\widehat\{G\}\_\{i,k\}^\{T\}\|\}\{\\sum\_\{i\}\|G\_\{i\}^\{T\}\|\},Rsession@k\\displaystyle R\_\{\\mathrm\{session\}\}@k=∑i\|G^i,kS\|∑i\|GiS\|\.\\displaystyle=\\frac\{\\sum\_\{i\}\|\\widehat\{G\}\_\{i,k\}^\{S\}\|\}\{\\sum\_\{i\}\|G\_\{i\}^\{S\}\|\}\.\(12\)
These retrieval estimands diagnose evidence delivery and are never substituted for strict answer accuracyn−1∑i𝟙\[ai≡yi\]n^\{\-1\}\\sum\_\{i\}\\mathbb\{1\}\[a\_\{i\}\\equiv y\_\{i\}\]\. We also retain mean query latency, index construction time, and context bytes\. Latency includes the local query embedding call and is therefore not pure vector\-index service time\.
For descriptive uncertainty we pairx/nx/nwith the 95% Wilson interval
p^\+z2/\(2n\)±zp^\(1−p^\)/n\+z2/\(4n2\)1\+z2/n,z=1\.96,\\frac\{\\widehat\{p\}\+z^\{2\}/\(2n\)\\ \\pm\\ z\\sqrt\{\\widehat\{p\}\(1\-\\widehat\{p\}\)/n\+z^\{2\}/\(4n^\{2\}\)\}\}\{1\+z^\{2\}/n\},\\qquad z=1\.96,\(13\)and report the two\-sided exact McNemar test for paired correctness\. Letbbbe the number of ECHO\-correct/Mem0\-wrong questions andccthe reverse:
pexact=min\(1,2∑j=0min\(b,c\)\(b\+cj\)2−\(b\+c\)\)\.p\_\{\\mathrm\{exact\}\}=\\min\\\!\\left\(1,2\\sum\_\{j=0\}^\{\\min\(b,c\)\}\\binom\{b\+c\}\{j\}2^\{\-\(b\+c\)\}\\right\)\.\(14\)Hereb=9b=9andc=30c=30\. We complement the question\-level test with stratified paired bootstrap intervals and a history\-cluster sensitivity analysis\. The sample covers eight histories, so the automated\-judge analysis and itspp\-value are interpreted at the protocol level rather than as full\-dataset population estimates\.
### V\-ELeakage and Invariance Audits
Public adapters reject answer, reference, rubric, and support fields\. Prediction entry points have no gold path\. LongMemEval requires special care because the released JSON co\-locatesanswer,has\_answer, andanswer\_session\_idswith histories; the public adapter strips these labels before ingestion\. LoCoMo likewise separates QA answer/evidence annotations from conversation payloads\.
Before any selective\-realization model call, we rebuild the complete task matrix and compare all context hashes, token counts, source IDs, hit counts, truncation fields, packing traces, retrieval latency, and provider identities against the frozen parent\. The run is invalid if any context field differs\.
## VIResults
### VI\-AFrozen ECHO Evidence Retrieval
TABLE IV:Cutoff\-aligned evidence retrieval, not QA accuracy\. Hit@10 is question\-level; turn/session R\.@5 and R\.@10 are micro annotated\-unit coverage recomputed from the same frozen Top\-10 rows\.Table[IV](https://arxiv.org/html/2608.21755#S6.T4)replaces earlier presentations that mixed a LoCoMo Hit@10 and LongMemEval Recall@5 under an*accuracy*heading\.
All three development runs have zero projection failure\. The shape checks are 10 conversations/5,882 turns for LoCoMo, 500 conversations/246,750 turns for LongMemEval\-S, and one local conversation/188 turns for BEAM\. Index construction takes 13\.9 minutes, 14\.90 hours, and 71\.2 seconds, respectively, on the fixed laptop stack\. LongMemEval\-S is dominated by 246,001 projected memories and local embedding generation; it should not be interpreted as a vector\-index\-only build time\.
0255075100LoCoMoLongMemEvalBEAMHit@10turn recallFig\. 3:Question\-level hits conceal incomplete evidence coverage\. The gap is largest on the local BEAM pilot\. LoCoMo uses the category\-1–4 primary slice\.Figure[3](https://arxiv.org/html/2608.21755#S6.F3)is the central diagnostic: Hit@10 answers whether at least one annotated turn appears, whereas turn recall measures how much required evidence appears\. The two are not interchangeable\.
### VI\-BRemaining Retrieval Errors
LoCoMo category 3 is the weakest slice \(86\.96% Hit@10, 66\.83% turn recall, MRR 0\.5210\); category 1 also has a coverage gap at 71\.38% turn recall\. These misses are dominated by multi\-turn and indirect support rather than simple absence of a relevant session\. LongMemEval\-S single\-session preference is the weakest type \(86\.67% Hit@10 and session recall, MRR 0\.6892\), while the multi\-session slice retains 86\.24% turn recall and 90\.70% session recall\. The remaining LongMemEval errors therefore mix preference paraphrase and multi\-session coverage rather than a global context ceiling\.
The BEAM development pilot is a stronger warning\. Event ordering and summarization each recover only 42\.86% of annotated turns and 50% of sessions despite 100% Hit@10\. Temporal reasoning has full turn/session recall but MRR 0\.3214, indicating a ranking rather than coverage failure\. These slices motivate separate ordering, summarization\-coverage, and temporal\-ranking workers; adding workers is justified only when a targeted smoke changes the implicated evidence and passes a stable\-hit non\-regression slice\.
### VI\-CFresh\-History BEAM Generalization
TABLE V:Preregistered fresh\-history BEAM generalization for ECHO Top\-10 retrieval\. The prespecified gate required at least 80 evaluated questions, zero projection failures, Hit@10≥85%\\geq 85\\%, turn recall≥50%\\geq 50\\%, and session recall≥60%\\geq 60\\%\.The five\-history run has zero projection failures but fails all three retrieval thresholds in Table[V](https://arxiv.org/html/2608.21755#S6.T5), falsifying a broad reading of the one\-history pilot\. Event ordering is weakest \(40\.0% Hit@10, 14\.71% turn recall, and 21\.57% session recall\), followed by summarization \(70\.0%, 14\.46%, and 26\.0%\)\. A post\-gate Top\-50 diagnostic places many gold turns at ranks 16–41, implicating candidate coverage and ranking rather than ingestion\. A generic focus\-rewrite smoke adds no Top\-10 hits and is reverted\. Under the stopping rule, cross\-benchmark non\-regression is skipped and the reserved confirmation histories remain sealed\.
### VI\-DProtocol\-Matched ECHO–Mem0 OSS QA
TABLE VI:Matched sampled end\-to\-end QA\. Both arms use the same binary Qwen answerer/judge protocol\. Parentheses contain Wilson 95% intervals\. Mem0 provenance retrieval metrics remain unobservable and are not assigned zero\.On this fixed 91\-question sample, Mem0 is 23\.08 percentage points higher in binary QA accuracy\. The discordant counts areb=9b=9andc=30c=30, yielding the exact test in Eq\.[14](https://arxiv.org/html/2608.21755#S5.E14)\. A stratified paired bootstrap gives a 95% interval of\[−35\.16,−10\.99\]\[\-35\.16,\-10\.99\]points\. The questions come from only eight histories, however, and a paired history\-cluster sensitivity interval is\[−25\.5,\+25\.0\]\[\-25\.5,\+25\.0\]points\. We therefore conclude only that Mem0 is stronger on this fixed question sample under the shared answer protocol; we do not infer a population advantage or a retrieval\-quality ordering\.
The protocol\-correct Mem0 overlay maps benchmark timestamps tometadata\.created\_at, uses exact extraction schemas, and preserves all ingestion/search failures\. The invalid pre\-schema run and repaired replay remain in the artifact ledger\. Mem0’s revision objects do not preserve a complete mapping to every contributing benchmark turn, so its ECHO\-style Hit@10, turn recall, session recall, and provenance MRR are*not observable*\. The automated judge result is provisional until the frozen 30\-question, 120\-response packet is independently labeled by two humans\.
### VI\-EAuthor\-Reported Results Are a Separate Estimand
TABLE VII:Primary\-source Mem0 numbers shown for orientation only\. None is metric\-compatible with ECHO retrieval in Table[IV](https://arxiv.org/html/2608.21755#S6.T4)or the matched sampled QA in Table[VI](https://arxiv.org/html/2608.21755#S6.T6)\.The managed numbers are taken from the Mem0 repository README \(accessed 19 August 2026\), which explicitly states that proprietary optimizations are not available in the open\-source SDK\. The LoCoMo paper numbers come from\[[3](https://arxiv.org/html/2608.21755#bib.bib9)\]\. We therefore neither subtract them from ECHO retrieval metrics nor label the local matched sample as a reproduction of managed Mem0\.
### VI\-FEvidence Scope
The frozen ECHO artifacts establish high evidence retrieval on two full conversational benchmarks\. The one\-history BEAM pilot is explicitly development evidence, and the preregistered five\-history test demonstrates materially weaker generalization\. The matched QA sample establishes a question\-level disadvantage for ECHO on the fixed 91 questions, not a population ranking: only eight history clusters are represented and the judge is not human\-calibrated\. Author\-reported managed results remain a third, non\-comparable estimand\.
## VIILoad\-Bearing Ablations, Robustness, and Scale
### VII\-ABEAM Retrieval Ablations
We use the complete local BEAM\-100K row as a paired diagnostic because it is small enough to rerun exactly and exposes the largest hit–coverage gap\. Every arm keeps the frozen v11 Top\-10 budget, Qwen embedding model, candidate and context limits, 188 indexed turns, and the same 18 evidence\-bearing questions\. Only the named component changes\. All four audits contain 20 unique question records \(18 evaluated and two annotation\-defined no\-evidence questions\), zero invalid records, and zero projection failures\.
TABLE VIII:Load\-bearing BEAM\-100K retrieval ablations \(n=18n=18evaluated questions\)\. Dense\-only disables lexical and entity routes; lexical\-only disables dense and entity routes\. Latency includes local query embedding\. Results are a paired local diagnostic, not a BEAM\-1M/10M claim\.Table[VIII](https://arxiv.org/html/2608.21755#S7.T8)rejects two shortcut explanations\. Dense retrieval alone preserves a one\-turn hit for every question but loses 9\.44 turn\-recall points, 13\.16 session\-recall points, and 0\.226 MRR\. Lexical retrieval alone misses three questions and loses 15\.10 turn\-recall points\. Within this development configuration, query expansion is the largest load\-bearing component: removing it halves mean query time, but Hit@10 falls by 16\.67 points, turn recall by 26\.42 points, and session recall by 18\.42 points\. Because the audited rules contain source\-specific phrases, this drop measures dependence on that particular rule set, not the benefit of a generic reformulator\. Session support remains a smaller diagnostic term, recovering two of 53 annotated turns and 0\.027 MRR\.
### VII\-BRobustness Boundary
The ablations validate component dependence, not universal robustness\. Controlled tests still need to vary late arrival, correction, retraction, contradictory sources, missing support, repeated entity mentions, relative dates, and stale derived indexes\. Required invariants are zero generation\-stale leakage, no similarity\-based currentness decision, preservation of historical as\-of answers, and deterministic abstention when a required closure is absent\. Prompt and paraphrase robustness must use source\-neutral transformations fixed before answers are exposed\.
### VII\-CWorker Concurrency Frontier
We fix 200 operations per point and 64 candidates and sweep concurrency\{1,2,4,8,16\}\\\{1,2,4,8,16\\\}\. The deterministic stress harness excludes remote LLM and embedding calls, so it isolates worker/state\-path capacity rather than end\-to\-end answer latency\. Across 40 configurations \(8 paths per level\) and 8,000 operations, no operation fails\.
1234124816—Predictive core–TopicBucket DB⋯\\cdotsROSE coreworker concurrencythroughput / 1\-worker throughputFig\. 4:Normalized worker throughput on the fixed Windows/WSL2 Docker host\. Stateful TopicBucket saturates near four workers; pure C\+\+ ROSE reranking continues scaling\. These are worker\-path measurements, not QA accuracy\.Figure[4](https://arxiv.org/html/2608.21755#S7.F4)shows that worker count is not a monotone capacity knob\. Predictive\-core throughput peaks at 107\.4k calls/s at four workers; TopicBucket/DuckDB peaks at 1,507 calls/s at four and remains near 1,447 calls/s at 16 while p95 grows from 2\.07 to 20\.43 ms\. ROSE core reaches 15\.9k reranks/s at 16 with 0\.598 ms p95\. In contrast, existing Ladybug graph paths stay near 40–44 calls/s and exhibit 1\.28–2\.15 s p95 at 16, locating the bottleneck in storage coordination rather than worker arithmetic\. Four workers are therefore the defensible stateful operating point on this host; eight or more are useful only for CPU\-local reranking\. Production capacity still requires replication on target hardware with live model endpoints\.
A deterministic post\-merge carrier gate further separates repository overhead from model latency\. With 2,000 active memories, 100 lexical Top\-10 queries, and an in\-memory DuckDB repository, Recall@1, Recall@10, MRR, and NDCG@10 are all 1\.0; p50/p95/p99 query latency is 61\.2/71\.0/73\.6 ms and peak RSS is 0\.99 GiB\. The gate excludes embedding and LLM calls and is therefore neither an end\-to\-end benchmark nor a cross\-system comparison\. Batched revision validation and recall\-audit insertion preserve per\-hit provenance while avoiding statement\-per\-hit preparation overhead\.
Human judge calibration and reserved\-history confirmation remain future work\.
## VIIIRelated Work
### VIII\-APersistent Agent Memory
Generative Agents stores observations, reflections, and plans\[[17](https://arxiv.org/html/2608.21755#bib.bib10)\]; MemGPT treats long\-lived context as a virtual\-memory management problem\[[16](https://arxiv.org/html/2608.21755#bib.bib11)\]; A\-MEM organizes evolving notes with links\[[24](https://arxiv.org/html/2608.21755#bib.bib12)\]; Mem0 extracts and updates salient memories\[[3](https://arxiv.org/html/2608.21755#bib.bib9)\]\. Zep represents evolving facts in a temporal knowledge graph\[[18](https://arxiv.org/html/2608.21755#bib.bib13)\], while HippoRAG 2 uses graph propagation for factual and associative retrieval\[[9](https://arxiv.org/html/2608.21755#bib.bib14)\]\. These systems establish persistent, graph, and temporal memory as prior art\. Our distinction is the explicit authority boundary among candidate discovery, bitemporal currentness, provenance closure, and selective answer realization under a matched audit protocol\.
### VIII\-BTemporal and Structured Memory
TReMu couples timeline memory with explicit temporal calculation\[[5](https://arxiv.org/html/2608.21755#bib.bib15)\]\. LightMem combines filtering, topic grouping, and offline consolidation\[[4](https://arxiv.org/html/2608.21755#bib.bib16)\]\. MemoryAgentBench broadens evaluation to retrieval, test\-time learning, long\-range understanding, and selective forgetting\[[8](https://arxiv.org/html/2608.21755#bib.bib17)\]; HaluMem localizes hallucinations to memory lifecycle stages\[[1](https://arxiv.org/html/2608.21755#bib.bib18)\]\. ECHO builds on temporal database and provenance semantics rather than claiming that timestamps, graphs, or consolidation are new by themselves\.
### VIII\-CLong\-Context Evaluation and Answer Judging
Lost in the Middle shows that readers can underuse evidence depending on its position\[[11](https://arxiv.org/html/2608.21755#bib.bib1)\]; full context is therefore a control, not an assumed oracle\. LoCoMo, LongMemEval, and BEAM progressively test longer and more dynamic conversational memory\. Because LLM judges can vary with prompt and model, our protocol pins the judge, stores its exact outputs, and reports strict deterministic metrics alongside it\. External headline scores remain author\-reported unless rerun in the matched harness\.
## IXDiscussion
### IX\-AFrom an Archive to a Governed Memory Plane
The central architectural choice is to separate*discovery*from*authority*\. Lexical and dense similarity are effective ways to propose what should be inspected, but they are poor mechanisms for deciding which revision is current or whether two states conflict\. ECHO therefore places a bitemporal ledger and provenance closure between retrieval and realization\. This boundary makes a stale answer, an unresolved conflict, and missing support different observable failures rather than different forms of “low relevance\.”
The cognitive framing is useful precisely where it produces such engineering commitments\. Episodic encoding motivates immutable experience; consolidation motivates typed projections that remain linked to episodes; reconsolidation motivates append\-only revision; contextual reinstatement motivates multi\-route recall; and executive control motivates selective realization and abstention\. These are functional correspondences that can be tested and ablated\. They do not imply that the modules implement, simulate, or localize biological memory\.
### IX\-BWhat the Evidence Supports—and Falsifies
The full LoCoMo and LongMemEval\-S runs support a bounded claim: on the frozen local files and stack, ECHO delivers high Top\-10 evidence coverage with zero projection failures\. The development BEAM pilot then demonstrates that Hit@10 alone is insufficient, because one relevant item can coexist with missing multi\-event support\. The fresh\-history gate goes further: its 78\.65% Hit@10 and 40\.80% turn recall falsify any claim that the 100% pilot hit rate generalizes across BEAM histories\. Top\-50 diagnostics localize much of the gap to ranking and coverage, especially for event ordering and summarization\.
The matched QA sample draws a second boundary\. Mem0 OSS is significantly better at the question level on the 91 fixed items, while the eight\-history cluster sensitivity interval remains inconclusive\. This does not negate ECHO’s retrieval results, because retrieval coverage and answer accuracy are different estimands; it shows that an auditable evidence plane is not by itself a stronger reader\. Conversely, Mem0’s lack of complete source\-turn lineage prevents its QA result from being interpreted as a provenance\-retrieval score\.
### IX\-CImplications for Memory\-System Evaluation
Three reporting practices follow\. First, report question hits together with micro turn/session coverage and first\-relevant rank\. Second, separate frozen development, fresh generalization, and end\-to\-end QA; a gain at one stage must not be relabeled as another\. Third, treat observability as part of the protocol: a metric that a baseline cannot expose is missing, not zero\. These practices make negative results actionable and reduce the temptation to compare managed product scores, open\-source retrieval metrics, and judge\-based QA as though they were interchangeable\.
## XLimitations and Ethical Considerations
LoCoMo and LongMemEval\-S were visible during development, and a post\-hoc audit found source\-specific query\-expansion phrases; those retrieval scores are provisional despite exclusion of gold QA fields\. The five\-history BEAM gate fails and does not characterize BEAM\-1M/10M; its reserved confirmation set remains sealed\. Accordingly, the authority and reproducibility claims in this paper are tied to the evaluated components and archived artifacts\.
The matched Mem0 comparison contains 91 questions but only eight history clusters\. Question\-level paired inference favors Mem0, whereas the history\-cluster sensitivity interval crosses zero; neither should be extrapolated to complete datasets\. Mem0 memory revision also does not expose complete source\-turn provenance, so retrieval Hit@10, turn/session recall, and provenance MRR are neither zero nor inferable\. Managed Mem0 scores use proprietary components and different protocols\.
The current study evaluates evidence delivery, not autonomous behavior or human\-like cognition\. The cognitive mapping is a functional design hypothesis, not a claim that software modules are anatomically, neurally, or clinically equivalent to biological memory\. End\-to\-end QA is sensitive to answerer and judge choice\. A 30\-question, 120\-response blinded calibration packet is frozen, and judge\-dependent conclusions are therefore reported as protocol\-level results rather than population estimates\.
Persistent personal memory raises privacy, consent, deletion, and access\-control risks\. Raw evidence and derived state should be scoped per user, encrypted, auditable, and deletable through provenance\-aware revocation\. Benchmark artifacts must exclude credentials, private hostnames, machine identifiers, and personally identifiable user logs\.
## XIConclusion
ECHO is an auditable memory architecture and service prototype separating immutable experience, bitemporal authority, candidate discovery, provenance closure, and realization\. Its visible\-dataset retrieval scores are descriptive because source\-specific expansion rules were used; it also fails the fresh BEAM gate, and Mem0 OSS is more accurate on the fixed 91\-question QA sample\. The contribution is therefore architectural and methodological: make currentness, support, conflict, and failure observable, while aligning each claim with its corresponding evidence boundary\.
## Appendix AEvidence Contract
All reported ECHO retrieval rows must be bound to dataset, source, model, prompt, and executable hashes; interrupted audits may be resumed only by preserving valid records and retaining truncated lines as failure evidence\. Retrieval and QA metrics are separate estimands\. A baseline field that is not exposed by its API is reported as*not observable*, never as zero\. Sampled baseline QA must retainnn, failures, and uncertainty and must not be extrapolated to a full benchmark\.
A future superiority claim requires a frozen answerer and human\-calibrated judge, a sufficiently powered protocol\-matched baseline, a fresh source that passes its preregistered gate, zero denominator drift, and non\-regression gates fixed before answers are opened\. Accordingly, the paper claims an auditable architecture, component\-level invariants, and development\-stage protocol findings, with confirmatory claims reserved for protocols satisfying the preregistered requirements above\.
## Appendix BArtifact Ledger
Frozen ECHO artifacts include the LoCoMo v7, LongMemEval v5, BEAM v11 development pilot, and five\-history fresh BEAM gate summaries and question\-level audits\. The evidence ledger also includes four complete BEAM ablation pairs, their analyses, and the 40\-configuration worker\-stress report bundle\. A post\-merge 2,000\-memory/100\-query carrier gate binds the Release source revision\. Mem0 artifacts retain the invalid pre\-schema run, exact failed\-pair replay, protocol\-correct ingestion, saved retrievals, all 91 paired predictions and scores, manifests, and completion records\. The artifact ledger is organized around the associated paths, datasets, prompts, images, container revisions, Qwen model IDs, environment metadata, and failures by SHA\-256\.
## References
- \[1\]D\. Chen, S\. Niu, K\. Li, P\. Liu, X\. Zheng, B\. Tang, X\. Li, F\. Xiong, and Z\. Li\(2025\)HaluMem: evaluating hallucinations in memory systems of agents\.arXiv preprint arXiv:2511\.03506\.External Links:[Link](https://arxiv.org/abs/2511.03506)Cited by:[§VIII\-B](https://arxiv.org/html/2608.21755#S8.SS2.p1.1)\.
- \[2\]J\. Cheney, L\. Chiticariu, and W\. Tan\(2009\)Provenance in databases: why, how, and where\.Foundations and Trends in Databases1\(4\),pp\. 379–474\.External Links:[Document](https://dx.doi.org/10.1561/1900000006)Cited by:[§III\-C](https://arxiv.org/html/2608.21755#S3.SS3.p1.1)\.
- \[3\]P\. Chhikara, D\. Khant, S\. Aryan, T\. Singh, and D\. Yadav\(2025\)Mem0: building production\-ready AI agents with scalable long\-term memory\.InEuropean Conference on Artificial Intelligence,pp\. 2993–3000\.External Links:[Document](https://dx.doi.org/10.3233/FAIA251160)Cited by:[§IV](https://arxiv.org/html/2608.21755#S4.p3.1),[§VI\-E](https://arxiv.org/html/2608.21755#S6.SS5.p1.1),[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.
- \[4\]J\. Fang, X\. Deng, H\. Xu, Z\. Jiang, Y\. Tang, Z\. Xu, S\. Deng, Y\. Yao, M\. Wang, S\. Qiao, H\. Chen, and N\. Zhang\(2026\)LightMem: lightweight and efficient memory\-augmented generation\.InInternational Conference on Learning Representations,External Links:[Link](https://arxiv.org/abs/2510.18866)Cited by:[§VIII\-B](https://arxiv.org/html/2608.21755#S8.SS2.p1.1)\.
- \[5\]Y\. Ge, S\. Romeo, J\. Cai, R\. Shu, Y\. Benajiba, M\. Sunkara, and Y\. Zhang\(2025\)TReMu: towards neuro\-symbolic temporal reasoning for LLM\-agents with memory in multi\-session dialogues\.InFindings of the Association for Computational Linguistics: ACL 2025,pp\. 18974–18988\.External Links:[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.972)Cited by:[§VIII\-B](https://arxiv.org/html/2608.21755#S8.SS2.p1.1)\.
- \[6\]Y\. Geifman and R\. El\-Yaniv\(2017\)Selective classification for deep neural networks\.InAdvances in Neural Information Processing Systems,Vol\.30\.Cited by:[§III\-F](https://arxiv.org/html/2608.21755#S3.SS6.p2.1)\.
- \[7\]M\. W\. Howard and M\. J\. Kahana\(2002\)A distributed representation of temporal context\.Journal of Mathematical Psychology46\(3\),pp\. 269–299\.External Links:[Document](https://dx.doi.org/10.1006/jmps.2001.1388)Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[8\]Y\. Hu, Y\. Wang, and J\. McAuley\(2026\)Evaluating memory in LLM agents via incremental multi\-turn interactions\.InInternational Conference on Learning Representations,External Links:[Link](https://arxiv.org/abs/2507.05257)Cited by:[§VIII\-B](https://arxiv.org/html/2608.21755#S8.SS2.p1.1)\.
- \[9\]B\. Jiménez Gutiérrez, Y\. Shu, W\. Qi, S\. Zhou, and Y\. Su\(2025\)From RAG to memory: non\-parametric continual learning for large language models\.InInternational Conference on Machine Learning,External Links:[Link](https://arxiv.org/abs/2502.14802)Cited by:[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.
- \[10\]D\. Kumaran, D\. Hassabis, and J\. L\. McClelland\(2016\)What learning systems do intelligent agents need? complementary learning systems theory updated\.Trends in Cognitive Sciences20\(7\),pp\. 512–534\.External Links:[Document](https://dx.doi.org/10.1016/j.tics.2016.05.004)Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[11\]N\. F\. Liu, K\. Lin, J\. Hewitt, A\. Paranjape, M\. Bevilacqua, F\. Petroni, and P\. Liang\(2024\)Lost in the middle: how language models use long contexts\.Transactions of the Association for Computational Linguistics12,pp\. 157–173\.External Links:[Document](https://dx.doi.org/10.1162/tacl%5Fa%5F00638)Cited by:[§VIII\-C](https://arxiv.org/html/2608.21755#S8.SS3.p1.1)\.
- \[12\]A\. Maharana, D\. Lee, S\. Tulyakov, M\. Bansal, F\. Barbieri, and Y\. Fang\(2024\)Evaluating very long\-term conversational memory of LLM agents\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics,pp\. 13851–13870\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.747)Cited by:[§I](https://arxiv.org/html/2608.21755#S1.p3.1)\.
- \[13\]J\. L\. McClelland, B\. L\. McNaughton, and R\. C\. O’Reilly\(1995\)Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory\.Psychological Review102\(3\),pp\. 419–457\.External Links:[Document](https://dx.doi.org/10.1037/0033-295X.102.3.419)Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[14\]E\. K\. Miller and J\. D\. Cohen\(2001\)An integrative theory of prefrontal cortex function\.Annual Review of Neuroscience24,pp\. 167–202\.External Links:[Document](https://dx.doi.org/10.1146/annurev.neuro.24.1.167)Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[15\]K\. Nader, G\. E\. Schafe, and J\. E\. LeDoux\(2000\)Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval\.Nature406\(6797\),pp\. 722–726\.External Links:[Document](https://dx.doi.org/10.1038/35021052)Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[16\]C\. Packer, V\. Fang, S\. G\. Patil, K\. Lin, S\. Wooders, and J\. E\. Gonzalez\(2023\)MemGPT: towards LLMs as operating systems\.arXiv preprint arXiv:2310\.08560\.External Links:[Link](https://arxiv.org/abs/2310.08560)Cited by:[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.
- \[17\]J\. S\. Park, J\. C\. O’Brien, C\. J\. Cai, M\. R\. Morris, P\. Liang, and M\. S\. Bernstein\(2023\)Generative agents: interactive simulacra of human behavior\.InProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology,External Links:[Document](https://dx.doi.org/10.1145/3586183.3606763)Cited by:[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.
- \[18\]P\. Rasmussen, P\. Paliychuk, T\. Beauvais, J\. Ryan, and D\. Chalef\(2025\)Zep: a temporal knowledge graph architecture for agent memory\.arXiv preprint arXiv:2501\.13956\.External Links:[Link](https://arxiv.org/abs/2501.13956)Cited by:[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.
- \[19\]S\. Robertson and H\. Zaragoza\(2009\)The probabilistic relevance framework: BM25 and beyond\.Foundations and Trends in Information Retrieval3\(4\),pp\. 333–389\.External Links:[Document](https://dx.doi.org/10.1561/1500000019)Cited by:[§III\-D](https://arxiv.org/html/2608.21755#S3.SS4.p1.1)\.
- \[20\]M\. Tavakoli, A\. Salemi, C\. Ye, M\. Abdalla, H\. Zamani, and J\. R\. Mitchell\(2026\)Beyond a million tokens: benchmarking and enhancing long\-term memory in LLMs\.InInternational Conference on Learning Representations,External Links:[Link](https://arxiv.org/abs/2510.27246)Cited by:[§I](https://arxiv.org/html/2608.21755#S1.p3.1)\.
- \[21\]K\. Torp, C\. S\. Jensen, and R\. T\. Snodgrass\(2000\)Effective timestamping in databases\.The VLDB Journal8\(3–4\),pp\. 267–288\.External Links:[Document](https://dx.doi.org/10.1007/s007780050009)Cited by:[§II\-A](https://arxiv.org/html/2608.21755#S2.SS1.p3.1)\.
- \[22\]E\. Tulving\(1972\)Episodic and semantic memory\.InOrganization of Memory,E\. Tulving and W\. Donaldson \(Eds\.\),pp\. 381–403\.Cited by:[§III\-A](https://arxiv.org/html/2608.21755#S3.SS1.p1.1)\.
- \[23\]D\. Wu, H\. Wang, W\. Yu, Y\. Zhang, K\. Chang, and D\. Yu\(2025\)LongMemEval: benchmarking chat assistants on long\-term interactive memory\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=pZiykaVOWL)Cited by:[§I](https://arxiv.org/html/2608.21755#S1.p3.1)\.
- \[24\]W\. Xu, Z\. Liang, K\. Mei, H\. Gao, J\. Tan, and Y\. Zhang\(2025\)A\-MEM: agentic memory for LLM agents\.arXiv preprint arXiv:2502\.12110\.External Links:[Link](https://arxiv.org/abs/2502.12110)Cited by:[§VIII\-A](https://arxiv.org/html/2608.21755#S8.SS1.p1.1)\.Similar Articles
Echo-Memory: A Controlled Study of Memory in Action World Models
Echo-Memory presents a controlled study of memory mechanisms in action-conditioned world models, revealing that memory structure and capacity significantly impact open-domain return performance beyond replay fidelity. The study introduces a matched evaluation protocol and finds that raw context and state-space recurrence are strong mechanisms.
Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings
This paper presents a longitudinal evaluation instrument for agent memory that avoids label-error and contamination by generating facts before text, and demonstrates that short-horizon benchmarks can mis-rank memory architectures compared to long-horizon performance. It also releases the Veracium open-source library for agent memory evaluation.
Cognis: Context-Aware Memory for Conversational AI Agents
Lyzr Cognis introduces a unified, open-source memory system for conversational AI that fuses BM25 and Matryoshka vector search with version-aware ingestion, achieving SOTA on LoCoMo and LongMemEval benchmarks.
EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
EvoArena introduces a benchmark for evaluating LLM agents in dynamic environments with progressive updates across terminal, software, and social domains, while EvoMem proposes a patch-based memory paradigm that records structured evolution; experiments show current agents achieve only 39.6% accuracy on EvoArena, and EvoMem yields average gains of 1.5% on the benchmark and improvements on GAIA and LoCoMo.
rohitg00/agentmemory
agentmemory is an open-source persistent memory layer for AI coding agents (Claude Code, Cursor, Gemini CLI, Codex CLI, etc.) that uses knowledge graphs, confidence scoring, and hybrid search to give agents long-term memory across sessions via MCP, hooks, or REST API. Built on the iii engine, it requires no external databases and exposes 51 MCP tools.