A research agent's most useful memory may be the experiment it rejected

Reddit r/AI_Agents Papers

Summary

The AQuA v2 preprint introduces a memory system for research agents that uses persistent evidence from accepted and rejected experiments to guide future proposals, emphasizing the importance of evidence lifecycle management.

Most agent-memory discussions start with recall: how much prior text can the system retrieve? The AQuA v2 preprint describes a different memory object. Within each research loop, validated evidence updates a part-specific persistent state that guides later proposals. The proposal LM and evaluator remain fixed; continuity comes from what the loop has established, including evidence for ideas it accepted and rejected. Part I makes that workflow concrete. An AI Manager coordinates six sequential specialists: Data Steward, Visual Analyst, Idea Miner, Factor Evaluator, Backtest Engineer, and Research Librarian. Feedback operates within a backtest, within a run, and across runs. The role chain ends with a Research Librarian. More importantly, the durable state is not merely a longer conversation: later proposals can inherit which mechanisms survived evaluation and which ones failed, so the next search does not have to treat every old idea as equally plausible. That suggests a stricter memory test for research agents: can a later proposal recover the evidence and rejection reason that motivated it? If it can only retrieve the old wording, the system has history, but not necessarily research state. Persistent evidence is not automatically trustworthy forever. A stale result can remain persuasive, two evaluations can conflict, and a fixed evaluator can validate something that later needs correction. The open design problem is the lifecycle of the evidence, not just its storage format. The source is AQuA v2 by Guo et al., arXiv:2608.12841; the full mechanism is summarized here so the post does not depend on a link. What would you require in an evidence ledger: provenance for every result, explicit rejection reasons, expiry rules, or a way to supersede contradictory findings?
Original Article

Similar Articles

Append-only memory is exactly wrong when an agent needs to change its mind

Reddit r/AI_Agents

A new preprint called TEPA treats memory validity as a first-class state, revoking outdated precedents when new evidence conflicts while keeping audit trails. It outperforms append-only and last-write-wins in a complete-reversal experiment, though results are not yet independently reproduced.

Agent memory is not just RAG over user facts

Reddit r/AI_Agents

The article argues that simple RAG-based agent memory systems fail in production due to issues like stale preferences, missed keywords, and prompt injection, and advocates for a layered memory architecture with active selection, deterministic fallback, governance, and testing.