TRACE: open-source hierarchical memory for LLM agents, 82.5% on MemoryAgentBench’s EventQA using gpt-oss-20B [P]

Reddit r/MachineLearning 07/06/26, 02:35 PM Papers

open-source memory-system llm-agents hierarchical-memory benchmark topic-tree

Summary

TRACE is an open-source hierarchical memory system for LLM agents that organizes conversation history into a topic tree, achieving 82.5% F1 on MemoryAgentBench's EventQA using an open-weight model, outperforming Mem0 and MemGPT.

Built a memory system called TRACE that organizes agent conversation history into a topic tree (branches + summaries) instead of flat RAG chunks, and benchmarked it on MemoryAgentBench (ICLR 2026), specifically the EventQA accurate-retrieval task. Its a pypi package: pip install trace-memory Results (F1): • TRACE (gpt-oss-20B): 82.5% • TRACE (gpt-oss-120B): 83.8% • Mem0 (GPT-4o-mini, paper’s official number): 37.5% • MemGPT/Letta (GPT-4o-mini, paper’s official number): 26.2% Ran gpt-oss locally, so this is an open-weights model against MemGPT/Mem0 on GPT-4o-mini, not an apples-to-apples same-backbone test (I don’t have the money for open ai tokens). I tried to get Mem0 running on gpt-oss-20B directly for fairness, but its fact-extraction step needs strict JSON output and gpt-oss’s responses didn’t parse cleanly (known issue, not gpt-oss specific. Same bug shows up with Gemini/Mistral too). Letta needs a full server setup so I skipped it. Full JSON logs from both runs are in the repo if you want to dig into the methodology yourselves. GitHub: https://github.com/husain34/TRACE

Original Article

Similar Articles

MemoryOS – AI agent memory with temporal knowledge graph and 9ms ingest and 78ms retrieval

Reddit r/AI_Agents

MemoryOS is an open-source, self-hosted AI agent memory tool using a temporal knowledge graph, achieving 86.2% accuracy on LongMemEval-s with fast 78ms retrieval speeds.

rohitg00/agentmemory

GitHub Trending (daily)

agentmemory is an open-source persistent memory layer for AI coding agents (Claude Code, Cursor, Gemini CLI, Codex CLI, etc.) that uses knowledge graphs, confidence scoring, and hybrid search to give agents long-term memory across sessions via MCP, hooks, or REST API. Built on the iii engine, it requires no external databases and exposes 51 MCP tools.

Agent memory that retrieves 96.4% on LongMemEval without calling a model

Reddit r/AI_Agents

Agentlas is a free, open-source agent memory system that uses a local SQLite database combined with lightweight embedding and keyword search to achieve 96.4% on LongMemEval without calling an LLM, outperforming alternatives like mem0 and supermemory.

GroupMemBench: Benchmarking LLM Agent Memory in Multi-Party Conversations

arXiv cs.CL

GroupMemBench is a new benchmark for evaluating LLM agent memory in multi-party conversations, exposing failures in current memory systems with the best achieving only 46% average accuracy.

@zxlzr: Introducing MemTrace: Making LLM Memory Systems Finally Debuggable Memory is becoming a core component of AI agents. Bu…

X AI KOLs Following

MemTrace is a new tool that makes LLM memory systems debuggable by tracing memory operations across multiple turns, addressing the black-box nature of current memory-augmented agents.