Hierarchos: Preliminary Findings From a 232M Recurrent Memory-Augmented Assistant Model [P]
Summary
This paper presents preliminary findings from Hierarchos, a 232-million parameter recurrent memory-augmented assistant model, exploring its capabilities in memory retention and assistance tasks.
Similar Articles
Multi-Head Recurrent Memory Agents
This paper identifies memory retention as the bottleneck in recurrent memory agents for long contexts and proposes Multi-Head Recurrent Memory (MHM), a training-free framework that partitions memory into independent heads with a select-then-update strategy. The lightweight instantiation MHM-LRU significantly improves retention and end-to-end accuracy across 100K–1M token ranges, raising retention from below 30% to 73.96% on RULER-HQA at 896K tokens.
Organize then Retrieve: Hierarchical Memory Navigation for Efficient Agents
This paper presents HORMA, a hierarchical organize-and-retrieve memory agent that organizes agent experiences into a file-system-like structure for efficient retrieval, improving performance on long-horizon tasks while reducing token usage.
H-Mem: A Novel Memory Mechanism for Evolving and Retrieving Agent Memory via a Hybrid Structure
H-Mem is a novel memory mechanism for LLM-based agents that uses a hybrid structure combining a temporal and semantic tree with a knowledge graph to model memory evolution and improve retrieval, achieving state-of-the-art performance on QA benchmarks.
sapientinc/HRM-Text-1B
Sapient Intelligence released HRM-Text-1B, a 1-billion-parameter language model with a novel dual-timescale recurrent architecture (Hierarchical Reasoning Model) that provides unbounded compute depth at bounded parameter count. The pre-alignment checkpoint is available on Hugging Face.
MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval
MemReranker is a reasoning-aware reranking model family (0.6B/4B) designed for agent memory retrieval, addressing limitations in semantic similarity by incorporating LLM knowledge distillation for better temporal and causal reasoning.