Hierarchos: Preliminary Findings From a 232M Recurrent Memory-Augmented Assistant Model [P]
Summary
This paper presents preliminary findings from Hierarchos, a 232-million parameter recurrent memory-augmented assistant model, exploring its capabilities in memory retention and assistance tasks.
Similar Articles
Show HN: Adaptive Recall, persistent memory for AI assistants over MCP
Adaptive Recall is a memory system for AI assistants that uses cognitive science and machine learning to improve retrieval quality over time. It offers an API with multiple retrieval strategies, knowledge graph construction, and self-improving capabilities.
Multi-Head Recurrent Memory Agents
This paper identifies memory retention as the bottleneck in recurrent memory agents for long contexts and proposes Multi-Head Recurrent Memory (MHM), a training-free framework that partitions memory into independent heads with a select-then-update strategy. The lightweight instantiation MHM-LRU significantly improves retention and end-to-end accuracy across 100K–1M token ranges, raising retention from below 30% to 73.96% on RULER-HQA at 896K tokens.
A 150M param recurrent model scores 29.5% on ARC-AGI-1 at $0.0007 per task
The article introduces BDH-CQ, a 150M parameter recurrent model that combines in-context learning with latent reasoning, achieving 29.5% on ARC-AGI-1 at a cost of $0.0007 per task, setting a new standard for cost efficiency.
@rohanpaul_ai: A massive idea from this Shanghai University paper Giving AI Models Human-Style Memory Imagine reading a huge mystery b…
This paper introduces HOLA, a method that gives fast AI models (like linear-attention and state-space models) an additional memory cache to store surprising facts, improving their recall in long-context tasks without sacrificing speed.
Hierarchical Compositionality for An Assistive AI Agent
This paper proposes an assistive AI agent architecture based on hierarchical compositionality and simple heuristics to resolve ambiguity in object references, outperforming data-driven baselines while supporting adaptation to user preferences.