Tag
Memora is a scalable memory system for AI agents that decouples storage from retrieval, achieving state-of-the-art performance on long-horizon tasks while using up to 98% fewer tokens. The research is published at ICML 2026.
This paper identifies oversensitivity in continuous reward models for reinforcement learning, where equally good responses receive different scores, and proposes a discretization technique using Monte Carlo dropout to reduce this oversensitivity while maintaining discriminative ability, leading to better policies and less reward hacking.