Tag
This position paper argues against the claim that natural language can fully replace formal languages such as programming languages, proposing an information-theoretic specificity framework and proving a crossover theorem showing formal languages are better for high-specificity tasks.
Memora is a scalable memory system for AI agents that decouples storage from retrieval, achieving state-of-the-art performance on long-horizon tasks while using up to 98% fewer tokens. The research is published at ICML 2026.
This paper identifies oversensitivity in continuous reward models for reinforcement learning, where equally good responses receive different scores, and proposes a discretization technique using Monte Carlo dropout to reduce this oversensitivity while maintaining discriminative ability, leading to better policies and less reward hacking.