Tag
This paper proposes using register tokens in diffusion language models to maintain bounded-state reasoning across generation chunks, showing substantial gains on math and code benchmarks without full context retention.
Discusses the shortcomings of transcript replay as default agent memory, citing research on context degradation and advocating for bounded-state memory with explicit write policies.