residual-streams

This paper investigates how language models under coding agents internally represent the evolving program during iterative editing. The authors find that linear probes can decode program properties (e.g., parsing, test pass rate) from residual streams, and surprisingly, these representations predict future outcomes before the agent materializes edits, revealing a 'latent programming horizon'.