Compression is prediction
Summary
An ngrok blog post by Annie Sexton exploring the conceptual link between compression and prediction, likely discussing how predictive systems and compression algorithms are fundamentally connected.
View Cached Full Text
Cached at: 08/12/26, 08:24 AM
Similar Articles
How Is Compression Prediction?
The article discusses the mathematical equivalence between compression and prediction in information theory, referencing classical foundations and modern applications like language models.
@ngrokHQ: Compression and LLMs are trying to solve the exact same problem: predicting what comes next. @_anniebabannie_'s interac…
ngrok highlights Annie Babannie's interactive essay explaining how compression and language models both tackle the problem of predicting what comes next.
Compression Is All You Need - A thesis on Long term AI memory
An essay arguing that compression, not longer context windows, is the load-bearing primitive for long-term AI memory and relational continuity, drawing an analogy to compute and storage in computing.
What if context compression is a diffusion noise function? Proposal + honest results from untrained-model experiments [R]
Proposes treating semantic compression as a diffusion noise function for handling massive context beyond model windows, using multi-pass reading at decreasing compression levels. Untrained-model experiments show components work in isolation but the full chain needs training to resolve binding bottleneck.
What should context compression keep? I looked at how six agents handle it[D]
An analysis of how six AI coding agents (Claude Code, Codex CLI, OpenCode, Cline, Cursor, Amp) converge on layered progressive compression for long contexts, differing in what they protect (user messages, stateful tool outputs) and whether they inform the model of compression, with tradeoffs between cost and accuracy.