Tag
This article explores using the gzip compression algorithm as a language model, demonstrating that compression algorithms can generate text by scoring candidate continuations based on compressed length, using beam search to produce output.
The tweet describes how any compression tool, including gzip, can be adapted for language modeling, and that gzip can generate text that resembles Shakespeare. A write-up is linked.