Tag
This paper introduces a recursion formula for efficiently computing the stochastic complexity of vectors with cluster structure using the Normalized Maximum Likelihood model, reducing time complexity from polynomial to linear.
This paper analyzes integer-sequence benchmarks for language models using minimum description length, revealing that these benchmarks often measure memorisation rather than inductive reasoning, and introduces a new difficulty measure.
SkillZip is a new method for compressing the accumulated skills of self-evolving agents without evaluation rollouts, by finding a minimal faithful structural explanation that reuses repeated rules and procedures while preserving rare exceptions.