combinatorial-reasoning

Tag

Cards List
#combinatorial-reasoning

Transformers Linearly Represent Highly Structured World Models

arXiv cs.LG · 2026-05-20

This paper demonstrates that transformers trained on Sudoku solving traces build structured world models organized by domain constraints, and identifies a sparse, monosemantic circuit responsible for the naked-single decision rule. The work provides a fully interpretable algorithmic account of transformer reasoning on a combinatorial task.

0 favorites 0 likes
← Back to home

Submit Feedback