chessformer_lens demo: ablating 1 of a chess transformer's 128 attention heads makes the model stop finding Morphy's queen sacrifice [P]
Summary
A demo of chessformer_lens shows that ablating a single attention head in a chess transformer causes it to stop recognizing Morphy's queen sacrifice, demonstrating the concentration of specific capabilities in individual heads.
Similar Articles
Trained transformer-based chess models to play like humans (including thinking time) [P]
Trained transformer-based chess models for rating buckets from 800 to 2500+, predicting moves, thinking time, and outcome. Achieves strong accuracy with only 9M parameters, and includes a novel thinking-time prediction component.
Ablation-Reversible Heads Don't Transfer: A Stress Test for Mechanistic Role Claims in Transformers
This paper shows that attention heads meeting common criteria for mechanistic role claims (necessity, linear decodability, ablation reversibility) routinely fail to transfer computations across prompts, and introduces the KID (Knowing/Intent/Doing) framework and a three-stage pipeline for more rigorous role assignment.
Deficient executive control in transformer attention
The article discusses a deficiency in executive control within transformer attention mechanisms, highlighting limitations in how transformers manage sequential dependencies.
@antoniolupetti: "Understanding Transformers and Attention Mechanisms" is a very interesting paper that presents the Transformer archite…
A tweet highlights an arxiv paper by Michel Fabrice Serret that introduces Transformers and attention mechanisms from an applied mathematics perspective, covering vectorization, multi-head attention, and methods to reduce attention costs like KV caching and latent attention.
A Controlled Study of Attention-Only Transformers
This paper presents a controlled study comparing attention-only transformers (Simple Attention Networks, SANs) against standard transformers matched for parameters, compute, and depth. It finds that removing feed-forward layers largely closes the performance gap when the freed capacity is reallocated to attention depth, with the remaining deficit attributed to parametric recall.