activation-transduction

Tag

Cards List
#activation-transduction

Ablation-Reversible Heads Don't Transfer: A Stress Test for Mechanistic Role Claims in Transformers

arXiv cs.AI · 2026-06-09 Cached

This paper shows that attention heads meeting common criteria for mechanistic role claims (necessity, linear decodability, ablation reversibility) routinely fail to transfer computations across prompts, and introduces the KID (Knowing/Intent/Doing) framework and a three-stage pipeline for more rigorous role assignment.

0 favorites 0 likes
← Back to home

Submit Feedback