Tag
This paper investigates when weight-tied looped transformers implement actual algorithms, introducing the budget law and showing mechanisms are portable across training budgets, with implications for adaptive computation and interpretability.