Tag
This paper investigates entity tracking in language models and humans using naturalistic narratives, revealing that models with sub-billion parameters already achieve human-level performance and exceed humans, indicating that core language understanding emerges at smaller scales than previously assumed.