Tag
This paper investigates whether long-context language models exhibit episodic-like order memory similar to humans, using a temporal order memory task based on a novel. The authors find that models show the same distance effect and uncover a single attention head reinstating temporal context, supporting temporal context reinstatement as a mechanism for episodic-like memory in LLMs.