Tag
This paper presents a scaling law showing that the contextual influence of word order in human language decays approximately as 1/d with distance, as measured by the reduction in perplexity from large language models, across multiple languages and corpora.