Regression to the Mean: on LLMs and the quiet death of the new
Summary
An essay arguing that LLMs, by returning the most probable continuation, may inadvertently suppress genuine novelty and deviation, leading to a cultural convergence toward the average rather than the truly new.
View Cached Full Text
Cached at: 07/06/26, 02:03 PM
Similar Articles
Are LLMs becoming similarly creative? Evidence from three years of models
This paper analyzes LLM outputs over three years using open-ended tasks and creativity assessments, finding a statistically significant decrease in diversity that suggests creative substance is converging across models, which could diminish human agency in co-creative work.
Linguistic Monoculture in LLM-Assisted Language Use
This paper introduces a mathematical framework to study how reliance on shared LLMs for writing may reduce population-level linguistic diversity, analyzing fixed, recursive, and personalized interaction mechanisms and characterizing equilibria and convergence rates.
LLMs are stuck in a groupthink groove. This startup is trying to get them out.
A startup called Springboards has developed an LLM named Flint that aims to produce more varied and creative responses than mainstream models, addressing a widespread issue of homogeneity in AI outputs. The article highlights research showing that many LLMs converge on similar answers due to similar training data and methods.
Making LLMs Better at Creative Writing using Entropy
This article presents a technique to improve LLM creative writing by modifying the sampling process using entropy, aiming to reduce the generic 'LLM feel' in generated text.
Use Boring Languages with LLMs
An opinion piece arguing that LLMs perform better with boring, consistent languages and ecosystems (like Ruby on Rails) because the training corpus has lower variance, leading to more reliable agentic output, while fragmented ecosystems (like JavaScript) produce poor results.