Tag
The author questions the inevitability of model collapse in AI if AI-generated content becomes dominant in future training data.
This paper investigates model collapse in multi-model ecosystems where AI-generated text is recycled into training data. It finds that market concentration has minimal effect on the speed or destination of collapse, which is primarily influenced by the sources of the training pool.
This paper examines how different AI model checkpoints exhibit varying susceptibility to collapse when trained recursively on shared model-generated data, revealing that fragility is an intrinsic property that can be inferred from short iterations.
The article explores how recursive AI processes cause degradation in image and text outputs, illustrating with experiments using AI models like Nano Banana 2 and Gemini to discuss model collapse and stability in generative AI.
This paper demonstrates that retrieval-augmented generation (RAG) systems suffer from collapse when retrieving self-authored documents, leading to reduced response diversity and self-bias, with experiments showing collapse in 79.6% of simulations.
This paper provides an up-to-date overview of the phenomenon of model collapse in generative AI and reviews countermeasures to mitigate it, highlighting challenges and future research opportunities.
The article raises concerns about AI models potentially training on data generated by AI itself, which could lead to issues like model collapse, citing examples such as Deezer removing millions of AI-generated songs and the high proportion of AI-created blog articles.
A blog post and accompanying tweet explore whether pre-generative-AI data becomes more valuable as the internet fills with synthetic content, discussing provenance, model collapse, and Anthropic's book scanning.
This paper introduces the 'fairness collapse' phenomenon, showing that training language models on synthetic data silently amplifies social biases before standard model collapse metrics degrade, highlighting a critical risk for AI fairness.
Explores the problem of AI models training on AI-generated content, leading to potential degradation and loss of truth as inaccuracies compound.
AI companies are buying pre-2022 printed books to avoid AI-generated text in training data, as old books are guaranteed free of AI slop and poisoning. ISBNdb offers bulk book acquisition services to AI labs under NDAs.
This paper studies model collapse in iterative instruction tuning with synthetic data, revealing that collapse manifests as polarization of competence where strong skills are reinforced while weak ones degrade. It proposes KITE, a two-stage framework combining failure-guided data generation and boundary-aware uncertainty curation to ensure stable improvement across iterations.
The article discusses a consulting firm's argument that model collapse, human cognitive debt (skill atrophy), and competitive pressure form a self-reinforcing feedback loop in AI, and questions whether organizations can resist the race to automate.
An exploration of model collapse, a phenomenon where AI models trained on synthetic data degrade in quality and diversity.
This paper demonstrates that data selection in low-resource verification regimes, where verifiers only have access to fragmented and biased slices of the target distribution, can paradoxically accelerate model collapse by pruning globally relevant tail modes. The authors provide theoretical proof and propose a collaborative proxy reference mechanism as a mitigation strategy.
This paper proposes a bilayer coupled SIR/SIRS framework to model synthetic data contamination and model collapse in AI ecosystems, showing that cross-contamination between models and data corpora leads to supercritical dynamics and identifying detection-based filtering as a key intervention.
This article explores model collapse not as a technical bug but as an epistemic problem: when an AI model's outputs become its own inputs, the model's representation of reality gradually flattens into a self-referential average, raising questions about how we distinguish a model that models the world from one that models only itself.
This paper studies self-consuming training in a multi-model regime, showing that human curation can backfire and degrade long-term alignment due to cross-model interactions.
This paper reframes model collapse in LLMs as a cultural transmission phenomenon, showing that iterated learning theory predicts a non-monotonic trajectory of compositionality under self-training, confirmed across multiple languages and models.
Scientists claim to have found a solution to prevent AI models from cannibalizing themselves when human-generated data runs out, addressing the problem of model collapse where LLMs trained on synthetic data produce gibberish and hallucinations.