AI is deteriorating in realtime

Reddit r/ArtificialInteligence News

Summary

AI models are deteriorating due to training on recursively generated synthetic data, leading to model collapse; multiple studies highlight the risks of scaling with synthetic data.

**SOURCES & REFERENCES** Shumailov et al. — "AI Models Collapse When Trained on Recursively Generated Data." Nature, July 2024. [https://www.nature.com/articles/s41586-024-07566-y](https://www.nature.com/articles/s41586-024-07566-y) Villalobos et al. (Epoch AI) — "Will We Run Out of Data? Limits of LLM Scaling Based on Human-Generated Data." International Conference on Machine Learning, 2024. [https://arxiv.org/abs/2211.04325](https://arxiv.org/abs/2211.04325) OpenAI — o3 and o4-mini System Card (April 2025). PersonQA hallucination benchmark. Gartner — Forecast on synthetic training data, projecting 60% of training corpora by 2024. Duke University Library — Generative AI Student Survey (January 2025). DeepMind — AlphaZero (chess/Go from self-play); AlphaGeometry (Olympiad-level geometry from synthetic data). Ed Zitron — "The Truth About the AI Bubble & The Software Decline." Tech Report interview. [https://www.wheresyoured.at/](https://www.wheresyoured.at/) Gary Marcus — "How an AI feedback loop threatens to break ChatGPT." Tech Report. [https://garymarcus.substack.com/](https://garymarcus.substack.com/)
Original Article

Similar Articles

What's up with model collapse?

Reddit r/LocalLLaMA

An exploration of model collapse, a phenomenon where AI models trained on synthetic data degrade in quality and diversity.