Some signs of AI model collapse begin to reveal themselves
Prediction: General-purpose AI could start getting worse
By Steven J. Vaughan-Nichols, The Register - May 27, 2025
https://www.theregister.com/2025/05/27/opinion_column_ai_model_collapse/
…. Welcome to Garbage In/Garbage Out (GIGO). Formally, in AI circles, this is known as AI model collapse. In an AI model collapse, AI systems, which are trained on their own outputs, gradually lose accuracy, diversity, and reliability. This occurs because errors compound across successive model generations, leading to distorted data distributions and “irreversible defects” in performance. The final result? A Nature 2024 paper stated, “The model becomes poisoned with its own projection of reality.” https://www.nature.com/articles/s41586-024-07566-y
:
… For all the crap about how AI will encourage us to spend more time doing better work, the truth is AI users write fake papers including bullshit results. This ranges from your kid’s high school report to fake scientific research documents to the infamous Chicago Sun-Times best of summer feature, which included forthcoming novels that don’t exist. ….