Could this be (partially?) explained by Model Collapse [1], i.e. iteratively training on data that includes an ever increasing amount of AI slop?

[1] https://thebullshitmachines.com/lesson-16-the-first-step-fal...