Model Collapse as Cultural Evolution

Dongxin Guo, Jikun Wu, Siu Ming Yiu

Model collapse, the progressive degradation of LLMs trained on their own outputs, has been characterized statistically but lacks a linguistic explanation for which structures degra…