Collapse of Self-trained Language Models

David Herel, Tomas Mikolov

In various fields of knowledge creation, including science, new ideas often build on pre-existing information. In this work, we explore this concept within the context of language…