Recursive Training Loops in LLMs: How training data properties modulate distribution shift in generated data?

Grgur Kovač, Jérémy Perez, Rémy Portelas +2

Large language models (LLMs) are increasingly used in the creation of online content, creating feedback loops as subsequent generations of models will be trained on this synthetic…