When Updating Stops Being Learning: Rethinking LLM Self-Evolution via learnable information gain

Chenxu Wang, Chaozhuo Li, Xinze Shi +6

Self-evolution lets large language models (LLMs) improve iteratively using their own generated data, but often suffers from self-evolution degeneration: performance improves, plate…