Train Smarter, Not Longer: Memorization-Guided Data Reuse for Efficient LLM Training

Jingwei Zuo, Cong Zeng, Ilyas Chahed +6

The training paradigm of large language models has shifted from traditional one-pass training to multi-epoch training, as reasonable reuse of limited high-quality data can improve…