EliteReplay: Preserving Diverse Solutions in RL Post-Training via Quality-Diversity Search

Hanane Nour Moussa, Doeun Lee, Sachin Kumar

Reinforcement learning has become a common post-training technique to improve the accuracy of LLMs on verifiable tasks. However, such training can narrow the set of solutions the m…