Thinking Seeds: Restarting On-Policy RL from the Model's Own Past Reasoning States

Lei Yang, Wei Bi, Chenxi Sun +2

On-policy reinforcement learning (RL) for language models trains on the reasoning states visited by the current policy. As training sharpens the policy, some states reached by earl…