REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline Reinforcement Learning

Yunjie Chen, Zihao Chen, Xiaoxin Chen +1

Large-scale online reinforcement learning (RL) is the predominant means of eliciting advanced abilities including long-term reasoning and agentic tool use in large language models…