SFT-then-RL Outperforms Mixed-Policy Methods for LLM Reasoning

Alexis Limozin, Eduard Durech, Torsten Hoefler +2

Recent mixed-policy optimization methods for LLM reasoning that interleave or blend supervised and reinforcement learning signals report improvements over the standard SFT-then-RL…