ReAPO: Retry-Aware Policy Optimization for Efficient Exploration in LLM Reasoning

Nghi Dao, Calder Morton-Ferguson, Noah Golowich +1

RLVR improves language-model reasoning, but commonly relies on independent stochastic rollouts for exploration, which can repeatedly sample similar failed strategies. Prior work ha…