Decoupling Exploration from Optimization in RLVR

Saif Punjwani, Micah Goldblum

Modern language models undergo reinforcement learning with verifiable rewards (RLVR) on top of already-trained checkpoints. A key promise of RLVR is the discovery of new reasoning…