Variance-Optimal State Resampling for Reinforcement Learning with Verifiable Rewards

Yibo Wang, Yuanxin Liu, Zhaoran Wang

Reinforcement learning with verifiable rewards spends much of its rollout budget on states that yield no learning signal. We recast this as a question about the sampling distributi…