Let the Batch Decide, On- or Off-Policy: Effective Sample Size for RL Post-Training

Rasool Fakoor, Murdock Aubry, Nicholas Stranges +1

Reinforcement learning (RL) is structurally harder than supervised learning because the policy changes the data distribution it learns from. The resulting fragility is especially v…