Extreme Region Policy Distillation

Changyu Chen, Xiting Wang, Rui Yan

Reinforcement learning for large language models faces a fundamental trade-off between sample efficiency and asymptotic performance: strictly on-policy methods discard trajectories…