Learning with a Single Rollout via Monte Carlo Pass@k Critic

Fengdi Che, Yang Liu, Lei Yu +4

Estimating token-level advantages in reinforcement learning (RL) for language models remains challenging because scaling up episodic experience collection is expensive. The difficu…