Predictable GRPO: A Closed-Form Model of Training Dynamics

Rajat Ghosh, Datta Nimmaturi, Aryan Singhal +4

We develop a first-principles reduced-order model of these dynamics. Under a single mean-field assumption that summarizes the policy by its expected reward, we reduce the GRPO upda…