When Do Larger Batches Help Scale LLM Reinforcement Learning?

Ziniu Li, Jinbo Wang, Guanhua Huang +3

Larger batches reduce the variance of stochastic gradients per update and are therefore often expected to accelerate training. Yet whether this statistical benefit translates into…