3 papers
cs.LG2026
When Do Larger Batches Help Scale LLM Reinforcement Learning?
Ziniu Li, Jinbo Wang, Guanhua Huang +3
Larger batches reduce the variance of stochastic gradients per update and are therefore often expected to accelerate training. Yet whether this statistical benefit translates into…
cs.DC2026
PrefixFlow: Training-Time KV Caching for Schedule-Level Prefix Reuse in LLM RL Training
Pengbo Li, Feiyuan Zhang, Guangming Sheng +8
In reinforcement learning (RL) post-training, one prompt fans out into trajectories, yet standard trainers replay the shared prefix's forward and backward pass times; in lo…
cs.LG2025
Unlocking Full Efficiency of Token Filtering in Large Language Model Training
Di Chai, Pengbo Li, Feiyuan Zhang +7
Token filtering has been proposed to enhance the utility of large language models (LLMs) by eliminating inconsequential tokens during training. While usingfewer tokens is expected…