PrefixFlow: Training-Time KV Caching for Schedule-Level Prefix Reuse in LLM RL Training

Pengbo Li, Feiyuan Zhang, Guangming Sheng +8

In reinforcement learning (RL) post-training, one prompt fans out into $N$ trajectories, yet standard trainers replay the shared prefix's forward and backward pass $N$ times; in lo…