Splitting Prompt Prefill from Response Replay for Context-Parallel Long-Context LLM Post-Training

Yubing Bao, Zhihui Lu, Qiang Duan +3

Training long-context LLM policies with RL requires re-evaluating groups of sampled responses under the updated policy, an update-stage attention workload that differs sharply from…