Accelerating Long-Tail Generation in Synchronous RLHF Training via Adaptive Tensor Parallelism

Long Zhao, Qinghe Wang, Jiaan Zhu +5

Reinforcement Learning from Human Feedback (RLHF) has become a key post-training paradigm for improving model quality. However, the synchronous three-stage RLHF pipeline is often b…