RLHFSpec: Breaking the Efficiency Bottleneck in RLHF Training via Adaptive Drafting

Siqi Wang, Hailong Yang, Junjie Zhu +3

Reinforcement Learning from Human Feedback (RLHF) is an important fine-tuning technique for large language models (LLMs) and comprises three stages: generation, inference, and trai…