Understanding Reinforcement Learning for Model Training, and future directions with GRAPE

Rohit Patel

This paper provides a self-contained, from-scratch, exposition of key algorithms for instruction tuning of models: SFT, Rejection Sampling, REINFORCE, Trust Region Policy Optimizat…