Language Model Alignment with Elastic Reset

Michael Noukhovitch, Samuel Lavoie, Florian Strub +1

Finetuning language models with reinforcement learning (RL), e.g. from human feedback (HF), is a prominent method for alignment. But optimizing against a reward model can improve o…