Post-Training at the Edge of Detectability: A Game-Theoretic Approach to Fine-Tuning

Keegan Harris, Brian W. Lee, Ian Waudby-Smith +3

Reinforcement learning (RL) fine-tuning is widely used in language model training to improve performance on a target task while limiting drift from a reference policy. A standard w…