Structure from Strategic Interaction & Uncertainty: Risk Sensitive Games for Robust Preference Learning

Max Horwitz, Jake Gonzales, Eric Mazumdar +1

A growing line of work reframes preference-based fine-tuning of large language models game-theoretically: Nash Learning from Human Feedback (NLHF) recasts the problem as a zero-sum…