Towards a theory of inference-time alignment with unknown rewards

Steve Hanneke, Hongao Wang, Mingyue Xu

Generative model alignment has received broad interest, and significant progress has been made in supervised fine-tuning and inference-time computation. Yet, alignment has remained…