Sample-Efficient Alignment for LLMs

Zichen Liu, Changyu Chen, Chao Du +2

We study methods for efficiently aligning large language models (LLMs) with human preferences given budgeted online feedback. We first formulate the LLM alignment problem in the fr…