Uncertainty Quantification for Large Language Model Reward Learning under Heterogeneous Human Feedback

Pangpang Liu, Junwei Lu, Will Wei Sun

We study estimation and statistical inference for reward models used in aligning large language models (LLMs). A key component of LLM alignment is reinforcement learning from human…