A Descriptive and Normative Theory of Human Beliefs in RLHF

Sylee Dandekar, Shripad Deshmukh, Frank Chiu +2

Human preferences in RLHF are typically modeled as a function of the human's reward function or corresponding optimal state-action values. In this work, we propose that human belie…