Beyond the Binary: Capturing Diverse Preferences With Reward Regularization

Vishakh Padmakumar, Chuanyang Jin, Hannah Rose Kirk +1

Large language models (LLMs) are increasingly deployed via public-facing interfaces to interact with millions of users, each with diverse preferences. Despite this, preference tuni…