Who Should We Listen to More? Welfare-Aware Preference Acquisition for Pluralistic Alignment

Ruomeng Ding, Tianwei Gao, Lianrui Geng +2

Pluralistic alignment needs to accommodate diverse preferences under limited human feedback. Using AI simulators to label preference comparisons reduces annotation costs, but varia…