Robust Nash Alignment under Preference Uncertainty

Shihab Ahmed, Debamita Ghosh, David Tang +3

Preference-based alignment methods typically optimize against a single preference model, and can therefore be brittle when pairwise preferences are uncertain: noisy, heterogeneous,…