Groupwise Distortion Guarantees for Preference-Based Alignment

Jacob Brodkey, Roberto Tamez, Aaron Roth

Preference-based alignment methods such as reinforcement learning from human feedback (RLHF) and Nash learning from human feedback (NLHF) aggregate pairwise preferences to learn an…