PAFO: Pareto Fairness Optimization for Personalized Reward Modeling

Xiaoyan Zhao, Haoting Ni, Yang Zhang +3

Large language models (LLMs) increasingly rely on reward models to align their outputs with diverse user preferences. While personalized reward models aim to capture such heterogen…