Fair-PP: A Synthetic Dataset for Aligning LLM with Personalized Preferences of Social Equity

Qi Zhou, Jie Zhang, Dongxia Wang +5

Human preference plays a crucial role in the refinement of large language models (LLMs). However, collecting human preference feedback is costly and most existing datasets neglect…