Alignment Data Map for Efficient Preference Data Selection and Diagnosis

Seohyeong Lee, Eunwon Kim, Hwaran Lee +1

Human preference data is essential for aligning large language models (LLMs) with human values, but collecting such data is often costly and inefficient-motivating the need for eff…