From Normative Frameworks to Alignment Data: Constructing and Evaluating SFT and Preference Data

Husrev Taha Sencar, Rezart Beka, Danish Naeem +6

Aligning language models with a specified normative framework requires translating abstract principles into concrete examples and preference signals from which models can learn. We…