Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization

Mélissa Tamine, Otmane Sakhi, Benjamin Heymann +2

Data valuation is a natural framework for understanding which preference datasets matter most when aligning a Large Language Model (LLM) using multiple sources. The standard game-t…