Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization

Mélissa Tamine, Otmane Sakhi, Benjamin Heymann +2

Data valuation is a natural framework for understanding which data sources matter most when aligning a Large Language Model (LLM) from multiple sources. The standard game-theoretic…