First-Order In-Context Shapley: Scalable Data Auditing for LLM Alignment and Evaluation

Yunting Song, Matthew Watson, Moustafa Farid Alzantot +2

Post-training alignment of Large Language Models is increasingly bottlenecked by data quality: preference and instruction-tuning corpora accumulate label noise, safety inversions,…