Pick the Mixture, Not the Samples: Combinatorial Data Selection for LLMs

Luyang Zhang, Jialu Wang, Bebei Li

Data selection for LLM fine-tuning faces two facts about real training: data pools draw from many distinct domains, and evaluation spans diverse tasks. As a result, the same sample…