Investigating the Impact of Data Selection Strategies on Language Model Performance

Jiayao Gu, Liting Chen, Yihong Li

Data selection is critical for enhancing the performance of language models, particularly when aligning training datasets with a desired target distribution. This study explores th…