HARP: Efficient Data Selection for Finetuning Large Language Models

Ning Wang, Zhengxin Zhang, Maosen Tang +3

Finetuning data selection requires balancing two competing goals: selecting examples that improve the downstream objective, and doing so without repeatedly finetuning models. Train…