MoDS: Model-oriented Data Selection for Instruction Tuning

Qianlong Du, Chengqing Zong, Jiajun Zhang

Instruction tuning has become the de facto method to equip large language models (LLMs) with the ability of following user instructions. Usually, hundreds of thousands or millions…