Query-based Submodular Data Selection for Efficient Instruction Tuning

Zhenghao Zhao, Yasutomo Kawanishi, Huihuo Zheng +2

As large language models are fine-tuned for increasingly specialized tasks, their performance depends more on which training examples are selected than on how many. Given a large h…