Chasing Random: Instruction Selection Strategies Fail to Generalize

Harshita Diddee, Daphne Ippolito

Prior work has shown that language models can be tuned to follow user instructions using only a small set of high-quality instructions. This has accelerated the development of meth…