REInstruct: Building Instruction Data from Unlabeled Corpus

Shu Chen, Xinyan Guan, Yaojie Lu +3

Manually annotating instruction data for large language models is difficult, costly, and hard to scale. Meanwhile, current automatic annotation methods typically rely on distilling…