Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning

Ming Li, Pei Chen, Chenguang Wang +5

Finetuning large language models with a variety of instruction-response pairs has enhanced their capability to understand and follow instructions. Current instruction tuning primar…