Learning from "Silly" Questions Improves Large Language Models, But Only Slightly

Tingyuan Zhu, Shudong Liu, Yidong Wang +4

Constructing high-quality Supervised Fine-Tuning (SFT) datasets is critical for the training of large language models (LLMs). Recent studies have shown that using data from a speci…