CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom

Yisen Li, Lingfeng Yang, Wenxuan Shen +4

Distilling advanced Large Language Models' instruction-following capabilities into smaller models using a selected subset has become a mainstream approach in model training. While…