Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models

Vijeta Deshpande, Debasmita Ghose, John D. Patterson +2

Diverse language model responses are crucial for creative generation, open-ended tasks, and self-improvement training. We show that common diversity metrics, and even reward models…