CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

Yuhan Wang, Rui Hu, Batian Di +5

Data selection turns large multimodal instruction pools into compact training subsets tailored to a vision-language model's target capabilities. Effective selection requires both u…