MM-LIMA: Less Is More for Alignment in Multi-Modal Datasets

Lai Wei, Xiaozhe Li, Zihao Jiang +2

Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using supervised vision-language instruction data…