What matters when building vision-language models?

Hugo Laurençon, Léo Tronchon, Matthieu Cord +1

The growing interest in vision-language models (VLMs) has been driven by improvements in large language models and vision transformers. Despite the abundance of literature on this…