MultiModal Fine-tuning with Synthetic Captions

Shohei Enomoto, Shin'ya Yamaguchi

In this paper, we address a fundamental gap between pre-training and fine-tuning of deep neural networks: while pre-training has shifted from unimodal to multimodal learning with e…