Batch Augmentation with Unimodal Fine-tuning for Multimodal Fusion of Large Language Models

H M Dipu Kabir, Subrota Kumar Mondal, Mohammad Ali Moni

In this paper, we propose batch augmentation with unimodal fine-tuning for multimodal learning. We start with pre-trained unimodal models. We fine-tune the unimodal models with the…