Multi-modal Retrieval Augmented Multi-modal Generation: Datasets, Evaluation Metrics and Strong Baselines

Zi-Ao Ma, Tian Lan, Rong-Cheng Tu +6

We present a systematic investigation of Multi-modal Retrieval Augmented Multi-modal Generation (M${}^2$RAG), a novel task that enables foundation models to process multi-modal web c…