Unified Multimodal Models as Auto-Encoders

Zhiyuan Yan, Kaiqing Lin, Zongjian Li +10

Image-to-text (I2T) understanding and text-to-image (T2I) generation are two fundamental, important yet traditionally isolated multimodal tasks. Despite their intrinsic connection,…