Model alignment using inter-modal bridges

Ali Gholamzadeh, Noor Sajid

Foundation models have demonstrated remarkable performance across modalities such as language and vision. However, model reuse across distinct modalities (e.g., text and vision) re…