PROMISE: Prompt-Attentive Hierarchical Contrastive Learning for Robust Cross-Modal Representation with Missing Modalities

Jiajun Chen, Sai Cheng, Yutao Yuan +4

Multimodal models integrating natural language and visual information have substantially improved generalization of representation models. However, their effectiveness significantl…