Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models

Sumin Hong, Katsumi Ibaraki, Renee Shi +2

Cross-modal associations are systematic pairings of features across modalities, such as the association of 'bouba' with round shapes and 'kiki' with sharp shapes. Prior work has co…