Emotion Across Speech and Faces: Shared Affective Mechanisms in Multimodal Foundation Models

Xiutian Zhao, Luqi Sun, Björn Schuller +1

Modern multimodal foundation models (MFMs) have made rapid progress on tasks requiring integrated perception across speech, vision, and language, including emotion recognition. How…