3 papers
cs.LG2022
Is Cross-Attention Preferable to Self-Attention for Multi-Modal Emotion Recognition?
Vandana Rajan, Alessio Brutti, Andrea Cavallaro
Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality…
eess.IV2021
Cross-Modal Knowledge Transfer via Inter-Modal Translation and Alignment for Affect Recognition
Vandana Rajan, Alessio Brutti, Andrea Cavallaro
Multi-modal affect recognition models leverage complementary information in different modalities to outperform their uni-modal counterparts. However, due to the unavailability of m…
cs.LG2020
Robust Latent Representations via Cross-Modal Translation and Alignment
Vandana Rajan, Alessio Brutti, Andrea Cavallaro
Multi-modal learning relates information across observation modalities of the same physical phenomenon to leverage complementary information. Most multi-modal machine learning meth…