7 citations · 7 across the 3 of their papers we have counts for
4 papers
MoD-DPO: Towards Mitigating Cross-modal Hallucinations in Omni LLMs using Modality Decoupled Preference Optimization
Ashutosh Chaubey, Jiacheng Pang, Mohammad Soleymani
Omni-modal large language models (omni LLMs) have recently achieved strong performance across audiovisual understanding tasks, yet they remain highly susceptible to cross-modal hal…
Discrete Facial Encoding: : A Framework for Data-driven Facial Display Discovery
Minh Tran, Maksim Siniukov, Zhangyu Jin +1
Facial expression analysis is central to understanding human behavior, yet existing coding systems such as the Facial Action Coding System (FACS) are constrained by limited coverag…
Social-MAE: A Transformer-Based Multimodal Autoencoder for Face and Voice
Hugo Bohy, Minh Tran, Kevin El Haddad +2
Human social behaviors are inherently multimodal necessitating the development of powerful audiovisual models for their perception. In this paper, we present Social-MAE, our pre-tr…
Investigating the Generalizability of Physiological Characteristics of Anxiety
Emily Zhou, Mohammad Soleymani, Maja J. Matarić
Recent works have demonstrated the effectiveness of machine learning (ML) techniques in detecting anxiety and stress using physiological signals, but it is unclear whether ML model…