79 citations · 189 across the 15 of their papers we have counts for
16 papers
Robust Continuous Human Activity Recognition Using Deep Learning and Distributed Radar Sensors
Sohani Munteha Hiam, Mohammad Soleymani
Continuous human activity recognition (HAR) with distributed radar sensor networks is challenging because Doppler signatures depend strongly on aspect angle, the informativeness of…
Personalized Adaptation with Pre-trained Speech Encoders for Continuous Emotion Recognition
Minh Tran, Yufeng Yin, Mohammad Soleymani
There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performan…
LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis
Di Chang, Yufeng Yin, Zongjian Li +2
Facial expression analysis is an important tool for human-computer interaction. In this paper, we introduce LibreFace, an open-source toolkit for facial expression analysis. This o…
FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Features
Yufeng Yin, Di Chang, Guoxian Song +5
Automatic detection of facial Action Units (AUs) allows for objective facial expression analysis. Due to the high cost of AU labeling and the limited size of existing benchmarks, p…
Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild
Yufeng Yin, Minh Tran, Di Chang +2
Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip…
A Speech Representation Anonymization Framework via Selective Noise Perturbation
Minh Tran, Mohammad Soleymani
Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existin…
A Pre-trained Audio-Visual Transformer for Emotion Recognition
Minh Tran, Mohammad Soleymani
In this paper, we introduce a pretrained audio-visual Transformer trained on more than 500k utterances from nearly 4000 celebrities from the VoxCeleb2 dataset for human behavior un…
Speaker Turn Modeling for Dialogue Act Classification
Zihao He, Leili Tavabi, Kristina Lerman +1
Dialogue Act (DA) classification is the task of classifying utterances with respect to the function they serve in a dialogue. Existing approaches to DA classification model utteran…
Modeling Dynamics of Facial Behavior for Mental Health Assessment
Minh Tran, Ellen Bradley, Michelle Matvey +2
Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In…
Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Survey
Sicheng Zhao, Shangfei Wang, Mohammad Soleymani +2
The wide popularity of digital photography and social networks has generated a rapidly growing volume of multimedia data (i.e., image, music, and video), resulting in a great deman…
Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval
Yale Song, Mohammad Soleymani
Visual-semantic embedding aims to find a shared latent space where related visual and textual instances are close to each other. Most current methods learn injective embedding func…
AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognition
Fabien Ringeval, Björn Schuller, Michel Valstar +14
The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mind, Detecting Depression with AI, and Cross-cultural Affect Recognition" is the ninth competition event aime…
A data-driven approach to mid-level perceptual musical feature modeling
Anna Aljanaki, Mohammad Soleymani
Musical features and descriptors could be coarsely divided into three levels of complexity. The bottom level contains the basic building blocks of music, e.g., chords, beats and ti…
Cross-Modal Retrieval with Implicit Concept Association
Yale Song, Mohammad Soleymani
Traditional cross-modal retrieval assumes explicit association of concepts across modalities, where there is no ambiguity in how the concepts are linked to each other, e.g., when w…
Detecting Cognitive Appraisals from Facial Expressions for Interest Recognition
Mohammad Soleymani
Interest makes one hold her attention on the object of interest. Automatic recognition of interest has numerous applications in human-computer interaction. In this paper, we study…
Corpus Development for Affective Video Indexing
Mohammad Soleymani, Martha Larson, Thierry Pun +1
Affective video indexing is the area of research that develops techniques to automatically generate descriptions of video content that encode the emotional reactions which the vide…