10 citations · 28 across the 11 of their papers we have counts for
14 papers
ATTEST: Evidence-Grounded Reinforcement Learning for Long-Audio Temporal Understanding
Ashutosh Chaubey, Jinxi Guo, Minh Tran +2
Temporal grounding is fundamental to audio understanding, yet large audio language models (LALMs) remain weak at it on long audio, where hallucinations compound and annotated data…
Identity-Consistent Expression Fields: A Disentangled Neural Radiance Field Framework for Few-Shot Facial Expression Synthesis
Minh Tran
Neural Radiance Fields (NeRF) have enabled photorealistic novel-view synthesis of 3D scenes and, in the facial domain, have been extended to reconstruct and animate 3D face models…
Discrete Facial Encoding: : A Framework for Data-driven Facial Display Discovery
Minh Tran, Maksim Siniukov, Zhangyu Jin +1
Facial expression analysis is central to understanding human behavior, yet existing coding systems such as the Facial Action Coding System (FACS) are constrained by limited coverag…
Social-MAE: A Transformer-Based Multimodal Autoencoder for Face and Voice
Hugo Bohy, Minh Tran, Kevin El Haddad +2
Human social behaviors are inherently multimodal necessitating the development of powerful audiovisual models for their perception. In this paper, we present Social-MAE, our pre-tr…
DiTaiListener: Controllable High Fidelity Listener Video Generation with Diffusion
Maksim Siniukov, Di Chang, Minh Tran +3
Generating naturalistic and nuanced listener motions for extended interactions remains an open problem. Existing methods often rely on low-dimensional motion codes for facial behav…
Dyadic Interaction Modeling for Social Behavior Generation
Minh Tran, Di Chang, Maksim Siniukov +1
Human-human communication is like a delicate dance where listeners and speakers concurrently interact to maintain conversational dynamics. Hence, an effective model for generating…
Privacy-preserving Representation Learning for Speech Understanding
Minh Tran, Mohammad Soleymani
Existing privacy-preserving speech representation learning methods target a single application domain. In this paper, we present a novel framework to anonymize utterance-level spee…
Personalized Adaptation with Pre-trained Speech Encoders for Continuous Emotion Recognition
Minh Tran, Yufeng Yin, Mohammad Soleymani
There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performan…
LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis
Di Chang, Yufeng Yin, Zongjian Li +2
Facial expression analysis is an important tool for human-computer interaction. In this paper, we introduce LibreFace, an open-source toolkit for facial expression analysis. This o…
Representation Learning for Audio Privacy Preservation using Source Separation and Robust Adversarial Learning
Diep Luong, Minh Tran, Shayan Gharib +2
Privacy preservation has long been a concern in smart acoustic monitoring systems, where speech can be passively recorded along with a target signal in the system's operating envir…
Adversarial Representation Learning for Robust Privacy Preservation in Audio
Shayan Gharib, Minh Tran, Diep Luong +2
Sound event detection systems are widely used in various applications such as surveillance and environmental monitoring where data is automatically collected, processed, and sent t…
Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild
Yufeng Yin, Minh Tran, Di Chang +2
Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip…
A Speech Representation Anonymization Framework via Selective Noise Perturbation
Minh Tran, Mohammad Soleymani
Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existin…
A Pre-trained Audio-Visual Transformer for Emotion Recognition
Minh Tran, Mohammad Soleymani
In this paper, we introduce a pretrained audio-visual Transformer trained on more than 500k utterances from nearly 4000 celebrities from the VoxCeleb2 dataset for human behavior un…