149 citations · 220 across the 52 of their papers we have counts for
61 papers
Learning from imperfect teachers for low-resource acoustic generalization
Shuanglin Li, Ruxiao Qian, Jian Liu +3
Knowledge distillation (KD) improves low-resource acoustic learning by enriching one-hot supervision with the softened predictive distribution of a fixed teacher network. However,…
Conversational Human Audio-visual Talking Dialogue Generation
Junhao Song, Lluis Guasch, Xilin He +8
Large-scale dyadic interactive audio-visual dialogue (DIAD) datasets provide fundamental data resources for developing humanoid interactive virtual agents and digital humans. Howev…
REACT 2026: The Fourth Multiple Appropriate Facial Reaction Generation Challenge: Personalised MAFRG and Appropriate EEG Reaction Prediction
Siyang Song, Micol Spitale, Zijian Wu +11
In dyadic interactions, various human facial reactions could be appropriate for responding to each human speaker behaviour. Following the successful organisation of the REACT 2023,…
Geometric Second-Order Feature Correlation Learning for Self-Supervised Speech Emotion Recognition
Shuanglin Li, Ruxiao Qian, Siyang Song
Self-supervised learning (SSL) yields powerful, context-rich representations for speech emotion recognition (SER), yet aggregating these representations into holistic descriptors r…
MECO: A Multimodal Dataset for Emotion and Cognitive Understanding in Older Adults
Hongbin Chen, Jie Li, Wei Wang +4
While affective computing has advanced considerably, multimodal emotion prediction in aging populations remains underexplored, largely due to the scarcity of dedicated datasets. Ex…
Beyond Preset Identities: Selective Stance Accommodation and Interaction Reorganisation in Generative Agent Societies
Hanzhong Zhang, Siyang Song, Lu Liu +1
Generative agent societies simulate people with assigned roles, preferences and relationships. As agents exchange arguments and choose partners, they can revise their positions and…
CogPic: A Multimodal Dataset for Early Cognitive Impairment Assessment via Picture Description Tasks
Liuyu Wu, Rui Feng, Jie Li +7
The automated evaluation of cognitive status using multimedia technologies offers a promising avenue for early dementia detection. However, the development of robust machine learni…
ECHO: Towards Emotionally Appropriate and Contextually Aware Interactive Head Generation
Xiangyu Kong, Xiaoyu Jin, Yihan Pan +6
In natural face-to-face interaction, participants seamlessly alternate between speaking and listening, producing facial behaviors (FBs) that are finely informed by long-range conte…
PureCC: Pure Learning for Text-to-Image Concept Customization
Zhichao Liao, Xiaole Xian, Qingyu Li +7
Existing concept customization methods have achieved remarkable outcomes in high-fidelity and multi-concept customization. However, they often neglect the influence on the original…
MAUGen: A Unified Diffusion Approach for Multi-Identity Facial Expression and AU Label Generation
Xiangdong Li, Ye Lou, Ao Gao +2
The lack of large-scale, demographically diverse face images with precise Action Unit (AU) occurrence and intensity annotations has long been recognized as a fundamental bottleneck…
Beyond Segmentation: An Oil Spill Change Detection Framework Using Synthetic SAR Imagery
Chenyang Lai, Shuaiyu Chen, Tianjin Huang +4
Marine oil spills are urgent environmental hazards that demand rapid and reliable detection to minimise ecological and economic damage. While Synthetic Aperture Radar (SAR) imagery…
FairMT: Fairness for Heterogeneous Multi-Task Learning
Guanyu Hu, Tangzheng Lian, Na Yan +5
Fairness in machine learning has been extensively studied in single-task settings, while fair multi-task learning (MTL), especially with heterogeneous tasks (classification, detect…
Enhancing Adversarial Transferability by Balancing Exploration and Exploitation with Gradient-Guided Sampling
Zenghao Niu, Weicheng Xie, Siyang Song +3
Adversarial attacks present a critical challenge to deep neural networks' robustness, particularly in transfer scenarios across different model architectures. However, the transfer…
ReactDiff: Fundamental Multiple Appropriate Facial Reaction Diffusion Model
Luo Cheng, Song Siyang, Yan Siyuan +2
The automatic generation of diverse and human-like facial reactions in dyadic dialogue remains a critical challenge for human-computer interaction systems. Existing methods fail to…
D^3-Talker: Dual-Branch Decoupled Deformation Fields for Few-Shot 3D Talking Head Synthesis
Yuhang Guo, Kaijun Deng, Siyang Song +3
A key challenge in 3D talking head synthesis lies in the reliance on a long-duration talking head video to train a new model for each target identity from scratch. Recent methods h…
Learning Personalised Human Internal Cognition from External Expressive Behaviours for Real Personality Recognition
Xiangyu Kong, Hengde Zhu, Haoqin Sun +6
Automatic real personality recognition (RPR) aims to evaluate human real personality traits from their expressive behaviours. However, most existing solutions generally act as exte…
Automatic Depression Assessment using Machine Learning: A Comprehensive Survey
Siyang Song, Yupeng Huo, Shiqing Tang +4
Depression is a common mental illness across current human society. Traditional depression assessment relying on inventories and interviews with psychologists frequently suffer fro…
The First MPDD Challenge: Multimodal Personality-aware Depression Detection
Changzeng Fu, Zelin Fu, Qi Zhang +14
Depression is a widespread mental health issue affecting diverse age groups, with notable prevalence among college students and the elderly. However, existing datasets and detectio…
REACT 2025: the Third Multiple Appropriate Facial Reaction Generation Challenge
Siyang Song, Micol Spitale, Xiangyu Kong +12
In dyadic interactions, a broad spectrum of human facial reactions might be appropriate for responding to each human speaker behaviour. Following the successful organisation of the…
Oral Imaging for Malocclusion Issues Assessments: OMNI Dataset, Deep Learning Baselines and Benchmarking
Pujun Xue, Junyi Ge, Xiaotong Jiang +8
Malocclusion is a major challenge in orthodontics, and its complex presentation and diverse clinical manifestations make accurate localization and diagnosis particularly important.…
OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactions
Cheng Luo, Jianghui Wang, Bing Li +2
In this paper, we introduce Online Multimodal Conversational Response Generation (OMCRG), a novel task designed to produce synchronized verbal and non-verbal listener feedback onli…
A Frequency-aware Augmentation Network for Mental Disorders Assessment from Audio
Shuanglin Li, Siyang Song, Rajesh Nair +1
Depression and Attention Deficit Hyperactivity Disorder (ADHD) stand out as the common mental health challenges today. In affective computing, speech signals serve as effective bio…
CD-Lamba: Boosting Remote Sensing Change Detection via a Cross-Temporal Locally Adaptive State Space Model
Zhenkai Wu, Xiaowen Ma, Rongrong Lian +4
Mamba, with its advantages of global perception and linear complexity, has been widely applied to identify changes of the target regions within the remote sensing (RS) images captu…
A Novel Scene Coupling Semantic Mask Network for Remote Sensing Image Segmentation
Xiaowen Ma, Rongrong Lian, Zhenkai Wu +8
As a common method in the field of computer vision, spatial attention mechanism has been widely used in semantic segmentation of remote sensing images due to its outstanding long-r…