62 citations · 247 across the 32 of their papers we have counts for
9 papers · 1 filter
Structured Prompting and LLM Ensembling for Multimodal Conversational Aspect-based Sentiment Analysis
Zhiqiang Gao, Shihao Gao, Zixing Zhang +3
Understanding sentiment in multimodal conversations is a complex yet crucial challenge toward building emotionally intelligent AI systems. The Multimodal Conversational Aspect-base…
Foundation Model-based Evaluation of Neuropsychiatric Disorders: A Lifespan-Inclusive, Multi-Modal, and Multi-Lingual Study
Zhongren Dong, Haotian Guo, Weixiang Xu +2
Neuropsychiatric disorders, such as Alzheimer's disease (AD), depression, and autism spectrum disorder (ASD), are characterized by linguistic and acoustic abnormalities, offering p…
DEBATE: A Dataset for Disentangling Textual Ambiguity in Mandarin Through Speech
Haotian Guo, Jing Han, Yongfeng Tu +5
Despite extensive research on textual and visual disambiguation, disambiguation through speech (DTS) remains underexplored. This is largely due to the lack of high-quality datasets…
ProsodyFM: Unsupervised Phrasing and Intonation Control for Intelligible Speech Synthesis
Xiangheng He, Junjie Chen, Zixing Zhang +1
Prosody contains rich information beyond the literal meaning of words, which is crucial for the intelligibility of speech. Current models still fall short in phrasing and intonatio…
ESIHGNN: Event-State Interactions Infused Heterogeneous Graph Neural Network for Conversational Emotion Recognition
Xupeng Zha, Huan Zhao, Zixing Zhang
Conversational Emotion Recognition (CER) aims to predict the emotion expressed by an utterance (referred to as an ``event'') during a conversation. Existing graph-based methods mai…
Customising General Large Language Models for Specialised Emotion Recognition Tasks
Liyizhe Peng, Zixing Zhang, Tao Pang +4
The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tas…
Refashioning Emotion Recognition Modelling: The Advent of Generalised Large Models
Zixing Zhang, Liyizhe Peng, Tao Pang +3
After the inception of emotion recognition or affective computing, it has increasingly become an active research topic due to its broad applications. Over the past couple of decade…
Attention-Augmented End-to-End Multi-Task Learning for Emotion Prediction from Speech
Zixing Zhang, Bingwen Wu, Bjoern Schuller
Despite the increasing research interest in end-to-end learning systems for speech emotion recognition, conventional systems either suffer from the overfitting due in part to the l…
Adversarial Training in Affective Computing and Sentiment Analysis: Recent Advances and Perspectives
Jing Han, Zixing Zhang, Nicholas Cummins +1
Over the past few years, adversarial training has become an extremely active research topic and has been successfully applied to various Artificial Intelligence (AI) domains. As a…