7 papers
What Makes Synthetic Speech Sound Sarcastic? A Prosody-Controlled Perception Study
Zhu Li, Shekhar Nayak, Matt Coler
Prosody plays an important role in sarcasm perception, yet previous studies have relied on naturally produced speech that lacks fine-grained control over individual acoustic dimens…
Modeling Sarcastic Speech: Semantic and Prosodic Cues in a Speech Synthesis Framework
Zhu Li, Yuqing Zhang, Xiyuan Gao +2
Sarcasm is a pragmatic phenomenon in which speakers convey meanings that diverge from literal content, relying on an interaction between semantics and prosodic expression. However,…
Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detection
Zhu Li, Yuqing Zhang, Xiyuan Gao +2
Sarcasm fundamentally alters meaning through tone and context, yet detecting it in speech remains a challenge due to data scarcity. In addition, existing detection systems often re…
SarcasmMiner: A Dual-Track Post-Training Framework for Robust Audio-Visual Sarcasm Reasoning
Zhu Li, Yongjian Chen, Huiyuan Lai +3
Multimodal sarcasm detection requires resolving pragmatic incongruity across textual, acoustic, and visual cues through cross-modal reasoning. To enable robust sarcasm reasoning wi…
Evaluating Multimodal Large Language Models on Spoken Sarcasm Understanding
Zhu Li, Xiyuan Gao, Yuqing Zhang +2
Sarcasm detection remains a challenge in natural language understanding, as sarcastic intent often relies on subtle cross-modal cues spanning text, speech, and vision. While prior…
Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis
Zhu Li, Yuqing Zhang, Xiyuan Gao +4
Sarcastic speech synthesis, which involves generating speech that effectively conveys sarcasm, is essential for enhancing natural interactions in applications such as entertainment…