5 papers
A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settings
Debasmita Bhattacharya, Siying Ding, Alayna Nguyen +1
Conversational entrainment is well-studied in monolingual and written contexts, but remains underexplored in spoken code-switching (CSW). We present a cross-lingual analysis of ent…
Mixed Signals: Understanding Model Disagreement in Multimodal Empathy Detection
Maya Srikanth, Run Chen, Julia Hirschberg
Multimodal models play a key role in empathy detection, but their performance can suffer when modalities provide conflicting cues. To understand these failures, we examine cases wh…
SYNTHEMPATHY: A Scalable Empathy Corpus Generated Using LLMs Without Any Crowdsourcing
Run Chen, Jun Shin, Julia Hirschberg
Previous research has shown that humans are more receptive towards language models that that exhibit empathetic behavior. While empathy is essential for developing helpful dialogue…
EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control
Haozhe Chen, Run Chen, Julia Hirschberg
While recent advances in Text-to-Speech (TTS) technology produce natural and expressive speech, they lack the option for users to select emotion and control intensity. We propose E…
Measuring Entrainment in Spontaneous Code-switched Speech
Debasmita Bhattacharya, Siying Ding, Alayna Nguyen +1
It is well-known that speakers who entrain to one another have more successful conversations than those who do not. Previous research has shown that interlocutors entrain on lingui…