17 papers
Speaker Role and Language Diarization for Analyzing Multilingual Interviews for Language Proficiency of Older Adults
Anfeng Xu, Tiantian Feng, Kevin Huang +8
Automatic language proficiency assessment in the context of multilingual interview-based settings remains underexplored. In this work, we develop Whisper-based speaker-role and lan…
Speech Entrainment in Multi-Party Conversations with a Digital Agent
Nicholas Mehlman, Kaitlin Zareno, Kleanthis Avramidis +2
It has been widely observed that individuals engaged in conversation tend to adapt their speaking style to more closely match the other interlocutors. However, most prior work has…
ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood
Tiantian Feng, Anfeng Xu, Xuan Shi +10
We present ChildVox, a novel benchmark for characterizing the diverse acoustic signals through which children communicate. Specifically, ChildVox follows the full developmental tra…
Exploring Speech Foundation Models for Speaker Diarization Across Lifespan
Anfeng Xu, Tiantian Feng, Shrikanth Narayanan
Speech foundation models have shown strong transferability across a wide range of speech applications. However, their robustness to age-related domain shift in speaker diarization…
VoxCare: Studying Natural Communication Behaviors of Hospital Caregivers through Wearable Sensing of Egocentric Audio
Tiantian Feng, Kleanthis Avramidis, Anfeng Xu +3
Healthcare professionals work in complex, high-stakes environments where effective communication is critical for care delivery, team coordination, and individual well-being. Howeve…
Conversational Speech Naturalness Predictor
Anfeng Xu, Yashesh Gaur, Naoyuki Kanda +6
Evaluation of conversational naturalness is essential for developing human-like speech agents. However, existing speech naturalness predictors are often designed to assess utteranc…