4 papers
Word meaning co-determines vowel-inherent spectral change. A corpus-based investigation of conversational Mandarin
Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen
This study investigates vowel-inherent spectral change (VISC) in spontaneous conversational Mandarin. Using the generalized additive model and word embeddings from distributional s…
Using embeddings to predict spoken word duration and pitch in Mandarin monosyllabic words
Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen
Time-normalized f0 contours of Mandarin words in conversational speech have been shown to be predictable in part from their contextualized embeddings (CEs). The present study inves…
ECHO: Towards Emotionally Appropriate and Contextually Aware Interactive Head Generation
Xiangyu Kong, Xiaoyu Jin, Yihan Pan +6
In natural face-to-face interaction, participants seamlessly alternate between speaking and listening, producing facial behaviors (FBs) that are finely informed by long-range conte…
A new kid on the block: Distributional semantics predicts the word-specific tone signatures of monosyllabic words in conversational Taiwan Mandarin
Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen
We present a corpus-based investigation of how the pitch contours of monosyllabic words are realized in spontaneous conversational Mandarin, focusing on the effects of words' meani…