activity
20242026
collaborators

5 papers

cs.CL2026

Word meaning co-determines vowel-inherent spectral change. A corpus-based investigation of conversational Mandarin

Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen

This study investigates vowel-inherent spectral change (VISC) in spontaneous conversational Mandarin. Using the generalized additive model and word embeddings from distributional s…

cs.CL2026

Using embeddings to predict spoken word duration and pitch in Mandarin monosyllabic words

Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen

Time-normalized f0 contours of Mandarin words in conversational speech have been shown to be predictable in part from their contextualized embeddings (CEs). The present study inves…

cs.CV2026

ECHO: Towards Emotionally Appropriate and Contextually Aware Interactive Head Generation

Xiangyu Kong, Xiaoyu Jin, Yihan Pan +6

In natural face-to-face interaction, participants seamlessly alternate between speaking and listening, producing facial behaviors (FBs) that are finely informed by long-range conte…

cs.CL2025

A new kid on the block: Distributional semantics predicts the word-specific tone signatures of monosyllabic words in conversational Taiwan Mandarin

Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen

We present a corpus-based investigation of how the pitch contours of monosyllabic words are realized in spontaneous conversational Mandarin, focusing on the effects of words' meani…

cs.CL2024

A corpus-based investigation of pitch contours of monosyllabic words in conversational Taiwan Mandarin

Xiaoyun Jin, Mirjam Ernestus, R. Harald Baayen

In Mandarin, the tonal contours of monosyllabic words produced in isolation or in careful speech are characterized by four lexical tones: a high-level tone (T1), a rising tone (T2)…