7 papers
MultiGen: Child-Friendly Multilingual Speech Generator with LLMs
Xiaoxue Gao, Huayun Zhang, Nancy F. Chen
Generative speech models have demonstrated significant potential in improving human-machine interactions, offering valuable real-world applications such as language learning for ch…
Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotions
Xiaoxue Gao, Huayun Zhang, Nancy F. Chen
Existing expressive text-to-speech (TTS) systems primarily model a limited set of categorical emotions, whereas human conversations extend far beyond these predefined emotions, mak…
SingaKids: A Multilingual Multimodal Dialogic Tutor for Language Learning
Zhengyuan Liu, Geyu Lin, Hui Li Tan +8
The integration of generative artificial intelligence into educational applications has enhanced personalized and interactive learning experiences, and it shows strong potential to…
Semi-supervised Learning For Robust Speech Evaluation
Huayun Zhang, Jeremy H. M. Wong, Geyu Lin +1
Speech evaluation measures a learners oral proficiency using automatic models. Corpora for training such models often pose sparsity challenges given that there often is limited sco…
Emo-DPO: Controllable Emotional Speech Synthesis through Direct Preference Optimization
Xiaoxue Gao, Chen Zhang, Yiming Chen +2
Current emotional text-to-speech (TTS) models predominantly conduct supervised training to learn the conversion from text and desired emotion to its emotional speech, focusing on a…
PRESENT: Zero-Shot Text-to-Prosody Control
Perry Lam, Huayun Zhang, Nancy F. Chen +2
Current strategies for achieving fine-grained prosody control in speech synthesis entail extracting additional style embeddings or adopting more complex architectures. To enable ze…