4 papers
Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillation
Jing-Xuan Zhang, Genshun Wan, Zhen-Hua Ling +3
In this work, we present a novel method, named AV2vec, for learning audio-visual speech representations by multimodal self-distillation. AV2vec has a student and a teacher module,…
Speaker Adaption with Intuitive Prosodic Features for Statistical Parametric Speech Synthesis
Pengyu Cheng, Zhenhua Ling
In this paper, we propose a method of speaker adaption with intuitive prosodic features for statistical parametric speech synthesis. The intuitive prosodic features employed in thi…
Cognitive Diagnosis with Explicit Student Vector Estimation and Unsupervised Question Matrix Learning
Lu Dong, Zhenhua Ling, Qiang Ling +1
Cognitive diagnosis is an essential task in many educational applications. Many solutions have been designed in the literature. The deterministic input, noisy "and" gate (DINA) mod…
Using multiple reference audios and style embedding constraints for speech synthesis
Cheng Gong, Longbiao Wang, Zhenhua Ling +2
The end-to-end speech synthesis model can directly take an utterance as reference audio, and generate speech from the text with prosody and speaker characteristics similar to the r…