57 citations · 116 across the 15 of their papers we have counts for
15 papers
learning discriminative features from spectrograms using center loss for speech emotion recognition
Dongyang Dai, Zhiyong Wu, Runnan Li +3
Identifying the emotional state from speech is essential for the natural interaction of the machine with the speaker. However, extracting effective features for emotion recognition…
Disambiguation of Chinese Polyphones in an End-to-End Framework with Semantic Features Extracted by Pre-trained BERT
Dongyang Dai, Zhiyong Wu, Shiyin Kang +5
Grapheme-to-phoneme (G2P) conversion serves as an essential component in Chinese Mandarin text-to-speech (TTS) system, where polyphone disambiguation is the core issue. In this pap…
PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback
Yaohua Bu, Tianyi Ma, Weijun Li +12
Second language (L2) English learners often find it difficult to improve their pronunciations due to the lack of expressive and personalized corrective feedback. In this paper, we…
Towards Multi-Scale Style Control for Expressive Speech Synthesis
Xiang Li, Changhe Song, Jingbei Li +3
This paper introduces a multi-scale speech style modeling method for end-to-end expressive speech synthesis. The proposed method employs a multi-scale reference encoder to extract…
ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unit
Zijie Ye, Haozhe Wu, Jia Jia +4
Dance and music are two highly correlated artistic forms. Synthesizing dance motions has attracted much attention recently. Most previous works conduct music-to-dance synthesis via…
Visual-speech Synthesis of Exaggerated Corrective Feedback
Yaohua Bu, Weijun Li, Tianyi Ma +4
To provide more discriminative feedback for the second language (L2) learners to better identify their mispronunciation, we propose a method for exaggerated visual-speech feedback…
Speaker Independent and Multilingual/Mixlingual Speech-Driven Talking Head Generation Using Phonetic Posteriorgrams
Huirong Huang, Zhiyong Wu, Shiyin Kang +9
Generating 3D speech-driven talking head has received more and more attention in recent years. Recent approaches mainly have following limitations: 1) most speaker-independent meth…
Understanding the Teaching Styles by an Attention based Multi-task Cross-media Dimensional modelling
Suping Zhou, Jia Jia, Yufeng Yin +7
Teaching style plays an influential role in helping students to achieve academic success. In this paper, we explore a new problem of effectively understanding teachers' teaching st…
Mining Unfollow Behavior in Large-Scale Online Social Networks via Spatial-Temporal Interaction
Haozhe Wu, Zhiyuan Hu, Jia Jia +3
Online Social Networks (OSNs) evolve through two pervasive behaviors: follow and unfollow, which respectively signify relationship creation and relationship dissolution. Researches…
Improving Generalization of Transformer for Speech Recognition with Parallel Schedule Sampling and Relative Positional Embedding
Pan Zhou, Ruchao Fan, Wei Chen +1
Transformer has shown promising results in many sequence to sequence transformation tasks recently. It utilizes a number of feed-forward self-attention layers to replace the recurr…
Modality Attention for End-to-End Audio-visual Speech Recognition
Pan Zhou, Wenwen Yang, Wei Chen +2
Audio-visual speech recognition (AVSR) system is thought to be one of the most promising solutions for robust speech recognition, especially in noisy environment. In this paper, we…
An Online Attention-based Model for Speech Recognition
Ruchao Fan, Pan Zhou, Wei Chen +2
Attention-based end-to-end models such as Listen, Attend and Spell (LAS), simplify the whole pipeline of traditional automatic speech recognition (ASR) systems and become popular i…
Exploring RNN-Transducer for Chinese Speech Recognition
Senmao Wang, Pan Zhou, Wei Chen +2
End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system. RNN transducer (RNN-T) is o…
Study on Feature Subspace of Archetypal Emotions for Speech Emotion Recognition
Xi Ma, Zhiyong Wu, Jia Jia +3
Feature subspace selection is an important part in speech emotion recognition. Most of the studies are devoted to finding a feature subspace for representing all emotions. However,…
Modeling Emotion Influence from Images in Social Networks
Xiaohui Wang, Jia Jia, Lianhong Cai +1
Images become an important and prevalent way to express users' activities, opinions and emotions. In a social network, individual emotions may be influenced by others, in particula…