105 citations · 715 across the 41 of their papers we have counts for
6 papers · 1 filter
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention
Hang Chen, Jun Du, Yu Hu +3
In this paper, we propose a novel deep learning architecture to improving word-level lip-reading. On the one hand, we first introduce the multi-scale processing into the spatial fe…
Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement
Hang Chen, Jun Du, Yu Hu +3
In this paper, we propose a visual embedding approach to improving embedding aware speech enhancement (EASE) by synchronizing visual lip frames at the phone and place of articulati…
Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer
Jing-Xuan Zhang, Li-Juan Liu, Yan-Nian Chen +4
With the development of automatic speech recognition (ASR) and text-to-speech synthesis (TTS) technique, it's intuitive to construct a voice conversion system by cascading an ASR a…
Attentive Fusion Enhanced Audio-Visual Encoding for Transformer Based Robust Speech Recognition
Liangfa Wei, Jie Zhang, Junfeng Hou +1
Audio-visual information fusion enables a performance improvement in speech recognition performed in complex acoustic scenarios, e.g., noisy environments. It is required to explore…
Recognition-Synthesis Based Non-Parallel Voice Conversion with Adversarial Learning
Jing-Xuan Zhang, Zhen-Hua Ling, Li-Rong Dai
This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguisti…
Attentive batch normalization for lstm-based acoustic modeling of speech recognition
Fenglin Ding, Wu Guo, Lirong Dai +1
Batch normalization (BN) is an effective method to accelerate model training and improve the generalization performance of neural networks. In this paper, we propose an improved ba…