1.2k citations · 2.5k across the 57 of their papers we have counts for
57 papers
Long-frame-shift Neural Speech Phase Prediction with Spectral Continuity Enhancement and Interpolation Error Compensation
Yang Ai, Ye-Xin Lu, Zhen-Hua Ling
Speech phase prediction, which is a significant research focus in the field of signal processing, aims to recover speech phase spectra from amplitude-related features. However, exi…
Zero-shot personalized lip-to-speech synthesis with face image based voice control
Zheng-Yan Sheng, Yang Ai, Zhen-Hua Ling
Lip-to-Speech (Lip2Speech) synthesis, which predicts corresponding speech from talking face images, has witnessed significant progress with various models and training strategies i…
Neural Speech Phase Prediction based on Parallel Estimation Architecture and Anti-Wrapping Losses
Yang Ai, Zhen-Hua Ling
This paper presents a novel speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra by neural networks. The proposed model is a cascade o…
Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis
Yukun Peng, Zhenhua Ling
This paper presents a method of decoupled pronunciation and prosody modeling to improve the performance of meta-learning-based multilingual speech synthesis. The baseline meta-lear…
Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models
Lu Dong, Zhi-Qiang Guo, Chao-Hong Tan +3
Neural network models have achieved state-of-the-art performance on grapheme-to-phoneme (G2P) conversion. However, their performance relies on large-scale pronunciation dictionarie…
PoNet: Pooling Network for Efficient Token Mixing in Long Sequences
Chao-Hong Tan, Qian Chen, Wen Wang +3
Transformer-based models have achieved great success in various NLP, vision, and speech tasks. However, the core of Transformer, the self-attention mechanism, has a quadratic time…
MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding
Jia-Chen Gu, Chongyang Tao, Zhen-Hua Ling +3
Recently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification…
Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbots
Jia-Chen Gu, Hui Liu, Zhen-Hua Ling +3
Persona can function as the prior knowledge for maintaining the consistency of dialogue systems. Most of previous studies adopted the self persona in dialogue whose response was ab…
Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation
Yu-Ping Ruan, Zhen-Hua Ling
This paper presents an emotion-regularized conditional variational autoencoder (Emo-CVAE) model for generating emotional conversation responses. In conventional CVAE-based emotiona…
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems
Chao-Hong Tan, Xiaoyu Yang, Zi'ou Zheng +7
Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to genera…
Tracking Interaction States for Multi-Turn Text-to-SQL Semantic Parsing
Run-Ze Wang, Zhen-Hua Ling, Jing-Bo Zhou +1
The task of multi-turn text-to-SQL semantic parsing aims to translate natural language utterances in an interaction into SQL queries in order to answer them using a database which…
Denoising-and-Dereverberation Hierarchical Neural Vocoder for Robust Waveform Generation
Yang Ai, Haoyu Li, Xin Wang +2
This paper presents a denoising and dereverberation hierarchical neural vocoder (DNR-HiNet) to convert noisy and reverberant acoustic features into a clean speech waveform. We impl…
Predictions of Subjective Ratings and Spoofing Assessments of Voice Conversion Challenge 2020 Submissions
Rohan Kumar Das, Tomi Kinnunen, Wen-Chin Huang +5
The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary eval…
Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer
Jing-Xuan Zhang, Li-Juan Liu, Yan-Nian Chen +4
With the development of automatic speech recognition (ASR) and text-to-speech synthesis (TTS) technique, it's intuitive to construct a voice conversion system by cascading an ASR a…
Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion
Yi Zhao, Wen-Chin Huang, Xiaohai Tian +5
The voice conversion challenge is a bi-annual scientific event held to compare and understand different voice conversion (VC) systems built on a common dataset. In 2020, we organiz…
Online Speaker Adaptation for WaveNet-based Neural Vocoders
Qiuchen Huang, Yang Ai, Zhenhua Ling
In this paper, we propose an online speaker adaptation method for WaveNet-based neural vocoders in order to improve their performance on speaker-independent waveform generation. In…
Recognition-Synthesis Based Non-Parallel Voice Conversion with Adversarial Learning
Jing-Xuan Zhang, Zhen-Hua Ling, Li-Rong Dai
This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguisti…
Knowledge-and-Data-Driven Amplitude Spectrum Prediction for Hierarchical Neural Vocoders
Yang Ai, Zhen-Hua Ling
In our previous work, we have proposed a neural vocoder called HiNet which recovers speech waveforms by predicting amplitude and phase spectra hierarchically from input acoustic fe…
Reverberation Modeling for Source-Filter-based Neural Vocoder
Yang Ai, Xin Wang, Junichi Yamagishi +1
This paper presents a reverberation module for source-filter-based neural vocoders that improves the performance of reverberant effect modeling. This module uses the output wavefor…
Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
Jia-Chen Gu, Tianda Li, Quan Liu +3
The NOESIS II challenge, as the Track 2 of the 8th Dialogue System Technology Challenges (DSTC 8), is the extension of DSTC 7. This track incorporates new elements that are vital f…
Filtering before Iteratively Referring for Knowledge-Grounded Response Selection in Retrieval-Based Chatbots
Jia-Chen Gu, Zhen-Hua Ling, Quan Liu +2
The challenges of building knowledge-grounded retrieval-based chatbots lie in how to ground a conversation on its background knowledge and how to match response candidates with bot…
DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement
Tianda Li, Jia-Chen Gu, Xiaodan Zhu +4
Disentanglement is a problem in which multiple conversations occur in the same channel simultaneously, and the listener should decide which utterance is part of the conversation he…
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
Jia-Chen Gu, Tianda Li, Quan Liu +4
In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (S…
An Adaptive X-vector Model for Text-independent Speaker Verification
Bin Gu, Wu Guo, Lirong Dai +1
In this paper, adaptive mechanisms are applied in deep neural network (DNN) training for x-vector-based text-independent speaker verification. First, adaptive convolutional neural…