Multi-Speaker End-to-End Speech Synthesis

Abstract

In this work, we extend ClariNet (Ping et al., 2019), a fully end-to-end speech synthesis model (i.e., text-to-wave), to generate high-fidelity speech from multiple speakers. To model the unique characteristic of different voices, low dimensional trainable speaker embeddings are shared across each component of ClariNet and trained together with the rest of the model. We demonstrate that the multi-speaker ClariNet outperforms state-of-the-art systems in terms of naturalness, because the whole model is jointly optimized in an end-to-end manner.

Cited by in corpus (9)

• Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddings
• Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length Embedding
• Hi-Fi Multi-Speaker English TTS Dataset
• From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback Constraint
• Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?
• Unsupervised Learning For Sequence-to-sequence Text-to-speech For Low-resource Languages
• Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation
• Pretraining Strategies, Waveform Model Choice, and Acoustic Configurations for Multi-Speaker End-to-End Speech Synthesis
• Combining speakers of multiple languages to improve quality of neural voices