Nonparallel Voice Conversion with Augmented Classifier Star Generative Adversarial Networks

Abstract

We previously proposed a method that allows for nonparallel voice conversion (VC) by using a variant of generative adversarial networks (GANs) called StarGAN. The main features of our method, called StarGAN-VC, are as follows: First, it requires no parallel utterances, transcriptions, or time alignment procedures for speech generator training. Second, it can simultaneously learn mappings across multiple domains using a single generator network and thus fully exploit available training data collected from multiple domains to capture latent features that are common to all the domains. Third, it can generate converted speech signals quickly enough to allow real-time implementations and requires only several minutes of training examples to generate reasonably realistic-sounding speech. In this paper, we describe three formulations of StarGAN, including a newly introduced novel StarGAN variant called "Augmented classifier StarGAN (A-StarGAN)", and compare them in a nonparallel VC task. We also compare them with several baseline methods.

arXiv commentSubmitted to IEEE/ACM Trans. ASLP. This paper is an extended full-paper version of arXiv:1806.02169

References in corpus (17)

• Auto-Encoding Variational Bayes
• WaveNet: A Generative Model for Raw Audio
• Neural Discrete Representation Learning
• Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
• Autoencoding beyond pixels using a learned similarity metric
• MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis
• SampleRNN: An Unconditional End-to-End Neural Audio Generation Model
• AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
• Parallel-Data-Free Voice Conversion Using Cycle-Consistent Adversarial Networks
• Efficient Neural Audio Synthesis
• The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methods
• ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
• Blow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversion
• Voice Transformer Network: Sequence-to-Sequence Voice Conversion Using Transformer with Text-to-Speech Pretraining
• FloWaveNet : A Generative Flow for Raw Audio
• Many-to-Many Voice Transformer Network
• Generative adversarial network-based approach to signal reconstruction from magnitude spectrograms