WaveCycleGAN2: Time-domain Neural Post-filter for Speech Waveform Generation

Abstract

WaveCycleGAN has recently been proposed to bridge the gap between natural and synthesized speech waveforms in statistical parametric speech synthesis and provides fast inference with a moving average model rather than an autoregressive model and high-quality speech synthesis with the adversarial training. However, the human ear can still distinguish the processed speech waveforms from natural ones. One possible cause of this distinguishability is the aliasing observed in the processed speech waveform via down/up-sampling modules. To solve the aliasing and provide higher quality speech synthesis, we propose WaveCycleGAN2, which 1) uses generators without down/up-sampling modules and 2) combines discriminators of the waveform domain and acoustic parameter domain. The results show that the proposed method 1) alleviates the aliasing well, 2) is useful for both speech waveforms generated by analysis-and-synthesis and statistical parametric speech synthesis, and 3) achieves a mean opinion score comparable to those of natural speech and speech synthesized by WaveNet (open WaveNet) and WaveGlow while processing speech samples at a rate of more than 150 kHz on an NVIDIA Tesla P100.

Submitted to INTERSPEECH2019

References in corpus (9)

• Dual Learning for Machine Translation
• Unsupervised Cross-Domain Image Generation
• Convolutional Kernel Networks
• PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications
• Efficient Neural Audio Synthesis
• ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
• StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks
• WaveCycleGAN: Synthetic-to-natural speech waveform conversion using cycle-consistent adversarial networks
• Collapsed speech segment detection and suppression for WaveNet vocoder

Cited by in corpus (6)

• Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review
• ASVspoof 2019: A large-scale public database of synthesized, converted and replayed speech
• An explainability study of the constant Q cepstral coefficient spoofing countermeasure for automatic speaker verification
• Scyclone: High-Quality and Parallel-Data-Free Voice Conversion Using Spectrogram and Cycle-Consistent Adversarial Networks
• Articulatory-WaveNet: Autoregressive Model For Acoustic-to-Articulatory Inversion
• A Cyclical Post-filtering Approach to Mismatch Refinement of Neural Vocoder for Text-to-speech Systems