Mathematical Vocoder Algorithm : Modified Spectral Inversion for Efficient Neural Speech Synthesis
arXiv:2106.03167
Abstract
In this work, we propose a new mathematical vocoder algorithm(modified spectral inversion) that generates a waveform from acoustic features without phase estimation. The main benefit of using our proposed method is that it excludes the training stage of the neural vocoder from the end-to-end speech synthesis model. Our implementation can synthesize high fidelity speech at approximately 20 Mhz on CPU and 59.6MHz on GPU. This is 909 and 2,702 times faster compared to real-time. Since the proposed methodology is not a data-driven method, it is applicable to unseen voices and multiple languages without any additional work. The proposed method is expected to adapt for researching on neural network models capable of synthesizing speech at the studio recording level.
arXiv commentsee sample in https://its10041004.github.io/MVA/
References in corpus (6)
- HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
- Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis
- Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions
- Tacotron: Towards End-to-End Speech Synthesis
- High Fidelity Speech Synthesis with Adversarial Networks
- Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning