Semantic-VAE: Semantic-Alignment Latent Representation for Better Speech Synthesis

Zhikang Niu, Shujie Hu, Jeongsoo Choi +8

Mel-spectrograms have been widely used in zero-shot text-to-speech (TTS); their inherent redundancy leads to inefficiency in text-speech alignment. Compact VAE-based latent represe…