Single-stage TTS with Masked Audio Token Modeling and Semantic Knowledge Distillation

Gerard I. Gállego, Roy Fejgin, Chunghsin Yeh +2

Audio token modeling has become a powerful framework for speech synthesis, with two-stage approaches employing semantic tokens remaining prevalent. In this paper, we aim to simplif…