TokenChain: A Discrete Speech Chain via Semantic Token Modeling

Mingxuan Wang, Satoshi Nakamura

Machine Speech Chain, simulating the human perception-production loop, proves effective in jointly improving ASR and TTS. We propose TokenChain, a fully discrete speech chain coupl…