Discrete Diffusion for Generative Modeling of Text-Aligned Speech Tokens

Pin-Jui Ku, He Huang, Jean-Marie Lemercier +3

This paper introduces a discrete diffusion model (DDM) framework for text-aligned speech tokenization and reconstruction. By replacing the auto-regressive speech decoder with a dis…