Taming Audio VAEs via Target-KL Regularization

Prem Seetharaman, Rithesh Kumar

Latent diffusion models have emerged as the dominant paradigm for many generation tasks including audio generation such as text-to-audio, text-to-music and text-to-speech. A key co…