Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It?

Alexander Shabalin, Simon Elistratov, Viacheslav Meshchaninov +2

Diffusion models have become a standard approach for generative modeling in continuous domains, yet their application to discrete data remains challenging. We investigate why Gauss…