Diffusion Models Memorize in Training -- and Generalize in Inference

Tim Kaiser, Markus Kollmann

Diffusion models generalize well in practice. However, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what…