A Mechanistic Study of Algorithmic Generalization in Diffusion Models on Modular Arithmetic

Joon Hyeok Kim, Yong-Hyun Park, Mattis Dalsætra Østby +1

Despite their empirical success, how diffusion models generalize remains poorly understood from a mechanistic perspective. In this work, we provide a controlled mechanistic account…