5 papers
Local Coverage Governs Memorization in Diffusion Models
Claudia Merger, Sebastian Goldt
Memorization in diffusion models is often treated as a global property of the model or dataset. In practice, however, a single diffusion model can simultaneously generate both memo…
A theory of learning data statistics in diffusion models, from easy to hard
Lorenzo Bardone, Claudia Merger, Sebastian Goldt
While diffusion models have emerged as a powerful class of generative models, their learning dynamics remain poorly understood. We address this issue first by empirically showing t…
A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights
Fabiola Ricci, Claudia Merger, Sebastian Goldt
Neural networks trained with gradient-based methods exhibit a strong simplicity bias: they learn simpler statistical features of their data before moving to more complex features.…
Generalization Dynamics of Linear Diffusion Models
Claudia Merger, Sebastian Goldt
Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization wit…
Characterizing Neural Manifolds' Properties and Curvatures using Normalizing Flows
Peter Bouss, Sandra Nestler, Kirsten Fischer +3
Neuronal activity is found to lie on low-dimensional manifolds embedded within the high-dimensional neuron space. Variants of principal component analysis are frequently employed t…