Adynamical systems view of training generativemodels and the memorization phenomenon

Siva Athreya, Chiranjib Bhattacharya, Vivek S. Borkar

Using recent works of one of the authors (VSB) on collapse in generative models and two time scale dynamics in stochastic gradient descent in high dimensions, we give a system theo…