Gauss-Newton drifting extends natural gradient descent

Théo Dumont, Théo Lacombe, François-Xavier Vialard

Drifting methods have recently been introduced as a promising new paradigm for training generative models, and have attracted a lot of attention so far. In this work, we focus on h…