76 citations · 93 across the 15 of their papers we have counts for
4 papers · 1 filter
Gradient Descent on Logistic Regression: Do Large Step-Sizes Work with Data on the Sphere?
Si Yi Meng, Baptiste Goujaud, Antonio Orvieto +1
Gradient descent on logistic regression has many fascinating properties not fully captured by classical analyses. For linearly separable data, the iterates converge in direction to…
Proving Linear Mode Connectivity of Neural Networks via Optimal Transport
Damien Ferbach, Baptiste Goujaud, Gauthier Gidel +1
The energy landscape of high-dimensional non-convex optimization problems is crucial to understanding the effectiveness of modern deep neural network architectures. Recent works ha…
A Study of Condition Numbers for First-Order Optimization
Charles Guille-Escuret, Baptiste Goujaud, Manuela Girotti +1
The study of first-order optimization algorithms (FOA) typically starts with assumptions on the objective functions, most commonly smoothness and strong convexity. These metrics ar…
Gradient based sample selection for online continual learning
Rahaf Aljundi, Min Lin, Baptiste Goujaud +1
A continual learning agent learns online with a non-stationary and never-ending stream of data. The key to such learning process is to overcome the catastrophic forgetting of previ…