22 citations · 38 across the 9 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
math.OC2021
Inertial Newton Algorithms Avoiding Strict Saddle Points
Camille Castera
We study the asymptotic behavior of second-order algorithms mixing Newton's method and inertial gradient descent in non-convex landscapes. We show that, despite the Newtonian behav…
cs.LG2021★ 10 cited
Second-order step-size tuning of SGD for non-convex optimization
Camille Castera, Jérôme Bolte, Cédric Févotte +1
In view of a direct and simple improvement of vanilla SGD, this paper presents a fine-tuning of its step-sizes in the mini-batch case. For doing so, one estimates curvature, based…