Showing math.STShow all
2 papers · 1 filter
math.ST2026
Complexity reduction in online stochastic Newton methods with potential O(N d) total cost
Antoine Godichon-Baggioni, Bruno Portier, Guillaume Sallé
Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first…
math.ST2024
A Full Adagrad algorithm with O(Nd) operations
Antoine Godichon-Baggioni, Wei Lu, Bruno Portier
A novel approach is given to overcome the computational challenges of the full-matrix Adaptive Gradient algorithm (Full AdaGrad) in stochastic optimization. By developing a recursi…