15 citations · 18 across the 2 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
math.OC2020★ 15 cited
A new framework for the computation of Hessians
Robert M. Gower, Margarida P. Mello
We investigate the computation of Hessian matrices via Automatic Differentiation, using a graph model and an algebraic model. The graph model reveals the inherent symmetries involv…
cs.LG2020★ 3 cited
Unified Analysis of Stochastic Gradient Methods for Composite Convex and Smooth Optimization
Ahmed Khaled, Othmane Sebbouh, Nicolas Loizou +2
We present a unified theorem for the convergence analysis of stochastic gradient algorithms for minimizing a smooth and convex loss plus a convex regularizer. We do this by extendi…