Convergence of Riemannian Stochastic Gradient Descent on Hadamard Manifold

Hiroyuki Sakai, Hideaki Iiduka

Novel convergence analyses are presented of Riemannian stochastic gradient descent (RSGD) on a Hadamard manifold. RSGD is the most basic Riemannian stochastic optimization algorith…