Adaptive Stochastic Gradient Descents on Manifolds with an Application on Weighted Low-Rank Approximation

Abstract

We prove a convergence theorem for stochastic gradient descents on manifolds with adaptive learning rate and apply it to the weighted low-rank approximation problem.