Stochastic Ratios Tracking Algorithm for Large Scale Machine Learning Problems

Shigeng Sun, Yuchen Xie

Many machine learning applications and tasks rely on the stochastic gradient descent (SGD) algorithm and its variants. Effective step length selection is crucial for the success of…