SGDLibrary: A MATLAB library for stochastic gradient descent algorithms
arXiv:1710.10951
Abstract
We consider the problem of finding the minimizer of a function of the finite-sum form . This problem has been studied intensively in recent years in the field of machine learning (ML). One promising approach for large-scale data is to use a stochastic optimization algorithm to solve the problem. SGDLibrary is a readable, flexible and extensible pure-MATLAB library of a collection of stochastic optimization algorithms. The purpose of the library is to provide researchers and implementers a comprehensive evaluation environment for the use of these algorithms on various ML problems.
References in corpus (7)
- ADADELTA: An Adaptive Learning Rate Method
- SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
- RES: Regularized Stochastic BFGS Algorithm
- A Linearly-Convergent Stochastic L-BFGS Algorithm
- Global Convergence of Online Limited Memory BFGS
- Barzilai-Borwein Step Size for Stochastic Gradient Descent
- SARAH: A Novel Method for Machine Learning Problems Using Stochastic Recursive Gradient