Mini-Batch Stochastic Conjugate Gradient Algorithms with Minimal Variance

Feifei Gao, Caixia Kou, Yu-Hong Dai

Stochastic gradient descent (SGD) methods have gained widespread popularity for solving large-scale optimization problems. However, the inherent variance in SGD often leads to slow…