Learning complexity of gradient descent and conjugate gradient algorithms

Xianqi Jiao, Jia Liu, Zhiping Chen

Gradient Descent (GD) and Conjugate Gradient (CG) methods are among the most effective iterative algorithms for solving unconstrained optimization problems, particularly in machine…