A New Perspective of Accelerated Gradient Methods: The Controlled Invariant Manifold Approach

Revati Gunjal, Sushama Wagh, Syed Shadab Nayyer +2

Gradient Descent (GD) is a ubiquitous algorithm for finding the optimal solution to an optimization problem. For reduced computational complexity, the optimal solution $\mathrm{x^*…