Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints

Ram Padmanabhan, Peter Seiler

The framework of Integral Quadratic Constraints (IQCs) is used to perform an analysis of gradient descent with varying step sizes. Two performance metrics are considered: convergen…