Gradient Descent in the Absence of Global Lipschitz Continuity of the Gradients

Vivak Patel, Albert S. Berahas

Gradient descent (GD) is a collection of continuous optimization methods that have achieved immeasurable success in practice. Owing to data science applications, GD with diminishin…