Concavifiability and convergence: necessary and sufficient conditions for gradient descent analysis

Thulasi Tholeti, Sheetal Kalyani

Convergence of the gradient descent algorithm has been attracting renewed interest due to its utility in deep learning applications. Even as multiple variants of gradient descent w…