A Methodology Establishing Linear Convergence of Adaptive Gradient Methods under PL Inequality

Kushal Chakrabarti, Mayank Baranwal

Adaptive gradient-descent optimizers are the standard choice for training neural network models. Despite their faster convergence than gradient-descent and remarkable performance i…