Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks

Huixiu Jiang, Ling Yang, Yu Bao +2

Stochastic optimization plays a crucial role in the advancement of deep learning technologies. Over the decades, significant effort has been dedicated to improving the training eff…