Adaptive Moment Estimation Optimization Algorithm Using Projection Gradient for Deep Learning

Yongqi Li, Xiaowei Zhang

Training deep neural networks is challenging. To accelerate training and enhance performance, we propose PadamP, a novel optimization algorithm. PadamP is derived by applying the a…