Proximal Adam: Robust Adaptive Update Scheme for Constrained Optimization

Peter Melchior, Rémy Joseph, Fred Moolekamp

We implement the adaptive step size scheme from the optimization methods AdaGrad and Adam in a novel variant of the Proximal Gradient Method (PGM). Our algorithm, dubbed AdaProx, a…