CGD: Modifying the Loss Landscape by Gradient Regularization

Shikhar Saxena, Tejas Bodas, Arti Yardi

Line-search methods are commonly used to solve optimization problems. The simplest line search method is steepest descent where one always moves in the direction of the negative gr…