Deforming the Loss Surface to Affect the Behaviour of the Optimizer

Liangming Chen, Long Jin, Xiujuan Du +2

In deep learning, it is usually assumed that the optimization process is conducted on a shape-fixed loss surface. Differently, we first propose a novel concept of deformation mappi…