3 citations · 5 across the 3 of their papers we have counts for
3 papers
cs.CV2021★ 3 cited
Activated Gradients for Deep Neural Networks
Mei Liu, Liangming Chen, Xiaohao Du +2
Deep neural networks often suffer from poor performance or even training failure due to the ill-conditioned problem, the vanishing/exploding gradient problem, and the saddle point…
cs.LG2020★ 2 cited
Deforming the Loss Surface to Affect the Behaviour of the Optimizer
Liangming Chen, Long Jin, Xiujuan Du +2
In deep learning, it is usually assumed that the optimization process is conducted on a shape-fixed loss surface. Differently, we first propose a novel concept of deformation mappi…
cs.CV2020
Deforming the Loss Surface
Liangming Chen, Long Jin, Xiujuan Du +2
In deep learning, it is usually assumed that the shape of the loss surface is fixed. Differently, a novel concept of deformation operator is first proposed in this paper to deform…