10 citations · 33 across the 10 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 8 cited
Defects of Convolutional Decoder Networks in Frequency Representation
Ling Tang, Wen Shen, Zhanpeng Zhou +2
In this paper, we prove the representation defects of a cascaded convolutional decoder network, considering the capacity of representing different frequency components of an input…
cs.LG2022
Batch Normalization Is Blind to the First and Second Derivatives of the Loss
Zhanpeng Zhou, Wen Shen, Huixin Chen +2
In this paper, we prove the effects of the BN operation on the back-propagation of the first and second derivatives of the loss. When we do the Taylor series expansion of the loss…
cs.LG2022★ 2 cited
Why Adversarial Training of ReLU Networks Is Difficult?
Xu Cheng, Hao Zhang, Yue Xin +3
This paper mathematically derives an analytic solution of the adversarial perturbation on a ReLU network, and theoretically explains the difficulty of adversarial training. Specifi…