Why Adversarial Training of ReLU Networks Is Difficult?

Xu Cheng, Hao Zhang, Yue Xin +3

This paper mathematically derives an analytic solution of the adversarial perturbation on a ReLU network, and theoretically explains the difficulty of adversarial training. Specifi…