69 citations · 455 across the 44 of their papers we have counts for
4 papers · 1 filter
Robustness Implies Generalization via Data-Dependent Generalization Bounds
Kenji Kawaguchi, Zhun Deng, Kyle Luh +1
This paper proves that robustness implies generalization via data-dependent generalization bounds. As a result, robustness and generalization are shown to be connected closely in a…
Towards Understanding the Dynamics of the First-Order Adversaries
Zhun Deng, Hangfeng He, Jiaoyang Huang +1
An acknowledged weakness of neural networks is their vulnerability to adversarial perturbations to the inputs. To improve the robustness of these models, one of the most popular de…
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy
Jiaoyang Huang, Horng-Tzer Yau
The evolution of a deep neural network trained by the gradient descent can be described by its neural tangent kernel (NTK) as introduced in [20], where it was proven that in the in…
Effect of Depth and Width on Local Minima in Deep Learning
Kenji Kawaguchi, Jiaoyang Huang, Leslie Pack Kaelbling
In this paper, we analyze the effects of depth and width on the quality of local minima, without strong over-parameterization and simplification assumptions in the literature. With…