31 citations · 34 across the 4 of their papers we have counts for
11 papers
Linear Stability Hypothesis and Rank Stratification for Nonlinear Models
Yaoyu Zhang, Zhongwang Zhang, Leyang Zhang +3
Models with nonlinear architectures/parameterizations such as deep neural networks (DNNs) are well known for their mysteriously good generalization performance at overparameterizat…
Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks
Yaoyu Zhang, Tao Luo, Zheng Ma +1
Why heavily parameterized neural networks (NNs) do not overfit the data is an important long standing open question. We propose a phenomenological model of the NN training to expla…
Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning
Tao Luo, Zheng Ma, Zhiwei Wang +2
A supervised learning problem is to find a function in a hypothesis function space given values on isolated data points. Inspired by the frequency principle in neural networks, we…
A deep learning-based ODE solver for chemical kinetics
Tianhan Zhang, Yaoyu Zhang, Weinan E +1
Developing efficient and accurate algorithms for chemistry integration is a challenging task due to its strong stiffness and high dimensionality. The current work presents a deep l…
On the exact computation of linear frequency principle dynamics and its generalization
Tao Luo, Zheng Ma, Zhi-Qin John Xu +1
Recent works show an intriguing phenomenon of Frequency Principle (F-Principle) that deep neural networks (DNNs) fit the target function from low to high frequency during the train…
Phase diagram for two-layer ReLU neural networks at infinite-width limit
Tao Luo, Zhi-Qin John Xu, Zheng Ma +1
How neural network behaves during the training over different choices of hyperparameters is an important question in the study of neural networks. In this work, inspired by the pha…