1 citations · 2 across the 9 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
Towards Better Generalization: Weight Decay Induces Low-rank Bias for Neural Networks
Ke Chen, Chugang Yi, Haizhao Yang
We study the implicit bias towards low-rank weight matrices when training neural networks (NN) with Weight Decay (WD). We prove that when a ReLU NN is sufficiently trained with Sto…
cs.LG2024
FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model
Zezheng Song, Jiaxin Yuan, Haizhao Yang
The fast simulation of dynamical systems is a key challenge in many scientific and engineering applications, such as weather forecasting, disease control, and drug discovery. With…
cs.SC2024★ 1 cited
A Fast Algorithm for the Finite Expression Method in Learning Dynamics on Complex Networks
Zezheng Song, Chunmei Wang, Haizhao Yang
Complex network data is prevalent in various real-world domains, including physical, technological, and biological systems. Despite this prevalence, predicting trends and understan…