517 citations · 580 across the 9 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.LG2021★ 1 cited
Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training
Huy Tuan Pham, Phan-Minh Nguyen
The mean field (MF) theory of multilayer neural networks centers around a particular infinite-width scaling, where the learning dynamics is closely tracked by the MF limit. A rando…
cs.LG2021★ 4 cited
Global Convergence of Three-layer Neural Networks in the Mean Field Regime
Huy Tuan Pham, Phan-Minh Nguyen
In the mean field regime, neural networks are appropriately scaled so that as the width tends to infinity, the learning dynamics tends to a nonlinear and nontrivial dynamical limit…
cs.LG2021★ 7 cited
Analysis of feature learning in weight-tied autoencoders via the mean field lens
Phan-Minh Nguyen
Autoencoders are among the earliest introduced nonlinear models for unsupervised learning. Although they are widely adopted beyond research, it has been a longstanding open problem…