35 citations · 44 across the 6 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cond-mat.dis-nn2022★ 1 cited
Effective Dynamics of Generative Adversarial Networks
Steven Durr, Youssef Mroueh, Yuhai Tu +1
Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statist…
cond-mat.dis-nn2022★ 35 cited
Stochastic gradient descent introduces an effective landscape-dependent regularization favoring flat solutions
Ning Yang, Chao Tang, Yuhai Tu
Generalization is one of the most important problems in deep learning (DL). In the overparameterized regime in neural networks, there exist many low-loss solutions that fit the tra…
cs.LG2022
The activity-weight duality in feed forward neural networks: The geometric determinants of generalization
Yu Feng, Yuhai Tu
One of the fundamental problems in machine learning is generalization. In neural network models with a large number of weights (parameters), many solutions can be found to fit the…