The activity-weight duality in feed forward neural networks: The geometric determinants of generalization

Yu Feng, Yuhai Tu

One of the fundamental problems in machine learning is generalization. In neural network models with a large number of weights (parameters), many solutions can be found to fit the…