A Theoretical Study of Neural Network Expressive Power via Manifold Topology

Jiachen Yao, Mayank Goswami, Chao Chen

A prevalent assumption regarding real-world data is that it lies on or close to a low-dimensional manifold. When deploying a neural network on data manifolds, the required size, i.…