Deep Neural Variation Spaces: A Unifying Perspective on Depth and Complexity

Julia Nakhleh, Robert D. Nowak

We develop a unified function space theory of deep fully connected neural networks. Functions in our spaces are defined recursively as ${\ell }^1$-bounded linear combinations of activ…