Improved universal approximation with neural networks studied via affine-invariant subspaces of $L_2({\mathbb{R}}^n)$

Cornelia Schneider, Samuel Probst

We show that there are no non-trivial closed subspaces of $L_2({\mathbb{R}}^n)$ that are invariant under invertible affine transformations. We apply this result to neural networks sh…