Geometric separation and constructive universal approximation with two hidden layers

Chanyoung Sung

We give a geometric construction of neural networks that separate disjoint compact subsets of ${\mathbb{R}}^n$, and use it to obtain a constructive universal approximation theorem. Speci…