Nonclosedness of Sets of Neural Networks in Sobolev Spaces

Scott Mahan, Emily King, Alex Cloninger

We examine the closedness of sets of realized neural networks of a fixed architecture in Sobolev spaces. For an exactly $m$-times differentiable activation function $\rho$, we constru…