On the fibers and semi-algebraicity of ReLU neuromanifolds

Axel Flinth, Stefano Mereta, Michele Pernice

We study the semi-algebraicity of the neuromanifold ${\mathcal{M}}_{\mathbf{d}}$ of a feedforward ReLU neural network and its symmetries. We prove that ${\mathcal{M}}_{\mathbf{d}}$ is not…