Neural Polytopes

Koji Hashimoto, Tomoya Naito, Hisashi Naito

We find that simple neural networks with ReLU activation generate polytopes as an approximation of a unit sphere in various dimensions. The species of polytopes are regulated by th…