Better Neural Network Expressivity: Subdividing the Simplex

Egor Bakaev, Florestan Brunck, Christoph Hertrich +2

This work studies the expressivity of ReLU neural networks with a focus on their depth. A sequence of previous works showed that $\lceil {\log }_2(n+1)\rceil$ hidden layers are suffi…