Linear-Size Neural Network Representation of Piecewise Affine Functions in ${\mathbb{R}}^2$

Leo Zanotti

It is shown that any continuous piecewise affine (CPA) function ${\mathbb{R}}^2\to \mathbb{R}$ with $p$ pieces can be represented by a ReLU neural network with two hidden layers and $…