A Framework for the construction of upper bounds on the number of affine linear regions of ReLU feed-forward neural networks

Peter Hinz, Sara van de Geer

We present a framework to derive upper bounds on the number of regions that feed-forward neural networks with ReLU activation functions are affine linear on. It is based on an indu…