Bounding The Number of Linear Regions in Local Area for Neural Networks with ReLU Activations

Rui Zhu, Bo Lin, Haixu Tang

The number of linear regions is one of the distinct properties of the neural networks using piecewise linear activation functions such as ReLU, comparing with those conventional on…