Characterizing the Discrete Geometry of ReLU Networks

Blake B. Gaines, Jinbo Bi

It is well established that ReLU networks define continuous piecewise-linear functions, and that their linear regions are polyhedra in the input space. These regions form a complex…