Deep Representation with ReLU Neural Networks

Andreas Heinecke, Wen-Liang Hwang

We consider deep feedforward neural networks with rectified linear units from a signal processing perspective. In this view, such representations mark the transition from using a s…