Spline Representation and Redundancies of One-Dimensional ReLU Neural Network Models

Gerlind Plonka, Yannick Riebe, Yurii Kolomoitsev

We analyze the structure of a one-dimensional deep ReLU neural network (ReLU DNN) in comparison to the model of continuous piecewise linear (CPL) spline functions with arbitrary kn…