Towards a regularity theory for ReLU networks -- chain rule and global error estimates

Julius Berner, Dennis Elbrächter, Philipp Grohs +1

Although for neural networks with locally Lipschitz continuous activation functions the classical derivative exists almost everywhere, the standard chain rule is in general not app…