Existence, uniqueness, and convergence rates for gradient flows in the training of artificial neural networks with ReLU activation

Simon Eberle, Arnulf Jentzen, Adrian Riekert +1

The training of artificial neural networks (ANNs) with rectified linear unit (ReLU) activation via gradient descent (GD) type optimization schemes is nowadays a common industrially…