4 papers
Global minimization at uniform exponential rate via geometrically adapted gradient descent in Deep Learning
Thomas Chen
We consider the scenario of supervised learning in Deep Learning (DL) networks, and exploit the arbitrariness of choice in the Riemannian metric relative to which the gradient desc…
Geometric structure of shallow neural networks and constructive cost minimization
Thomas Chen, PatrÃcia Muñoz Ewald
In this paper, we approach the problem of cost (loss) minimization in underparametrized shallow ReLU networks through the explicit construction of upper bounds which appeal to the…
Interpretable global minima of deep ReLU neural networks on sequentially separable data
Thomas Chen, PatrÃcia Muñoz Ewald
We explicitly construct zero loss neural network classifiers. We write the weight matrices and bias vectors in terms of cumulative parameters, which determine truncation maps actin…
On non-approximability of zero loss global minimizers by gradient descent in Deep Learning
Thomas Chen, Patricia Muñoz Ewald
We analyze geometric aspects of the gradient descent algorithm in Deep Learning (DL), and give a detailed discussion of the circumstance that in underparametrized DL networks, zero…