output
20112022
most citedMultidimensional Economic Complexity and Inclusive Green Growth

128 citations

researchers with a paper here

Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.

collaborating institutions
Showing 2021 · cs.LGShow all

2 papers · 2 filters

cs.LG2021★ 1 cited

Numerical influence of ReLU'(0) on backpropagation

David Bertoin, Jérôme Bolte, Sébastien Gerchinovitz +1

In theory, the choice of ReLU(0) in [0, 1] for a neural network has a negligible influence both on backpropagation and training. Yet, in the real world, 32 bits default precision c…

cs.LG2021★ 10 cited

Second-order step-size tuning of SGD for non-convex optimization

Camille Castera, Jérôme Bolte, Cédric Févotte +1

In view of a direct and simple improvement of vanilla SGD, this paper presents a fine-tuning of its step-sizes in the mini-batch case. For doing so, one estimates curvature, based…