output
20112022
most citedMultidimensional Economic Complexity and Inclusive Green Growth

128 citations

Showing cs.LGShow all

5 papers · 1 filter

cs.LG2022

Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems

Jérôme Bolte, Edouard Pauwels, Antonio Silveti-Falls

We leverage path differentiability and a recent result on nonsmooth implicit differentiation calculus to give sufficient conditions ensuring that the solution to a monotone inclusi…

cs.LG2021★ 1 cited

Numerical influence of ReLU'(0) on backpropagation

David Bertoin, Jérôme Bolte, Sébastien Gerchinovitz +1

In theory, the choice of ReLU(0) in [0, 1] for a neural network has a negligible influence both on backpropagation and training. Yet, in the real world, 32 bits default precision c…

cs.LG2021★ 10 cited

Second-order step-size tuning of SGD for non-convex optimization

Camille Castera, Jérôme Bolte, Cédric Févotte +1

In view of a direct and simple improvement of vanilla SGD, this paper presents a fine-tuning of its step-sizes in the mini-batch case. For doing so, one estimates curvature, based…

cs.LG2019★ 3 cited

ROI Maximization in Stochastic Online Decision-Making

Nicolò Cesa-Bianchi, Tommaso Cesari, Yishay Mansour +1

We introduce a novel theoretical framework for Return On Investment (ROI) maximization in repeated decision-making. Our setting is motivated by the use case of companies that regul…

cs.LG2019★ 8 cited

Cooperative Online Learning: Keeping your Neighbors Updated

Nicolò Cesa-Bianchi, Tommaso R. Cesari, Claire Monteleoni

We study an asynchronous online learning setting with a network of agents. At each time step, some of the agents are activated, requested to make a prediction, and pay the correspo…