789 citations · 3.9k across the 31 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
math.OC2016
A Limited-Memory Quasi-Newton Algorithm for Bound-Constrained Nonsmooth Optimization
Nitish Shirish Keskar, Andreas Waechter
We consider the problem of minimizing a continuous function that may be nonsmooth and nonconvex, subject to bound constraints. We propose an algorithm that uses the L-BFGS quasi-Ne…
cs.LG2016★ 571 cited
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima
Nitish Shirish Keskar, Dheevatsa Mudigere, Jorge Nocedal +2
The stochastic gradient descent (SGD) method and its variants are algorithms of choice for many Deep Learning tasks. These methods operate in a small-batch regime wherein a fractio…