4 citations · 5 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 4 cited
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape
Devansh Bisla, Jing Wang, Anna Choromanska
In this paper, we study the sharpness of a deep learning (DL) loss landscape around local minima in order to reveal systematic mechanisms underlying the generalization abilities of…
cs.LG2021★ 1 cited
AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop
Yunfei Teng, Jing Wang, Anna Choromanska
Modern deep learning (DL) architectures are trained using variants of the SGD algorithm that is run with a defined learning rate schedule, i.e., the learning ra…