5 citations · 7 across the 4 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021★ 1 cited
AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop
Yunfei Teng, Jing Wang, Anna Choromanska
Modern deep learning (DL) architectures are trained using variants of the SGD algorithm that is run with a defined learning rate schedule, i.e., the learning ra…
cs.LG2020
Overcoming Catastrophic Forgetting via Direction-Constrained Optimization
Yunfei Teng, Anna Choromanska, Murray Campbell +3
This paper studies a new design of the optimization algorithm for training deep learning models with a fixed architecture of the classification network in a continual learning fram…
cs.LG2019★ 1 cited
Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models: Extension
Yunfei Teng, Wenbo Gao, Francois Chalus +3
We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a re…