138 citations · 349 across the 10 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 8 cited
SALR: Sharpness-aware Learning Rate Scheduler for Improved Generalization
Xubo Yue, Maher Nouiehed, Raed Al Kontar
In an effort to improve generalization in deep learning and automate the process of learning rate scheduling, we propose SALR: a sharpness-aware learning rate update technique desi…
math.OC2020★ 123 cited
Non-convex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances
Meisam Razaviyayn, Tianjian Huang, Songtao Lu +3
The min-max optimization problem, also known as the saddle point problem, is a classical optimization problem which is also studied in the context of zero-sum games. Given a class…