76 citations · 226 across the 9 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
stat.ML2017★ 76 cited
First-order Methods Almost Always Avoid Saddle Points
Jason D. Lee, Ioannis Panageas, Georgios Piliouras +3
We establish that first-order methods avoid saddle points for almost all initializations. Our results apply to a wide variety of first-order methods, including gradient descent, bl…
cs.GT2017★ 60 cited
Multiplicative Weights Update with Constant Step-Size in Congestion Games: Convergence, Limit Cycles and Chaos
Gerasimos Palaiopanos, Ioannis Panageas, Georgios Piliouras
The Multiplicative Weights Update (MWU) method is a ubiquitous meta-algorithm that works as follows: A distribution is maintained on a certain set, and at each step the probability…