84 citations · 226 across the 21 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 2 cited
Symmetries, flat minima, and the conserved quantities of gradient flow
Bo Zhao, Iordan Ganev, Robin Walters +2
Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys. Yet, little is known about the theoretical ori…
cs.LG2022
Faster Optimization on Sparse Graphs via Neural Reparametrization
Nima Dehmamy, Csaba Both, Jianzhi Long +1
In mathematical optimization, second-order Newton's methods generally converge faster than first-order methods, but they require the inverse of the Hessian, hence are computational…
cs.LG2022★ 3 cited
Symmetry Teleportation for Accelerated Optimization
Bo Zhao, Nima Dehmamy, Robin Walters +1
Existing gradient-based optimization methods update parameters locally, in a direction that minimizes the loss function. We study a different approach, symmetry teleportation, that…