138 citations · 310 across the 39 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2022★ 1 cited
Exact Solutions of a Deep Linear Network
Liu Ziyin, Botao Li, Xiangming Meng
This work finds the analytical expression of the global minima of a deep linear network with weight decay and stochastic neurons, a fundamental model for understanding the landscap…
stat.ML2020★ 3 cited
Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
Kangqiao Liu, Liu Ziyin, Masahito Ueda
In the vanishing learning rate regime, stochastic gradient descent (SGD) is now relatively well understood. In this work, we propose to study the basic properties of SGD and its va…