103 citations · 311 across the 16 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 103 cited
Gradient descent aligns the layers of deep linear networks
Ziwei Ji, Matus Telgarsky
This paper establishes risk convergence and asymptotic weight matrix alignment --- a form of implicit regularization --- of gradient flow and gradient descent when applied to deep…
cs.LG2018★ 64 cited
Risk and parameter convergence of logistic regression
Ziwei Ji, Matus Telgarsky
Gradient descent, when applied to the task of logistic regression, outputs iterates which are biased to follow a unique ray defined by the data. The direction of this ray is the ma…