68 citations · 68 across the 1 of their papers we have counts for
2 papers
cs.LG2018★ 108 cited
Gradient Descent Happens in a Tiny Subspace
Guy Gur-Ari, Daniel A. Roberts, Ethan Dyer
We show that in a variety of large-scale deep learning scenarios the gradient dynamically converges to a very small subspace after a short period of training. The subspace is spann…
hep-th2014★ 68 cited
Hawking-Page transition in holographic massive gravity
Allan Adams, Daniel A. Roberts, Omid Saremi
We study the Hawking-Page transition in a holographic model of field theories with momentum dissipation. We find that the deconfinement temperature strictly decreases as momentum d…