Improved high-dimensional estimation with Langevin dynamics and stochastic weight averaging

Stanley Wei, Alex Damian, Jason D. Lee

Significant recent work has studied the ability of gradient descent to recover a hidden planted direction ${\theta }^{\star }\in S^{d-1}$ in different high-dimensional settings, including te…