2.3k citations · 11.9k across the 167 of their papers we have counts for
3 papers · 1 filter
The Statistics of Streaming Sparse Regression
Jacob Steinhardt, Stefan Wager, Percy Liang
We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresen…
Altitude Training: Strong Bounds for Single-Layer Dropout
Stefan Wager, William Fithian, Sida Wang +1
Dropout training, originally designed for deep neural networks, has been successful on high-dimensional single-layer natural language tasks. This paper proposes a theoretical expla…
Relaxations for inference in restricted Boltzmann machines
Sida I. Wang, Roy Frostig, Percy Liang +1
We propose a relaxation-based approximate inference algorithm that samples near-MAP configurations of a binary pairwise Markov random field. We experiment on MAP inference tasks in…