167 citations · 293 across the 8 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019★ 5 cited
Implicit Regularization and Convergence for Weight Normalization
Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren +5
Normalization methods such as batch [Ioffe and Szegedy, 2015], weight [Salimansand Kingma, 2016], instance [Ulyanov et al., 2016], and layer normalization [Baet al., 2016] have bee…
cs.LG2019★ 8 cited
Learning Distributions Generated by One-Layer ReLU Networks
Shanshan Wu, Alexandros G. Dimakis, Sujay Sanghavi
We consider the problem of estimating the parameters of a -dimensional rectified Gaussian distribution from i.i.d. samples. A rectified Gaussian distribution is defined by passi…