5 papers · 1 filter
A Geometric Analysis of PCA
Ayoub El Hanchi, Murat Erdogdu, Chris Maddison
What property of the data distribution determines the excess risk of principal component analysis? In this paper, we provide a precise answer to this question. We establish a centr…
Sampling from the Mean-Field Stationary Distribution
Yunbum Kook, Matthew S. Zhang, Sinho Chewi +2
We study the complexity of sampling from the stationary distribution of a mean-field SDE, or equivalently, the complexity of minimizing a functional over the space of probability m…
Minimax Linear Regression under the Quantile Risk
Ayoub El Hanchi, Chris J. Maddison, Murat A. Erdogdu
We study the problem of designing minimax procedures in linear regression under the quantile risk. We start by considering the realizable setting with independent Gaussian noise, w…
Optimal Excess Risk Bounds for Empirical Risk Minimization on -Norm Linear Regression
Ayoub El Hanchi, Murat A. Erdogdu
We study the performance of empirical risk minimization on the -norm linear regression problem for . We show that, in the realizable case, under no moment ass…
A Separation in Heavy-Tailed Sampling: Gaussian vs. Stable Oracles for Proximal Samplers
Ye He, Alireza Mousavi-Hosseini, Krishnakumar Balasubramanian +1
We study the complexity of heavy-tailed sampling and present a separation result in terms of obtaining high-accuracy versus low-accuracy guarantees i.e., samplers that require only…